Reinforcement Learning for Sequential Solar PV Policy Design under Uncertainty: An Agent-Based Approach

2026-09-04

AI Summary

该研究通过结合强化学习与基于代理的模型，解决在不确定性下设计有效的太阳能光伏政策问题，探索了不同政策偏好下的采用-成本权衡。

Abstract

Designing effective and fiscally sustainable policies for solar photovoltaic (PV) adoption requires balancing adoption gains against public expenditure under uncertainty and heterogeneous decision-making. This study formulates PV policy design as a sequential decision problem and integrates reinforcement learning (RL) with a stochastic agent-based model (ABM) that simulates yearly solar PV adoption under uncertainty. A policymaker agent selects annual incentives, including capital grants, subsidised loan rates, and feed-in tariffs, over a 16-year horizon. Adoption--cost trade-offs are explored by varying policy preferences within a scalarised reward framework. Policies are learned using PPO, SAC, and TD3 and evaluated under stochastic simulation. The results show that this approach produces a clear trade-off structure: the highest-adoption policy (TD3, $w_{\text{cost}}=0.5$) achieves approximately 4,145 adopters at a cost of EUR 41.73 million, while the lowest-cost policy (PPO, $w_{\text{cost}}=2.0$) reduces expenditure to EUR 7.27 million with 2,682 adopters. The balanced policy (PPO, $w_{\text{cost}}=1.6$) achieves 3,495 adopters at a cost of EUR 22.47 million. Across algorithms, consistent trade-off patterns are observed, indicating robustness of the adoption--cost relationship. Compared with static baseline policies, the RL framework explores a broader range of policy configurations. These findings demonstrate the potential of RL as a flexible tool for adaptive policy design under uncertainty.

Problem

• Reinforcement Learning
• Solar PV Policy Design
• Uncertainty
• Agent-Based Model
• Adoption-Cost Trade-offs

Innovation

• Reinforcement Learning
• Agent-Based Model
• Policy Design
• Solar PV Adoption
• Uncertainty