DOI:10.35833/MPCE.2022.000271 Sequential Reconfiguration of Unbalanced Distribution Network with Soft Open Points Based on Deep Reinforcement Learning Page view: 35        Net amount: 104 Author: Ziyang Yin, Shouxiang Wang, Qianyu Zhao Author Affiliation: Key Laboratory of Smart Grid of Ministry of Education, Tianjin University, Tianjin 300072, China Foundation: This work was supported in part by the Smart Grid Joint Fund Integration Program of National Natural Science Foundation of China and State Grid Corporation of China (No. U2166202) and National Natural Science Foundation of China (No. 52077149) Abstract: With the large-scale distributed generations (DGs) being connected to distribution network (DN), the traditional day-ahead reconfiguration methods based on physical models are challenged to maintain the robustness and avoid voltage off-limits. To address these problems, this paper develops a deep reinforcement learning method for the sequential reconfiguration with soft open points (SOPs) based on real-time data. A state-based decision model is first proposed by constructing a Marko decision process-based reconfiguration and SOP joint optimization model so that the decisions can be achieved in milliseconds. Then, a deep reinforcement learning joint framework including branching double deep Q network (BDDQN) and multi-policy soft actor-critic (MPSAC) is proposed, which has significantly improved the learning efficiency of the decision model in multi-dimensional mixed-integer action space. And the influence of DG and load uncertainty on control results has been minimized by using the real-time status of the DN to make control decisions. The numerical simulations on the IEEE 34-bus and 123-bus systems demonstrate that the proposed method can effectively reduce the operation cost and solve the overvoltage problem caused by high ratio of photovoltaic (PV) integration. Keywords: Data-driven ; distribution network reconfiguration ; deep reinforcement learning ; distributed generation Received:May 14, 2022               Online Time:2023/01/28 View Full Text       Download reader