• 대한전기학회
Mobile QR Code QR CODE : The Transactions of the Korean Institute of Electrical Engineers
  • COPE
  • kcse
  • 한국과학기술단체총연합회
  • 한국학술지인용색인
  • Scopus
  • crossref
  • orcid
Title Power System Topology Control via Option-Critic Deep Reinforcement Learning
Authors 왕천(Chen Wang) ; 장호천(Haotian Zhang) ; 이민주(Minju Lee) ; 이명훈(Myoung Hoon Lee) ; 문준(Jun Moon)
DOI https://doi.org/10.5370/KIEE.2025.74.6.1030
Page pp.1030-1040
ISSN 1975-8359
Keywords Deep reinforcement learning; option-critic framework; topology control; smart grid.
Abstract In recent years, the integration of renewable energy sources into power systems has increased their complexity, making automated control and management more challenging. To address this issue, we propose OC-LSTM, a deep reinforcement learning (DRL) algorithm which integrates option-critic DRL with the long short-term memory (LSTM) neural network to efficiently manage power systems. The OC-LSTM algorithm extracts temporal features from the power system using the LSTM network and leverages the option-critic (OC) framework in DRL to learn policies for adjusting the system's topology, ensuring secure and efficient power transmission. Experimental results demonstrate that the OC-LSTM algorithm outperforms standard DRL algorithms during training, and ablation studies further confirm the effectiveness of LSTM in extracting power system features. Additionally, the OC-LSTM algorithm allows stable operation of the IEEE 5-Bus, IEEE 14-Bus and L2RPN WCCI 2020 power systems for 60 consecutive hours without the need for human intervention.