Load Frequency Active Disturbance Rejection Control for Multi-Source Power System Based on Soft Actor-Critic
To ensure the safe operation of an interconnected power system, it is necessary to maintain the stability of the frequency and the tie-line exchanged power. This is one of the hottest issues in the power system field and is usually called load frequency control. To overcome the influences of load di...
| Main Authors: | , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2021-08-01
|
| Series: | Energies |
| Subjects: | |
| Online Access: | https://www.mdpi.com/1996-1073/14/16/4804 |
| _version_ | 1797524077251919872 |
|---|---|
| author | Yuemin Zheng Jin Tao Hao Sun Qinglin Sun Zengqiang Chen Matthias Dehmer Quan Zhou |
| author_facet | Yuemin Zheng Jin Tao Hao Sun Qinglin Sun Zengqiang Chen Matthias Dehmer Quan Zhou |
| author_sort | Yuemin Zheng |
| collection | DOAJ |
| description | To ensure the safe operation of an interconnected power system, it is necessary to maintain the stability of the frequency and the tie-line exchanged power. This is one of the hottest issues in the power system field and is usually called load frequency control. To overcome the influences of load disturbances on multi-source power systems containing thermal power plants, hydropower plants, and gas turbine plants, we design a linear active disturbance rejection control (LADRC) based on the tie-line bias control mode. For LADRC, the parameter selection of the controller directly affects the response performance of the entire system, and it is usually not feasible to manually adjust parameters. Therefore, to obtain the optimal controller parameters, we use the Soft Actor-Critic algorithm in reinforcement learning to obtain the controller parameters in real time, and we design the reward function according to the needs of the power system. We carry out simulation experiments to verify the effectiveness of the proposed method. Compared with the results of other proportional–integral–derivative control techniques using optimization algorithms and LADRC with constant parameters, the proposed method shows significant advantages in terms of overshoot, undershoot, and settling time. In addition, by adding different disturbances to different areas of the multi-source power system, we demonstrate the robustness of the proposed control strategy. |
| first_indexed | 2024-03-10T08:52:12Z |
| format | Article |
| id | doaj.art-f9503f497e0941b989f228b2dce56d98 |
| institution | Directory Open Access Journal |
| issn | 1996-1073 |
| language | English |
| last_indexed | 2024-03-10T08:52:12Z |
| publishDate | 2021-08-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Energies |
| spelling | doaj.art-f9503f497e0941b989f228b2dce56d982023-11-22T07:27:42ZengMDPI AGEnergies1996-10732021-08-011416480410.3390/en14164804Load Frequency Active Disturbance Rejection Control for Multi-Source Power System Based on Soft Actor-CriticYuemin Zheng0Jin Tao1Hao Sun2Qinglin Sun3Zengqiang Chen4Matthias Dehmer5Quan Zhou6College of Artificial Intelligence, Nankai University, Tianjin 300350, ChinaCollege of Artificial Intelligence, Nankai University, Tianjin 300350, ChinaCollege of Artificial Intelligence, Nankai University, Tianjin 300350, ChinaCollege of Artificial Intelligence, Nankai University, Tianjin 300350, ChinaCollege of Artificial Intelligence, Nankai University, Tianjin 300350, ChinaDepartment of Computer Science, Swiss Distance University of Applied Sciences, 3900 Brig, SwitzerlandDepartment of Electrical Engineering and Automation, Aalto University, 02150 Espoo, FinlandTo ensure the safe operation of an interconnected power system, it is necessary to maintain the stability of the frequency and the tie-line exchanged power. This is one of the hottest issues in the power system field and is usually called load frequency control. To overcome the influences of load disturbances on multi-source power systems containing thermal power plants, hydropower plants, and gas turbine plants, we design a linear active disturbance rejection control (LADRC) based on the tie-line bias control mode. For LADRC, the parameter selection of the controller directly affects the response performance of the entire system, and it is usually not feasible to manually adjust parameters. Therefore, to obtain the optimal controller parameters, we use the Soft Actor-Critic algorithm in reinforcement learning to obtain the controller parameters in real time, and we design the reward function according to the needs of the power system. We carry out simulation experiments to verify the effectiveness of the proposed method. Compared with the results of other proportional–integral–derivative control techniques using optimization algorithms and LADRC with constant parameters, the proposed method shows significant advantages in terms of overshoot, undershoot, and settling time. In addition, by adding different disturbances to different areas of the multi-source power system, we demonstrate the robustness of the proposed control strategy.https://www.mdpi.com/1996-1073/14/16/4804load frequency controllinear active disturbance rejection controlsoft actor-criticmulti-source power systemreinforcement learning |
| spellingShingle | Yuemin Zheng Jin Tao Hao Sun Qinglin Sun Zengqiang Chen Matthias Dehmer Quan Zhou Load Frequency Active Disturbance Rejection Control for Multi-Source Power System Based on Soft Actor-Critic Energies load frequency control linear active disturbance rejection control soft actor-critic multi-source power system reinforcement learning |
| title | Load Frequency Active Disturbance Rejection Control for Multi-Source Power System Based on Soft Actor-Critic |
| title_full | Load Frequency Active Disturbance Rejection Control for Multi-Source Power System Based on Soft Actor-Critic |
| title_fullStr | Load Frequency Active Disturbance Rejection Control for Multi-Source Power System Based on Soft Actor-Critic |
| title_full_unstemmed | Load Frequency Active Disturbance Rejection Control for Multi-Source Power System Based on Soft Actor-Critic |
| title_short | Load Frequency Active Disturbance Rejection Control for Multi-Source Power System Based on Soft Actor-Critic |
| title_sort | load frequency active disturbance rejection control for multi source power system based on soft actor critic |
| topic | load frequency control linear active disturbance rejection control soft actor-critic multi-source power system reinforcement learning |
| url | https://www.mdpi.com/1996-1073/14/16/4804 |
| work_keys_str_mv | AT yueminzheng loadfrequencyactivedisturbancerejectioncontrolformultisourcepowersystembasedonsoftactorcritic AT jintao loadfrequencyactivedisturbancerejectioncontrolformultisourcepowersystembasedonsoftactorcritic AT haosun loadfrequencyactivedisturbancerejectioncontrolformultisourcepowersystembasedonsoftactorcritic AT qinglinsun loadfrequencyactivedisturbancerejectioncontrolformultisourcepowersystembasedonsoftactorcritic AT zengqiangchen loadfrequencyactivedisturbancerejectioncontrolformultisourcepowersystembasedonsoftactorcritic AT matthiasdehmer loadfrequencyactivedisturbancerejectioncontrolformultisourcepowersystembasedonsoftactorcritic AT quanzhou loadfrequencyactivedisturbancerejectioncontrolformultisourcepowersystembasedonsoftactorcritic |