Modelling of Two Training Approaches Using Reinforcement Learning for Real-time Optimization of Hybrid Microgrids
Reinforcement learning has been employed in recent research articles to optimize the energy storage system scheduling in microgrids, aiming to reduce overall system costs. However, applying reinforcement learning in real-time scenarios introduces uncertainties and delays due to the extensive traini...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
National University of Sciences and Technology, Islamabad
2023-11-01
|
| Series: | NUST Journal of Engineering Sciences |
| Online Access: | https://journals.nust.edu.pk/index.php/njes/article/view/757 |
| _version_ | 1797633368813207552 |
|---|---|
| author | khawaja Haider ali Mohammed Alharbi Asif Tahir |
| author_facet | khawaja Haider ali Mohammed Alharbi Asif Tahir |
| author_sort | khawaja Haider ali |
| collection | DOAJ |
| description |
Reinforcement learning has been employed in recent research articles to optimize the energy storage system scheduling in microgrids, aiming to reduce overall system costs. However, applying reinforcement learning in real-time scenarios introduces uncertainties and delays due to the extensive training required to develop the optimal policy for the storage system. This work addresses these challenges and explores potential solutions for real-time dispatch control actions of the battery in a grid-tied microgrid. The study considers different approaches for training the agent, distinguishing between online and offline scheduling of the energy storage system. The limitations of these approaches and their implications on real-time performance are also analyzed. By developing a comprehensive microgrid model and comparing two training approaches, this research contributes to novel insights for efficient real-time scheduling of energy storage systems in grid-tied microgrids. The proposed approach presents a promising path towards addressing uncertainties and achieving optimal operation in grid-tied microgrids. In terms of average cost per year, the difference between the two approaches is 4% if foresight of the real data is perfect, otherwise the real-time approach is more cost-effective.
|
| first_indexed | 2024-03-11T11:53:06Z |
| format | Article |
| id | doaj.art-b6df623287ae4098a50106279afa7e67 |
| institution | Directory Open Access Journal |
| issn | 2070-9900 2411-6319 |
| language | English |
| last_indexed | 2024-03-11T11:53:06Z |
| publishDate | 2023-11-01 |
| publisher | National University of Sciences and Technology, Islamabad |
| record_format | Article |
| series | NUST Journal of Engineering Sciences |
| spelling | doaj.art-b6df623287ae4098a50106279afa7e672023-11-08T22:25:18ZengNational University of Sciences and Technology, IslamabadNUST Journal of Engineering Sciences2070-99002411-63192023-11-0116210.24949/njes.v16i2.757Modelling of Two Training Approaches Using Reinforcement Learning for Real-time Optimization of Hybrid Microgridskhawaja Haider ali0Mohammed Alharbi1Asif Tahir2Electrical Engineering department, Sukkur IBA University,65200 Airport Road Sukkur, Pakistan2Department of Electrical Engineering, College of Engineering, King Saud University, Riyadh 11421, Saudi ArabiaEnvironment and Sustainability Institute (ESI), University of Exeter, Penryn Campus, Cornwall, TR10 9FE, United Kingdom Reinforcement learning has been employed in recent research articles to optimize the energy storage system scheduling in microgrids, aiming to reduce overall system costs. However, applying reinforcement learning in real-time scenarios introduces uncertainties and delays due to the extensive training required to develop the optimal policy for the storage system. This work addresses these challenges and explores potential solutions for real-time dispatch control actions of the battery in a grid-tied microgrid. The study considers different approaches for training the agent, distinguishing between online and offline scheduling of the energy storage system. The limitations of these approaches and their implications on real-time performance are also analyzed. By developing a comprehensive microgrid model and comparing two training approaches, this research contributes to novel insights for efficient real-time scheduling of energy storage systems in grid-tied microgrids. The proposed approach presents a promising path towards addressing uncertainties and achieving optimal operation in grid-tied microgrids. In terms of average cost per year, the difference between the two approaches is 4% if foresight of the real data is perfect, otherwise the real-time approach is more cost-effective. https://journals.nust.edu.pk/index.php/njes/article/view/757 |
| spellingShingle | khawaja Haider ali Mohammed Alharbi Asif Tahir Modelling of Two Training Approaches Using Reinforcement Learning for Real-time Optimization of Hybrid Microgrids NUST Journal of Engineering Sciences |
| title | Modelling of Two Training Approaches Using Reinforcement Learning for Real-time Optimization of Hybrid Microgrids |
| title_full | Modelling of Two Training Approaches Using Reinforcement Learning for Real-time Optimization of Hybrid Microgrids |
| title_fullStr | Modelling of Two Training Approaches Using Reinforcement Learning for Real-time Optimization of Hybrid Microgrids |
| title_full_unstemmed | Modelling of Two Training Approaches Using Reinforcement Learning for Real-time Optimization of Hybrid Microgrids |
| title_short | Modelling of Two Training Approaches Using Reinforcement Learning for Real-time Optimization of Hybrid Microgrids |
| title_sort | modelling of two training approaches using reinforcement learning for real time optimization of hybrid microgrids |
| url | https://journals.nust.edu.pk/index.php/njes/article/view/757 |
| work_keys_str_mv | AT khawajahaiderali modellingoftwotrainingapproachesusingreinforcementlearningforrealtimeoptimizationofhybridmicrogrids AT mohammedalharbi modellingoftwotrainingapproachesusingreinforcementlearningforrealtimeoptimizationofhybridmicrogrids AT asiftahir modellingoftwotrainingapproachesusingreinforcementlearningforrealtimeoptimizationofhybridmicrogrids |