Data-driven bi-level predictive energy management strategy for fuel cell buses with algorithmics fusion

This paper aims to answer how to effectively integrate the data-driven method into the traditional predictive energy management algorithm rather than replacing it outright. Given the challenge of selecting an appropriate prediction horizon for predictive energy management, this study seeks to bridge...

Full description

Bibliographic Details
Main Authors: Menglin Li, Haoran Liu, Mei Yan, Jingda Wu, Lisheng Jin, Hongwen He
Format: Article
Language:English
Published: Elsevier 2023-10-01
Series:Energy Conversion and Management: X
Subjects:
Online Access:http://www.sciencedirect.com/science/article/pii/S2590174523000703
_version_ 1797788441475284992
author Menglin Li
Haoran Liu
Mei Yan
Jingda Wu
Lisheng Jin
Hongwen He
author_facet Menglin Li
Haoran Liu
Mei Yan
Jingda Wu
Lisheng Jin
Hongwen He
author_sort Menglin Li
collection DOAJ
description This paper aims to answer how to effectively integrate the data-driven method into the traditional predictive energy management algorithm rather than replacing it outright. Given the challenge of selecting an appropriate prediction horizon for predictive energy management, this study seeks to bridge traditional predictive energy management with machine learning approaches, thereby presenting a novel bi-level predictive energy management strategy for fuel cell buses with multi-prediction horizons. In the upper layer, the core parameter, prediction horizon, of the traditional model predictive control energy management framework is optimized using two distinct data-driven methods. The first method employs deep learning to establish a mapping relationship between the vehicle states and the optimal prediction horizon through deep neural networks. The second method utilizes reinforcement learning to obtain the best prediction horizon under varying vehicle states through intelligent agent exploration. In the lower level, predictive energy management is performed on fuel cell buses based on optimization levels. Finally, the proposed strategy is validated using test data from actual fuel cell buses. The results demonstrate that two data-driven methods, based on the optimal ΔSoC approximation and the deep reinforcement learning, can select the appropriate prediction horizon more conducive to energy saving according to the vehicle states. Regarding energy consumption, the multi-horizon predictive energy management based on deep reinforcement learning exhibits a remarkable reduction in energy consumption by 7.62 %, 4.55 %, 4.60 %, and 7.80 %, when compared with the predictive energy management employing fixed prediction horizons of 5 s, 10 s, 15 s, and 20 s, respectively. Furthermore, it outperforms the multi-horizon predictive energy management approach based on the optimal ΔSoC approximation by 3.59 %.
first_indexed 2024-03-13T01:35:37Z
format Article
id doaj.art-1ec6b76e5d3f47d78024783416fe306d
institution Directory Open Access Journal
issn 2590-1745
language English
last_indexed 2024-03-13T01:35:37Z
publishDate 2023-10-01
publisher Elsevier
record_format Article
series Energy Conversion and Management: X
spelling doaj.art-1ec6b76e5d3f47d78024783416fe306d2023-07-04T05:10:21ZengElsevierEnergy Conversion and Management: X2590-17452023-10-0120100414Data-driven bi-level predictive energy management strategy for fuel cell buses with algorithmics fusionMenglin Li0Haoran Liu1Mei Yan2Jingda Wu3Lisheng Jin4Hongwen He5School of Vehicle and Energy, Yanshan University, Qinhuangdao 066004, ChinaSchool of Vehicle and Energy, Yanshan University, Qinhuangdao 066004, ChinaSchool of Vehicle and Energy, Yanshan University, Qinhuangdao 066004, China; Corresponding author.School of Mechanical and Aerospace Engineering, Nanyang Technological University 308232, SingaporeSchool of Vehicle and Energy, Yanshan University, Qinhuangdao 066004, ChinaNational Engineering Laboratory for Electric Vehicles, School of Mechanical Engineering, Beijing Institute of Technology 100081, ChinaThis paper aims to answer how to effectively integrate the data-driven method into the traditional predictive energy management algorithm rather than replacing it outright. Given the challenge of selecting an appropriate prediction horizon for predictive energy management, this study seeks to bridge traditional predictive energy management with machine learning approaches, thereby presenting a novel bi-level predictive energy management strategy for fuel cell buses with multi-prediction horizons. In the upper layer, the core parameter, prediction horizon, of the traditional model predictive control energy management framework is optimized using two distinct data-driven methods. The first method employs deep learning to establish a mapping relationship between the vehicle states and the optimal prediction horizon through deep neural networks. The second method utilizes reinforcement learning to obtain the best prediction horizon under varying vehicle states through intelligent agent exploration. In the lower level, predictive energy management is performed on fuel cell buses based on optimization levels. Finally, the proposed strategy is validated using test data from actual fuel cell buses. The results demonstrate that two data-driven methods, based on the optimal ΔSoC approximation and the deep reinforcement learning, can select the appropriate prediction horizon more conducive to energy saving according to the vehicle states. Regarding energy consumption, the multi-horizon predictive energy management based on deep reinforcement learning exhibits a remarkable reduction in energy consumption by 7.62 %, 4.55 %, 4.60 %, and 7.80 %, when compared with the predictive energy management employing fixed prediction horizons of 5 s, 10 s, 15 s, and 20 s, respectively. Furthermore, it outperforms the multi-horizon predictive energy management approach based on the optimal ΔSoC approximation by 3.59 %.http://www.sciencedirect.com/science/article/pii/S2590174523000703Energy managementMulti-prediction horizonsFuel cell busesData-drivenReinforcement learning
spellingShingle Menglin Li
Haoran Liu
Mei Yan
Jingda Wu
Lisheng Jin
Hongwen He
Data-driven bi-level predictive energy management strategy for fuel cell buses with algorithmics fusion
Energy Conversion and Management: X
Energy management
Multi-prediction horizons
Fuel cell buses
Data-driven
Reinforcement learning
title Data-driven bi-level predictive energy management strategy for fuel cell buses with algorithmics fusion
title_full Data-driven bi-level predictive energy management strategy for fuel cell buses with algorithmics fusion
title_fullStr Data-driven bi-level predictive energy management strategy for fuel cell buses with algorithmics fusion
title_full_unstemmed Data-driven bi-level predictive energy management strategy for fuel cell buses with algorithmics fusion
title_short Data-driven bi-level predictive energy management strategy for fuel cell buses with algorithmics fusion
title_sort data driven bi level predictive energy management strategy for fuel cell buses with algorithmics fusion
topic Energy management
Multi-prediction horizons
Fuel cell buses
Data-driven
Reinforcement learning
url http://www.sciencedirect.com/science/article/pii/S2590174523000703
work_keys_str_mv AT menglinli datadrivenbilevelpredictiveenergymanagementstrategyforfuelcellbuseswithalgorithmicsfusion
AT haoranliu datadrivenbilevelpredictiveenergymanagementstrategyforfuelcellbuseswithalgorithmicsfusion
AT meiyan datadrivenbilevelpredictiveenergymanagementstrategyforfuelcellbuseswithalgorithmicsfusion
AT jingdawu datadrivenbilevelpredictiveenergymanagementstrategyforfuelcellbuseswithalgorithmicsfusion
AT lishengjin datadrivenbilevelpredictiveenergymanagementstrategyforfuelcellbuseswithalgorithmicsfusion
AT hongwenhe datadrivenbilevelpredictiveenergymanagementstrategyforfuelcellbuseswithalgorithmicsfusion