CEA-FJSP: Carbon emission-aware flexible job-shop scheduling based on deep reinforcement learning
Currently, excessive carbon emission is causing visible damage to the ecosystem and will lead to long-term environmental degradation in the future. The manufacturing industry is one of the main contributors to the carbon emission problem. Therefore, the reduction of carbon emissions should be consid...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Frontiers Media S.A.
2022-11-01
|
| Series: | Frontiers in Environmental Science |
| Subjects: | |
| Online Access: | https://www.frontiersin.org/articles/10.3389/fenvs.2022.1059451/full |
| _version_ | 1798045495017340928 |
|---|---|
| author | Shiyong Wang Jiaxian Li Hao Tang Juan Wang |
| author_facet | Shiyong Wang Jiaxian Li Hao Tang Juan Wang |
| author_sort | Shiyong Wang |
| collection | DOAJ |
| description | Currently, excessive carbon emission is causing visible damage to the ecosystem and will lead to long-term environmental degradation in the future. The manufacturing industry is one of the main contributors to the carbon emission problem. Therefore, the reduction of carbon emissions should be considered at all levels of production activities. In this paper, the carbon emission as a parvenu indicator is considered parallelly with the nobleman indicator, makespan, in the flexible job-shop scheduling problem. Firstly, the carbon emission is modeled based on the energy consumption of machine operation and the coolant treatment during the production process. Then, a deep reinforcement learning-based scheduling model is proposed to handle the carbon emission-aware flexible job-shop scheduling problem. The proposed model treats scheduling as a Markov decision process, where the scheduling agent and the scheduling environment interact repeatedly via states, actions, and rewards. Next, a deep neural network is employed to parameterize the scheduling policy. Then, the proximal policy optimization algorithm is conducted to drive the deep neural network to learn the objective-oriented optimal mapping from the states to the actions. The experimental results verify that the proposed deep reinforcement learning-based scheduling model has prominent optimization and generalization abilities. Moreover, the proposed model presents a nonlinear optimization effect over the weight combinations. |
| first_indexed | 2024-04-11T23:21:40Z |
| format | Article |
| id | doaj.art-18c5b3933eed4637a63ddaa85fdd98de |
| institution | Directory Open Access Journal |
| issn | 2296-665X |
| language | English |
| last_indexed | 2024-04-11T23:21:40Z |
| publishDate | 2022-11-01 |
| publisher | Frontiers Media S.A. |
| record_format | Article |
| series | Frontiers in Environmental Science |
| spelling | doaj.art-18c5b3933eed4637a63ddaa85fdd98de2022-12-22T03:57:25ZengFrontiers Media S.A.Frontiers in Environmental Science2296-665X2022-11-011010.3389/fenvs.2022.10594511059451CEA-FJSP: Carbon emission-aware flexible job-shop scheduling based on deep reinforcement learningShiyong Wang0Jiaxian Li1Hao Tang2Juan Wang3School of Mechanical and Automotive Engineering, South China University of Technology, Guangzhou, ChinaSchool of Mechanical and Automotive Engineering, South China University of Technology, Guangzhou, ChinaSchool of Information and Communication Engineering, Hainan University, Haikou, Hainan, ChinaSchool of Electronics and Communication, Guangdong Mechanical & Electronical Polytechnic, Guangzhou, ChinaCurrently, excessive carbon emission is causing visible damage to the ecosystem and will lead to long-term environmental degradation in the future. The manufacturing industry is one of the main contributors to the carbon emission problem. Therefore, the reduction of carbon emissions should be considered at all levels of production activities. In this paper, the carbon emission as a parvenu indicator is considered parallelly with the nobleman indicator, makespan, in the flexible job-shop scheduling problem. Firstly, the carbon emission is modeled based on the energy consumption of machine operation and the coolant treatment during the production process. Then, a deep reinforcement learning-based scheduling model is proposed to handle the carbon emission-aware flexible job-shop scheduling problem. The proposed model treats scheduling as a Markov decision process, where the scheduling agent and the scheduling environment interact repeatedly via states, actions, and rewards. Next, a deep neural network is employed to parameterize the scheduling policy. Then, the proximal policy optimization algorithm is conducted to drive the deep neural network to learn the objective-oriented optimal mapping from the states to the actions. The experimental results verify that the proposed deep reinforcement learning-based scheduling model has prominent optimization and generalization abilities. Moreover, the proposed model presents a nonlinear optimization effect over the weight combinations.https://www.frontiersin.org/articles/10.3389/fenvs.2022.1059451/fullsmart manufacturingproduction schedulingdeep reinforcement learningcarbon emissionmulti-objective optimization |
| spellingShingle | Shiyong Wang Jiaxian Li Hao Tang Juan Wang CEA-FJSP: Carbon emission-aware flexible job-shop scheduling based on deep reinforcement learning Frontiers in Environmental Science smart manufacturing production scheduling deep reinforcement learning carbon emission multi-objective optimization |
| title | CEA-FJSP: Carbon emission-aware flexible job-shop scheduling based on deep reinforcement learning |
| title_full | CEA-FJSP: Carbon emission-aware flexible job-shop scheduling based on deep reinforcement learning |
| title_fullStr | CEA-FJSP: Carbon emission-aware flexible job-shop scheduling based on deep reinforcement learning |
| title_full_unstemmed | CEA-FJSP: Carbon emission-aware flexible job-shop scheduling based on deep reinforcement learning |
| title_short | CEA-FJSP: Carbon emission-aware flexible job-shop scheduling based on deep reinforcement learning |
| title_sort | cea fjsp carbon emission aware flexible job shop scheduling based on deep reinforcement learning |
| topic | smart manufacturing production scheduling deep reinforcement learning carbon emission multi-objective optimization |
| url | https://www.frontiersin.org/articles/10.3389/fenvs.2022.1059451/full |
| work_keys_str_mv | AT shiyongwang ceafjspcarbonemissionawareflexiblejobshopschedulingbasedondeepreinforcementlearning AT jiaxianli ceafjspcarbonemissionawareflexiblejobshopschedulingbasedondeepreinforcementlearning AT haotang ceafjspcarbonemissionawareflexiblejobshopschedulingbasedondeepreinforcementlearning AT juanwang ceafjspcarbonemissionawareflexiblejobshopschedulingbasedondeepreinforcementlearning |