A Supply Chain Inventory Management Method for Civil Aircraft Manufacturing Based on Multi-Agent Reinforcement Learning
Effective supply chain inventory management is crucial for large-scale manufacturing industries such as civil aircraft and automobile manufacturing to ensure efficient manufacturing. Generally, the main manufacturer makes the annual inventory management plan, and contacts with suppliers when some ma...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2023-06-01
|
| Series: | Applied Sciences |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2076-3417/13/13/7510 |
| _version_ | 1797592167799062528 |
|---|---|
| author | Mingjie Piao Dongdong Zhang Hu Lu Rupeng Li |
| author_facet | Mingjie Piao Dongdong Zhang Hu Lu Rupeng Li |
| author_sort | Mingjie Piao |
| collection | DOAJ |
| description | Effective supply chain inventory management is crucial for large-scale manufacturing industries such as civil aircraft and automobile manufacturing to ensure efficient manufacturing. Generally, the main manufacturer makes the annual inventory management plan, and contacts with suppliers when some material is approaching critical inventory level according to the actual production schedule, which increases the difficulty of inventory management. In recent years, many researchers have focused on using reinforcement learning method to study inventory management problems. Current approaches were mainly designed for the supply chain with single-node multi-material or multi-node single-material mode, which are not suitable to the civil aircraft manufacturing supply chain with multi-node multi-material mode. To deal with this problem, we formulated the problem as a partially observable Markov decision process (POMDP) model and proposed a multi-agent reinforcement learning method for supply chain inventory management, in which the dual-policy and information transmission mechanism was designed to help the supply chain participant improve the global information utilization efficiency of the supply chain and the coordination efficiency with other participants. The experiment results show that our method has about 45% performance improvement on efficiency compared with current reinforcement learning-based methods. |
| first_indexed | 2024-03-11T01:48:36Z |
| format | Article |
| id | doaj.art-f4462907a69144b4b8b8321d62295356 |
| institution | Directory Open Access Journal |
| issn | 2076-3417 |
| language | English |
| last_indexed | 2024-03-11T01:48:36Z |
| publishDate | 2023-06-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Applied Sciences |
| spelling | doaj.art-f4462907a69144b4b8b8321d622953562023-11-18T16:07:26ZengMDPI AGApplied Sciences2076-34172023-06-011313751010.3390/app13137510A Supply Chain Inventory Management Method for Civil Aircraft Manufacturing Based on Multi-Agent Reinforcement LearningMingjie Piao0Dongdong Zhang1Hu Lu2Rupeng Li3College of Electronics and Information Engineering, Tongji University, Shanghai 201804, ChinaCollege of Electronics and Information Engineering, Tongji University, Shanghai 201804, ChinaCOMAC Shanghai Aircraft Manufacturing Co., Ltd., Shanghai 201324, ChinaCOMAC Shanghai Aircraft Manufacturing Co., Ltd., Shanghai 201324, ChinaEffective supply chain inventory management is crucial for large-scale manufacturing industries such as civil aircraft and automobile manufacturing to ensure efficient manufacturing. Generally, the main manufacturer makes the annual inventory management plan, and contacts with suppliers when some material is approaching critical inventory level according to the actual production schedule, which increases the difficulty of inventory management. In recent years, many researchers have focused on using reinforcement learning method to study inventory management problems. Current approaches were mainly designed for the supply chain with single-node multi-material or multi-node single-material mode, which are not suitable to the civil aircraft manufacturing supply chain with multi-node multi-material mode. To deal with this problem, we formulated the problem as a partially observable Markov decision process (POMDP) model and proposed a multi-agent reinforcement learning method for supply chain inventory management, in which the dual-policy and information transmission mechanism was designed to help the supply chain participant improve the global information utilization efficiency of the supply chain and the coordination efficiency with other participants. The experiment results show that our method has about 45% performance improvement on efficiency compared with current reinforcement learning-based methods.https://www.mdpi.com/2076-3417/13/13/7510multi-agent reinforcement learningsupply chaininventory management |
| spellingShingle | Mingjie Piao Dongdong Zhang Hu Lu Rupeng Li A Supply Chain Inventory Management Method for Civil Aircraft Manufacturing Based on Multi-Agent Reinforcement Learning Applied Sciences multi-agent reinforcement learning supply chain inventory management |
| title | A Supply Chain Inventory Management Method for Civil Aircraft Manufacturing Based on Multi-Agent Reinforcement Learning |
| title_full | A Supply Chain Inventory Management Method for Civil Aircraft Manufacturing Based on Multi-Agent Reinforcement Learning |
| title_fullStr | A Supply Chain Inventory Management Method for Civil Aircraft Manufacturing Based on Multi-Agent Reinforcement Learning |
| title_full_unstemmed | A Supply Chain Inventory Management Method for Civil Aircraft Manufacturing Based on Multi-Agent Reinforcement Learning |
| title_short | A Supply Chain Inventory Management Method for Civil Aircraft Manufacturing Based on Multi-Agent Reinforcement Learning |
| title_sort | supply chain inventory management method for civil aircraft manufacturing based on multi agent reinforcement learning |
| topic | multi-agent reinforcement learning supply chain inventory management |
| url | https://www.mdpi.com/2076-3417/13/13/7510 |
| work_keys_str_mv | AT mingjiepiao asupplychaininventorymanagementmethodforcivilaircraftmanufacturingbasedonmultiagentreinforcementlearning AT dongdongzhang asupplychaininventorymanagementmethodforcivilaircraftmanufacturingbasedonmultiagentreinforcementlearning AT hulu asupplychaininventorymanagementmethodforcivilaircraftmanufacturingbasedonmultiagentreinforcementlearning AT rupengli asupplychaininventorymanagementmethodforcivilaircraftmanufacturingbasedonmultiagentreinforcementlearning AT mingjiepiao supplychaininventorymanagementmethodforcivilaircraftmanufacturingbasedonmultiagentreinforcementlearning AT dongdongzhang supplychaininventorymanagementmethodforcivilaircraftmanufacturingbasedonmultiagentreinforcementlearning AT hulu supplychaininventorymanagementmethodforcivilaircraftmanufacturingbasedonmultiagentreinforcementlearning AT rupengli supplychaininventorymanagementmethodforcivilaircraftmanufacturingbasedonmultiagentreinforcementlearning |