Deep Reinforcement Learning for Truck-Drone Delivery Problem
Utilizing drones for delivery is an effective approach to enhancing delivery efficiency and lowering expenses. However, to overcome the delivery range and payload capacity limitations of drones, the combination of trucks and drones is gaining more attention. By using trucks as a flight platform for...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2023-07-01
|
| Series: | Drones |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2504-446X/7/7/445 |
| _version_ | 1797589605132795904 |
|---|---|
| author | Zhiliang Bi Xiwang Guo Jiacun Wang Shujin Qin Guanjun Liu |
| author_facet | Zhiliang Bi Xiwang Guo Jiacun Wang Shujin Qin Guanjun Liu |
| author_sort | Zhiliang Bi |
| collection | DOAJ |
| description | Utilizing drones for delivery is an effective approach to enhancing delivery efficiency and lowering expenses. However, to overcome the delivery range and payload capacity limitations of drones, the combination of trucks and drones is gaining more attention. By using trucks as a flight platform for drones and supporting their take-off and landing, the delivery range and capacity can be greatly extended. This research focused on mixed truck-drone delivery and utilized reinforcement learning and real road networks to address its optimal scheduling issue. Furthermore, the state and behavior of the vehicle were optimized to reduce meaningless behavior, especially the optimization of truck travel trajectory and customer service time. Finally, a comparison with other reinforcement learning algorithms with behavioral constraints demonstrated the reasonableness of the problem and the advantages of the algorithm. |
| first_indexed | 2024-03-11T01:08:53Z |
| format | Article |
| id | doaj.art-877133c4d73c4ede956ee362f58fe13b |
| institution | Directory Open Access Journal |
| issn | 2504-446X |
| language | English |
| last_indexed | 2024-03-11T01:08:53Z |
| publishDate | 2023-07-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Drones |
| spelling | doaj.art-877133c4d73c4ede956ee362f58fe13b2023-11-18T19:01:10ZengMDPI AGDrones2504-446X2023-07-017744510.3390/drones7070445Deep Reinforcement Learning for Truck-Drone Delivery ProblemZhiliang Bi0Xiwang Guo1Jiacun Wang2Shujin Qin3Guanjun Liu4School of Information and Control, Liaoning Petrochemical University, Fushun 113001, ChinaSchool of Information and Control, Liaoning Petrochemical University, Fushun 113001, ChinaSchool of Computer Science and Software Engineering, Monmouth University, West Long Branch, NJ 07764, USASchool of Economics and Management, Shangqiu Normal University, Shangqiu 476000, ChinaSchool of Electronic and Information Engineering, Tongji University, Shanghai 201804, ChinaUtilizing drones for delivery is an effective approach to enhancing delivery efficiency and lowering expenses. However, to overcome the delivery range and payload capacity limitations of drones, the combination of trucks and drones is gaining more attention. By using trucks as a flight platform for drones and supporting their take-off and landing, the delivery range and capacity can be greatly extended. This research focused on mixed truck-drone delivery and utilized reinforcement learning and real road networks to address its optimal scheduling issue. Furthermore, the state and behavior of the vehicle were optimized to reduce meaningless behavior, especially the optimization of truck travel trajectory and customer service time. Finally, a comparison with other reinforcement learning algorithms with behavioral constraints demonstrated the reasonableness of the problem and the advantages of the algorithm.https://www.mdpi.com/2504-446X/7/7/445reinforcement learningdronepath planningroad network |
| spellingShingle | Zhiliang Bi Xiwang Guo Jiacun Wang Shujin Qin Guanjun Liu Deep Reinforcement Learning for Truck-Drone Delivery Problem Drones reinforcement learning drone path planning road network |
| title | Deep Reinforcement Learning for Truck-Drone Delivery Problem |
| title_full | Deep Reinforcement Learning for Truck-Drone Delivery Problem |
| title_fullStr | Deep Reinforcement Learning for Truck-Drone Delivery Problem |
| title_full_unstemmed | Deep Reinforcement Learning for Truck-Drone Delivery Problem |
| title_short | Deep Reinforcement Learning for Truck-Drone Delivery Problem |
| title_sort | deep reinforcement learning for truck drone delivery problem |
| topic | reinforcement learning drone path planning road network |
| url | https://www.mdpi.com/2504-446X/7/7/445 |
| work_keys_str_mv | AT zhiliangbi deepreinforcementlearningfortruckdronedeliveryproblem AT xiwangguo deepreinforcementlearningfortruckdronedeliveryproblem AT jiacunwang deepreinforcementlearningfortruckdronedeliveryproblem AT shujinqin deepreinforcementlearningfortruckdronedeliveryproblem AT guanjunliu deepreinforcementlearningfortruckdronedeliveryproblem |