Online Three-Dimensional Bin Packing: A DRL Algorithm with the Buffer Zone
The online 3D bin packing problem(3D-BPP) is widely used in the logistics industry and is of great practical significance for promoting the intelligent transformation of the industry. The heuristic algorithm relies too much on manual experience to formulate more perfect packing rules. In recent year...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Sciendo
2024-02-01
|
| Series: | Foundations of Computing and Decision Sciences |
| Subjects: | |
| Online Access: | https://doi.org/10.2478/fcds-2024-0005 |
| _version_ | 1797303092952170496 |
|---|---|
| author | Zhang Jiawei Shuai Tianping |
| author_facet | Zhang Jiawei Shuai Tianping |
| author_sort | Zhang Jiawei |
| collection | DOAJ |
| description | The online 3D bin packing problem(3D-BPP) is widely used in the logistics industry and is of great practical significance for promoting the intelligent transformation of the industry. The heuristic algorithm relies too much on manual experience to formulate more perfect packing rules. In recent years, many scholars solve 3D-BPP via deep reinforcement learning(DRL) algorithms. However, they ignore many skills used in manual packing, one of the most important skill is workers put the item aside if the item is packed improperly. Inspired by this skill, we propose a DRL algorithm with a buffer zone. Firstly, we define the wasted space and the buffer zone. And then, we integrate them into the DRL algorithm framework. Importantly, we compare the bin utilization with di erent thresholds of wasted space and di erent buffer zone sizes. Experimental results show that our algorithm outperforms existing heuristic algorithms and DRL algorithms. |
| first_indexed | 2024-03-07T23:47:59Z |
| format | Article |
| id | doaj.art-3f6d66edba814876bcd1a2f9858341b2 |
| institution | Directory Open Access Journal |
| issn | 2300-3405 |
| language | English |
| last_indexed | 2024-03-07T23:47:59Z |
| publishDate | 2024-02-01 |
| publisher | Sciendo |
| record_format | Article |
| series | Foundations of Computing and Decision Sciences |
| spelling | doaj.art-3f6d66edba814876bcd1a2f9858341b22024-02-19T09:03:40ZengSciendoFoundations of Computing and Decision Sciences2300-34052024-02-01491637410.2478/fcds-2024-0005Online Three-Dimensional Bin Packing: A DRL Algorithm with the Buffer ZoneZhang Jiawei0Shuai Tianping11School of Science, Beijing University of Posts and Telecommunications, Beijing, China1School of Science, Beijing University of Posts and Telecommunications, Beijing, ChinaThe online 3D bin packing problem(3D-BPP) is widely used in the logistics industry and is of great practical significance for promoting the intelligent transformation of the industry. The heuristic algorithm relies too much on manual experience to formulate more perfect packing rules. In recent years, many scholars solve 3D-BPP via deep reinforcement learning(DRL) algorithms. However, they ignore many skills used in manual packing, one of the most important skill is workers put the item aside if the item is packed improperly. Inspired by this skill, we propose a DRL algorithm with a buffer zone. Firstly, we define the wasted space and the buffer zone. And then, we integrate them into the DRL algorithm framework. Importantly, we compare the bin utilization with di erent thresholds of wasted space and di erent buffer zone sizes. Experimental results show that our algorithm outperforms existing heuristic algorithms and DRL algorithms.https://doi.org/10.2478/fcds-2024-00053d bin packingbuffer zonewasted spaceactor-critic |
| spellingShingle | Zhang Jiawei Shuai Tianping Online Three-Dimensional Bin Packing: A DRL Algorithm with the Buffer Zone Foundations of Computing and Decision Sciences 3d bin packing buffer zone wasted space actor-critic |
| title | Online Three-Dimensional Bin Packing: A DRL Algorithm with the Buffer Zone |
| title_full | Online Three-Dimensional Bin Packing: A DRL Algorithm with the Buffer Zone |
| title_fullStr | Online Three-Dimensional Bin Packing: A DRL Algorithm with the Buffer Zone |
| title_full_unstemmed | Online Three-Dimensional Bin Packing: A DRL Algorithm with the Buffer Zone |
| title_short | Online Three-Dimensional Bin Packing: A DRL Algorithm with the Buffer Zone |
| title_sort | online three dimensional bin packing a drl algorithm with the buffer zone |
| topic | 3d bin packing buffer zone wasted space actor-critic |
| url | https://doi.org/10.2478/fcds-2024-0005 |
| work_keys_str_mv | AT zhangjiawei onlinethreedimensionalbinpackingadrlalgorithmwiththebufferzone AT shuaitianping onlinethreedimensionalbinpackingadrlalgorithmwiththebufferzone |