Distributed UUV cluster task allocation algorithm based on deep reinforcement learning
Task allocation is one of the basic and key issues in the research of agent clusters. UUV clusters are limited by underwater detection and communication capabilities in task allocation. UUV individuals can only obtain partial information around them, and conventional global algorithms cannot be appl...
| Main Author: | |
|---|---|
| Format: | Article |
| Language: | zho |
| Published: |
Editorial Office of Command Control and Simulation
2023-06-01
|
| Series: | Zhihui kongzhi yu fangzhen |
| Subjects: | |
| Online Access: | https://www.zhkzyfz.cn/fileup/1673-3819/PDF/1673-3819(2023)03-0025-09.pdf |
| _version_ | 1797805929812459520 |
|---|---|
| author | HAO Guanjie, YAO Yao, CHANG Peng, ZHANG Xiaoshuang |
| author_facet | HAO Guanjie, YAO Yao, CHANG Peng, ZHANG Xiaoshuang |
| author_sort | HAO Guanjie, YAO Yao, CHANG Peng, ZHANG Xiaoshuang |
| collection | DOAJ |
| description | Task allocation is one of the basic and key issues in the research of agent clusters. UUV clusters are limited by underwater detection and communication capabilities in task allocation. UUV individuals can only obtain partial information around them, and conventional global algorithms cannot be applied well. A task allocation algorithm based on deep reinforcement learning and distributed UUV cluster organizational structure is proposed. The algorithm first realizes the partial task allocation of each UUV individual, and then the information between adjacent individuals is consistent and coordinated, thus realizing the optimal task allocation of UUV cluster. Through the simulation experiment, the algorithm in this paper converges faster than the genetic algorithm, has less traffic and higher task allocation efficiency than the contract network algorithm, and the distributed architecture does not rely on the "command center". The UUV cluster system has higher robustness and higher task allocation reliability. |
| first_indexed | 2024-03-13T05:59:34Z |
| format | Article |
| id | doaj.art-e19f7f10d7f64a0eace65ea09efa041e |
| institution | Directory Open Access Journal |
| issn | 1673-3819 |
| language | zho |
| last_indexed | 2024-03-13T05:59:34Z |
| publishDate | 2023-06-01 |
| publisher | Editorial Office of Command Control and Simulation |
| record_format | Article |
| series | Zhihui kongzhi yu fangzhen |
| spelling | doaj.art-e19f7f10d7f64a0eace65ea09efa041e2023-06-13T01:02:48ZzhoEditorial Office of Command Control and SimulationZhihui kongzhi yu fangzhen1673-38192023-06-01453253310.3969/j.issn.1673-3819.2023.03.004Distributed UUV cluster task allocation algorithm based on deep reinforcement learningHAO Guanjie, YAO Yao, CHANG Peng, ZHANG Xiaoshuang0Jiangsu Automation Research Institute, Lianyungang 222061, ChinaTask allocation is one of the basic and key issues in the research of agent clusters. UUV clusters are limited by underwater detection and communication capabilities in task allocation. UUV individuals can only obtain partial information around them, and conventional global algorithms cannot be applied well. A task allocation algorithm based on deep reinforcement learning and distributed UUV cluster organizational structure is proposed. The algorithm first realizes the partial task allocation of each UUV individual, and then the information between adjacent individuals is consistent and coordinated, thus realizing the optimal task allocation of UUV cluster. Through the simulation experiment, the algorithm in this paper converges faster than the genetic algorithm, has less traffic and higher task allocation efficiency than the contract network algorithm, and the distributed architecture does not rely on the "command center". The UUV cluster system has higher robustness and higher task allocation reliability.https://www.zhkzyfz.cn/fileup/1673-3819/PDF/1673-3819(2023)03-0025-09.pdftask allocation|deep reinforcement learning|distributed|multi-agent |
| spellingShingle | HAO Guanjie, YAO Yao, CHANG Peng, ZHANG Xiaoshuang Distributed UUV cluster task allocation algorithm based on deep reinforcement learning Zhihui kongzhi yu fangzhen task allocation|deep reinforcement learning|distributed|multi-agent |
| title | Distributed UUV cluster task allocation algorithm based on deep reinforcement learning |
| title_full | Distributed UUV cluster task allocation algorithm based on deep reinforcement learning |
| title_fullStr | Distributed UUV cluster task allocation algorithm based on deep reinforcement learning |
| title_full_unstemmed | Distributed UUV cluster task allocation algorithm based on deep reinforcement learning |
| title_short | Distributed UUV cluster task allocation algorithm based on deep reinforcement learning |
| title_sort | distributed uuv cluster task allocation algorithm based on deep reinforcement learning |
| topic | task allocation|deep reinforcement learning|distributed|multi-agent |
| url | https://www.zhkzyfz.cn/fileup/1673-3819/PDF/1673-3819(2023)03-0025-09.pdf |
| work_keys_str_mv | AT haoguanjieyaoyaochangpengzhangxiaoshuang distributeduuvclustertaskallocationalgorithmbasedondeepreinforcementlearning |