Semantic communication aware reinforcement learning for communication fault-tolerant UAV collaborative control
Unmanned aerial vehicle (UAV) swarms have seen extensive deployment across a spectrum of military and civilian applications in recent years. The success of UAV missions is contingent upon robust communication and collaboration among the UAV, which has become a pivotal area of technical research. How...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
POSTS&TELECOM PRESS Co., LTD
2024-04-01
|
| Series: | 网络与信息安全学报 |
| Subjects: | |
| Online Access: | http://www.cjnis.com.cn/thesisDetails#10.11959/j.issn.2096-109x.2024025 |
| _version_ | 1826868495066857472 |
|---|---|
| author | ZHANG Yang GU Hongyu FENG Bohao WANG Ran |
| author_facet | ZHANG Yang GU Hongyu FENG Bohao WANG Ran |
| author_sort | ZHANG Yang |
| collection | DOAJ |
| description | Unmanned aerial vehicle (UAV) swarms have seen extensive deployment across a spectrum of military and civilian applications in recent years. The success of UAV missions is contingent upon robust communication and collaboration among the UAV, which has become a pivotal area of technical research. However, in environments rife with communication uncertainties, both subjective and objective environmental factors can disrupt UAV communication and collaboration. This interference can prevent UAV from accurately transmitting and receiving information, thereby jeopardizing the success of collaborative missions To address this challenge, a fault-tolerant UAV collaboration method grounded in reinforcement learning and semantic communication was developed to cater to the leader-follower UAV mission pattern within environments constrained by limited communication capabilities To enhance the follower UAV's strategy for reinforcement learning-based following, a semantic communication mechanism coupled with a Proximal Policy Optimization (PPO) method was implemented. This approach facilitated the prediction of the leader UAV's actions. Under normal communication conditions, the follower UAV received data transmitted by the leader and executed the corresponding command operations. In scenarios where communication was interfered, the follower UAV leveraged historical flight and communication data to extract semantic information. This information was then used autonomously to predict the future flight paths of the leading UAV. By integrating the learned and predicted behavior patterns of the leader, the follower UAV was able to make informed decisions. The proposed scheme, which did not necessitate additional anti-interference equipment, enabled the UAV swarm to counteract communication interference and bolster the efficiency of collaboration within a challenging and obstructed communication context. Experimental studies show that, when compared to benchmark methods, the proposed scheme not only endures complex environments with interferences but also significantly improves the efficiency of UAV leading-following operations and the overall mission success rate. This research provides valuable insights into viable solutions for future UAV swarm collaborations within communication-constrained and interfered environments. |
| first_indexed | 2025-02-16T22:46:15Z |
| format | Article |
| id | doaj.art-c0b969cb8e4341f48e2dd3ac4ee50904 |
| institution | Directory Open Access Journal |
| issn | 2096-109X |
| language | English |
| last_indexed | 2025-02-16T22:46:15Z |
| publishDate | 2024-04-01 |
| publisher | POSTS&TELECOM PRESS Co., LTD |
| record_format | Article |
| series | 网络与信息安全学报 |
| spelling | doaj.art-c0b969cb8e4341f48e2dd3ac4ee509042025-01-15T03:17:09ZengPOSTS&TELECOM PRESS Co., LTD网络与信息安全学报2096-109X2024-04-0110698063897457Semantic communication aware reinforcement learning for communication fault-tolerant UAV collaborative controlZHANG YangGU HongyuFENG BohaoWANG RanUnmanned aerial vehicle (UAV) swarms have seen extensive deployment across a spectrum of military and civilian applications in recent years. The success of UAV missions is contingent upon robust communication and collaboration among the UAV, which has become a pivotal area of technical research. However, in environments rife with communication uncertainties, both subjective and objective environmental factors can disrupt UAV communication and collaboration. This interference can prevent UAV from accurately transmitting and receiving information, thereby jeopardizing the success of collaborative missions To address this challenge, a fault-tolerant UAV collaboration method grounded in reinforcement learning and semantic communication was developed to cater to the leader-follower UAV mission pattern within environments constrained by limited communication capabilities To enhance the follower UAV's strategy for reinforcement learning-based following, a semantic communication mechanism coupled with a Proximal Policy Optimization (PPO) method was implemented. This approach facilitated the prediction of the leader UAV's actions. Under normal communication conditions, the follower UAV received data transmitted by the leader and executed the corresponding command operations. In scenarios where communication was interfered, the follower UAV leveraged historical flight and communication data to extract semantic information. This information was then used autonomously to predict the future flight paths of the leading UAV. By integrating the learned and predicted behavior patterns of the leader, the follower UAV was able to make informed decisions. The proposed scheme, which did not necessitate additional anti-interference equipment, enabled the UAV swarm to counteract communication interference and bolster the efficiency of collaboration within a challenging and obstructed communication context. Experimental studies show that, when compared to benchmark methods, the proposed scheme not only endures complex environments with interferences but also significantly improves the efficiency of UAV leading-following operations and the overall mission success rate. This research provides valuable insights into viable solutions for future UAV swarm collaborations within communication-constrained and interfered environments.http://www.cjnis.com.cn/thesisDetails#10.11959/j.issn.2096-109x.2024025UAV anti-jammingcommunication jammingsemantic communicationreinforcement learning |
| spellingShingle | ZHANG Yang GU Hongyu FENG Bohao WANG Ran Semantic communication aware reinforcement learning for communication fault-tolerant UAV collaborative control 网络与信息安全学报 UAV anti-jamming communication jamming semantic communication reinforcement learning |
| title | Semantic communication aware reinforcement learning for communication fault-tolerant UAV collaborative control |
| title_full | Semantic communication aware reinforcement learning for communication fault-tolerant UAV collaborative control |
| title_fullStr | Semantic communication aware reinforcement learning for communication fault-tolerant UAV collaborative control |
| title_full_unstemmed | Semantic communication aware reinforcement learning for communication fault-tolerant UAV collaborative control |
| title_short | Semantic communication aware reinforcement learning for communication fault-tolerant UAV collaborative control |
| title_sort | semantic communication aware reinforcement learning for communication fault tolerant uav collaborative control |
| topic | UAV anti-jamming communication jamming semantic communication reinforcement learning |
| url | http://www.cjnis.com.cn/thesisDetails#10.11959/j.issn.2096-109x.2024025 |
| work_keys_str_mv | AT zhangyang semanticcommunicationawarereinforcementlearningforcommunicationfaulttolerantuavcollaborativecontrol AT guhongyu semanticcommunicationawarereinforcementlearningforcommunicationfaulttolerantuavcollaborativecontrol AT fengbohao semanticcommunicationawarereinforcementlearningforcommunicationfaulttolerantuavcollaborativecontrol AT wangran semanticcommunicationawarereinforcementlearningforcommunicationfaulttolerantuavcollaborativecontrol |