Towards reinforcement learning in UAV relay for anti-jamming maritime communications
Maritime communications with sea surface reflections and sea wave occlusions are susceptible to jamming attacks due to the wide geographical area and intensive wireless communication services. Unmanned Aerial Vehicles (UAVs) help relay messages to improve communication performance, but the relay pol...
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
KeAi Communications Co., Ltd.
2023-12-01
|
| Series: | Digital Communications and Networks |
| Subjects: | |
| Online Access: | http://www.sciencedirect.com/science/article/pii/S2352864822001729 |
| _version_ | 1797382840463130624 |
|---|---|
| author | Chuhuan Liu Yi Zhang Guohang Niu Luliang Jia Liang Xiao Jiangxia Luan |
| author_facet | Chuhuan Liu Yi Zhang Guohang Niu Luliang Jia Liang Xiao Jiangxia Luan |
| author_sort | Chuhuan Liu |
| collection | DOAJ |
| description | Maritime communications with sea surface reflections and sea wave occlusions are susceptible to jamming attacks due to the wide geographical area and intensive wireless communication services. Unmanned Aerial Vehicles (UAVs) help relay messages to improve communication performance, but the relay policy that depends on the rapidly changing maritime environments is difficult to optimize. In this paper, a reinforcement learning-based UAV relay policy for maritime communications is proposed to resist jamming attacks. Based on previous transmission performance, the relay location, the received power of the transmitted signal and the received jamming power, this scheme optimizes the UAV trajectory and relay power to save the energy consumption and decrease the Bit-Error-Rate (BER) of the maritime signals. A deep reinforcement learning-based scheme is also proposed, which designs a deep neural network with dueling architecture to further improve the communication performance and computational complexity. The performance bounds regarding the signal to interference plus noise ratio, energy consumption and the communication utility are provided based on the Nash equilibrium of the game against jamming, and the computational complexity of the proposed schemes is analyzed. Simulation results show that the proposed schemes improve the energy efficiency and decrease the BER compared with the benchmark. |
| first_indexed | 2024-03-08T21:12:12Z |
| format | Article |
| id | doaj.art-3d9be31fc7fd4ab8a081a67d95f31090 |
| institution | Directory Open Access Journal |
| issn | 2352-8648 |
| language | English |
| last_indexed | 2024-03-08T21:12:12Z |
| publishDate | 2023-12-01 |
| publisher | KeAi Communications Co., Ltd. |
| record_format | Article |
| series | Digital Communications and Networks |
| spelling | doaj.art-3d9be31fc7fd4ab8a081a67d95f310902023-12-22T05:33:31ZengKeAi Communications Co., Ltd.Digital Communications and Networks2352-86482023-12-019614771485Towards reinforcement learning in UAV relay for anti-jamming maritime communicationsChuhuan Liu0Yi Zhang1Guohang Niu2Luliang Jia3Liang Xiao4Jiangxia Luan5Department of Information and Communication Engineering, Xiamen University, Xiamen, 361005, ChinaDepartment of Information and Communication Engineering, Xiamen University, Xiamen, 361005, China; Corresponding author.Department of Information and Communication Engineering, Xiamen University, Xiamen, 361005, ChinaSchool of Space Information, Space Engineering University, Beijing, 101400, ChinaDepartment of Information and Communication Engineering, Xiamen University, Xiamen, 361005, ChinaXiamen Meiya Pico Information Co., Ltd., Xiamen, 361005, ChinaMaritime communications with sea surface reflections and sea wave occlusions are susceptible to jamming attacks due to the wide geographical area and intensive wireless communication services. Unmanned Aerial Vehicles (UAVs) help relay messages to improve communication performance, but the relay policy that depends on the rapidly changing maritime environments is difficult to optimize. In this paper, a reinforcement learning-based UAV relay policy for maritime communications is proposed to resist jamming attacks. Based on previous transmission performance, the relay location, the received power of the transmitted signal and the received jamming power, this scheme optimizes the UAV trajectory and relay power to save the energy consumption and decrease the Bit-Error-Rate (BER) of the maritime signals. A deep reinforcement learning-based scheme is also proposed, which designs a deep neural network with dueling architecture to further improve the communication performance and computational complexity. The performance bounds regarding the signal to interference plus noise ratio, energy consumption and the communication utility are provided based on the Nash equilibrium of the game against jamming, and the computational complexity of the proposed schemes is analyzed. Simulation results show that the proposed schemes improve the energy efficiency and decrease the BER compared with the benchmark.http://www.sciencedirect.com/science/article/pii/S2352864822001729Maritime communicationsJammingUnmanned aerial vehicleRelayReinforcement learning |
| spellingShingle | Chuhuan Liu Yi Zhang Guohang Niu Luliang Jia Liang Xiao Jiangxia Luan Towards reinforcement learning in UAV relay for anti-jamming maritime communications Digital Communications and Networks Maritime communications Jamming Unmanned aerial vehicle Relay Reinforcement learning |
| title | Towards reinforcement learning in UAV relay for anti-jamming maritime communications |
| title_full | Towards reinforcement learning in UAV relay for anti-jamming maritime communications |
| title_fullStr | Towards reinforcement learning in UAV relay for anti-jamming maritime communications |
| title_full_unstemmed | Towards reinforcement learning in UAV relay for anti-jamming maritime communications |
| title_short | Towards reinforcement learning in UAV relay for anti-jamming maritime communications |
| title_sort | towards reinforcement learning in uav relay for anti jamming maritime communications |
| topic | Maritime communications Jamming Unmanned aerial vehicle Relay Reinforcement learning |
| url | http://www.sciencedirect.com/science/article/pii/S2352864822001729 |
| work_keys_str_mv | AT chuhuanliu towardsreinforcementlearninginuavrelayforantijammingmaritimecommunications AT yizhang towardsreinforcementlearninginuavrelayforantijammingmaritimecommunications AT guohangniu towardsreinforcementlearninginuavrelayforantijammingmaritimecommunications AT luliangjia towardsreinforcementlearninginuavrelayforantijammingmaritimecommunications AT liangxiao towardsreinforcementlearninginuavrelayforantijammingmaritimecommunications AT jiangxialuan towardsreinforcementlearninginuavrelayforantijammingmaritimecommunications |