Enhanced Dynamic Spectrum Access in UAV Wireless Networks for Post-Disaster Area Surveillance System: A Multi-Player Multi-Armed Bandit Approach
Modern wireless networks are notorious for being very dense, uncoordinated, and selfish, especially with greedy user needs. This leads to a critical scarcity problem in spectrum resources. The Dynamic Spectrum Access system (DSA) is considered a promising solution for this scarcity problem. With the...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2021-11-01
|
| Series: | Sensors |
| Subjects: | |
| Online Access: | https://www.mdpi.com/1424-8220/21/23/7855 |
| _version_ | 1797507251903135744 |
|---|---|
| author | Amr Amrallah Ehab Mahmoud Mohamed Gia Khanh Tran Kei Sakaguchi |
| author_facet | Amr Amrallah Ehab Mahmoud Mohamed Gia Khanh Tran Kei Sakaguchi |
| author_sort | Amr Amrallah |
| collection | DOAJ |
| description | Modern wireless networks are notorious for being very dense, uncoordinated, and selfish, especially with greedy user needs. This leads to a critical scarcity problem in spectrum resources. The Dynamic Spectrum Access system (DSA) is considered a promising solution for this scarcity problem. With the aid of Unmanned Aerial Vehicles (UAVs), a post-disaster surveillance system is implemented using Cognitive Radio Network (CRN). UAVs are distributed in the disaster area to capture live images of the damaged area and send them to the disaster management center. CRN enables UAVs to utilize a portion of the spectrum of the Electronic Toll Collection (ETC) gates operating in the same area. In this paper, a joint transmission power selection, data-rate maximization, and interference mitigation problem is addressed. Considering all these conflicting parameters, this problem is investigated as a budget-constrained multi-player multi-armed bandit (MAB) problem. The whole process is done in a decentralized manner, where no information is exchanged between UAVs. To achieve this, two power-budget-aware PBA-MAB) algorithms, namely upper confidence bound (PBA-UCB (MAB) algorithm and Thompson sampling (PBA-TS) algorithm, were proposed to realize the selection of the transmission power value efficiently. The proposed PBA-MAB algorithms show outstanding performance over random power value selection in terms of achievable data rate. |
| first_indexed | 2024-03-10T04:45:54Z |
| format | Article |
| id | doaj.art-de37e34de7c9450b8eed6caa5528cd23 |
| institution | Directory Open Access Journal |
| issn | 1424-8220 |
| language | English |
| last_indexed | 2024-03-10T04:45:54Z |
| publishDate | 2021-11-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Sensors |
| spelling | doaj.art-de37e34de7c9450b8eed6caa5528cd232023-11-23T03:00:09ZengMDPI AGSensors1424-82202021-11-012123785510.3390/s21237855Enhanced Dynamic Spectrum Access in UAV Wireless Networks for Post-Disaster Area Surveillance System: A Multi-Player Multi-Armed Bandit ApproachAmr Amrallah0Ehab Mahmoud Mohamed1Gia Khanh Tran2Kei Sakaguchi3Department of Electrical and Electronic Engineering, School of Engineering, Tokyo Institute of Technology, Meguro, Tokyo 152-8550, JapanElectrical Engineering Department, College of Engineering, Prince Sattam Bin Abdulaziz University, Wadi Addwasir 11991, Saudi ArabiaDepartment of Electrical and Electronic Engineering, School of Engineering, Tokyo Institute of Technology, Meguro, Tokyo 152-8550, JapanDepartment of Electrical and Electronic Engineering, School of Engineering, Tokyo Institute of Technology, Meguro, Tokyo 152-8550, JapanModern wireless networks are notorious for being very dense, uncoordinated, and selfish, especially with greedy user needs. This leads to a critical scarcity problem in spectrum resources. The Dynamic Spectrum Access system (DSA) is considered a promising solution for this scarcity problem. With the aid of Unmanned Aerial Vehicles (UAVs), a post-disaster surveillance system is implemented using Cognitive Radio Network (CRN). UAVs are distributed in the disaster area to capture live images of the damaged area and send them to the disaster management center. CRN enables UAVs to utilize a portion of the spectrum of the Electronic Toll Collection (ETC) gates operating in the same area. In this paper, a joint transmission power selection, data-rate maximization, and interference mitigation problem is addressed. Considering all these conflicting parameters, this problem is investigated as a budget-constrained multi-player multi-armed bandit (MAB) problem. The whole process is done in a decentralized manner, where no information is exchanged between UAVs. To achieve this, two power-budget-aware PBA-MAB) algorithms, namely upper confidence bound (PBA-UCB (MAB) algorithm and Thompson sampling (PBA-TS) algorithm, were proposed to realize the selection of the transmission power value efficiently. The proposed PBA-MAB algorithms show outstanding performance over random power value selection in terms of achievable data rate.https://www.mdpi.com/1424-8220/21/23/7855unmanned aerial vehiclesdynamic spectrum accessquality of servicereinforcement learningmulti-armed bandit |
| spellingShingle | Amr Amrallah Ehab Mahmoud Mohamed Gia Khanh Tran Kei Sakaguchi Enhanced Dynamic Spectrum Access in UAV Wireless Networks for Post-Disaster Area Surveillance System: A Multi-Player Multi-Armed Bandit Approach Sensors unmanned aerial vehicles dynamic spectrum access quality of service reinforcement learning multi-armed bandit |
| title | Enhanced Dynamic Spectrum Access in UAV Wireless Networks for Post-Disaster Area Surveillance System: A Multi-Player Multi-Armed Bandit Approach |
| title_full | Enhanced Dynamic Spectrum Access in UAV Wireless Networks for Post-Disaster Area Surveillance System: A Multi-Player Multi-Armed Bandit Approach |
| title_fullStr | Enhanced Dynamic Spectrum Access in UAV Wireless Networks for Post-Disaster Area Surveillance System: A Multi-Player Multi-Armed Bandit Approach |
| title_full_unstemmed | Enhanced Dynamic Spectrum Access in UAV Wireless Networks for Post-Disaster Area Surveillance System: A Multi-Player Multi-Armed Bandit Approach |
| title_short | Enhanced Dynamic Spectrum Access in UAV Wireless Networks for Post-Disaster Area Surveillance System: A Multi-Player Multi-Armed Bandit Approach |
| title_sort | enhanced dynamic spectrum access in uav wireless networks for post disaster area surveillance system a multi player multi armed bandit approach |
| topic | unmanned aerial vehicles dynamic spectrum access quality of service reinforcement learning multi-armed bandit |
| url | https://www.mdpi.com/1424-8220/21/23/7855 |
| work_keys_str_mv | AT amramrallah enhanceddynamicspectrumaccessinuavwirelessnetworksforpostdisasterareasurveillancesystemamultiplayermultiarmedbanditapproach AT ehabmahmoudmohamed enhanceddynamicspectrumaccessinuavwirelessnetworksforpostdisasterareasurveillancesystemamultiplayermultiarmedbanditapproach AT giakhanhtran enhanceddynamicspectrumaccessinuavwirelessnetworksforpostdisasterareasurveillancesystemamultiplayermultiarmedbanditapproach AT keisakaguchi enhanceddynamicspectrumaccessinuavwirelessnetworksforpostdisasterareasurveillancesystemamultiplayermultiarmedbanditapproach |