Dynamic Cooperative Spectrum Sensing Based on Deep Multi-User Reinforcement Learning
Dynamic spectrum access (DSA) has been considered as a promising technology to address spectrum scarcity and improve spectrum utilization. Normally, the channels are related to each other. Meanwhile, collisions will be inevitably caused by communicating between multiple PUs or multiple SUs in a real...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2021-02-01
|
| Series: | Applied Sciences |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2076-3417/11/4/1884 |
| _version_ | 1797395813513560064 |
|---|---|
| author | Shuai Liu Jing He Jiayun Wu |
| author_facet | Shuai Liu Jing He Jiayun Wu |
| author_sort | Shuai Liu |
| collection | DOAJ |
| description | Dynamic spectrum access (DSA) has been considered as a promising technology to address spectrum scarcity and improve spectrum utilization. Normally, the channels are related to each other. Meanwhile, collisions will be inevitably caused by communicating between multiple PUs or multiple SUs in a real DSA environment. Considering these factors, the deep multi-user reinforcement learning (DMRL) is proposed by introducing the cooperative strategy into dueling deep Q network (DDQN). With no demand of prior information about the system dynamics, DDQN can efficiently learn the correlations between channels, and reduce the computational complexity in the large state space of the multi-user environment. To reduce the conflicts and further maximize the network utility, cooperative channel strategy is explored by utilizing the acknowledge (ACK) signals without exchanging spectrum information. In each time slot, each user selects a channel and transmits a packet with a certain probability. After sending, ACK signals are utilized to judge whether the transmission is successful or not. Compared with other popular models, the simulation results show that the proposed DMRL can achieve better performance on effectively enhancing spectrum utilization and reducing conflict rate in the dynamic cooperative spectrum sensing. |
| first_indexed | 2024-03-09T00:41:09Z |
| format | Article |
| id | doaj.art-eff35d85eafa4103920071a8d28fea51 |
| institution | Directory Open Access Journal |
| issn | 2076-3417 |
| language | English |
| last_indexed | 2024-03-09T00:41:09Z |
| publishDate | 2021-02-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Applied Sciences |
| spelling | doaj.art-eff35d85eafa4103920071a8d28fea512023-12-11T17:49:37ZengMDPI AGApplied Sciences2076-34172021-02-01114188410.3390/app11041884Dynamic Cooperative Spectrum Sensing Based on Deep Multi-User Reinforcement LearningShuai Liu0Jing He1Jiayun Wu2School of Software Engineering, Xi’an Jiaotong University, Xi’an 710049, ChinaSchool of Software Engineering, Xi’an Jiaotong University, Xi’an 710049, ChinaSchool of Software Engineering, Xi’an Jiaotong University, Xi’an 710049, ChinaDynamic spectrum access (DSA) has been considered as a promising technology to address spectrum scarcity and improve spectrum utilization. Normally, the channels are related to each other. Meanwhile, collisions will be inevitably caused by communicating between multiple PUs or multiple SUs in a real DSA environment. Considering these factors, the deep multi-user reinforcement learning (DMRL) is proposed by introducing the cooperative strategy into dueling deep Q network (DDQN). With no demand of prior information about the system dynamics, DDQN can efficiently learn the correlations between channels, and reduce the computational complexity in the large state space of the multi-user environment. To reduce the conflicts and further maximize the network utility, cooperative channel strategy is explored by utilizing the acknowledge (ACK) signals without exchanging spectrum information. In each time slot, each user selects a channel and transmits a packet with a certain probability. After sending, ACK signals are utilized to judge whether the transmission is successful or not. Compared with other popular models, the simulation results show that the proposed DMRL can achieve better performance on effectively enhancing spectrum utilization and reducing conflict rate in the dynamic cooperative spectrum sensing.https://www.mdpi.com/2076-3417/11/4/1884dynamic spectrum sensingreinforcement learningcollaborative strategy |
| spellingShingle | Shuai Liu Jing He Jiayun Wu Dynamic Cooperative Spectrum Sensing Based on Deep Multi-User Reinforcement Learning Applied Sciences dynamic spectrum sensing reinforcement learning collaborative strategy |
| title | Dynamic Cooperative Spectrum Sensing Based on Deep Multi-User Reinforcement Learning |
| title_full | Dynamic Cooperative Spectrum Sensing Based on Deep Multi-User Reinforcement Learning |
| title_fullStr | Dynamic Cooperative Spectrum Sensing Based on Deep Multi-User Reinforcement Learning |
| title_full_unstemmed | Dynamic Cooperative Spectrum Sensing Based on Deep Multi-User Reinforcement Learning |
| title_short | Dynamic Cooperative Spectrum Sensing Based on Deep Multi-User Reinforcement Learning |
| title_sort | dynamic cooperative spectrum sensing based on deep multi user reinforcement learning |
| topic | dynamic spectrum sensing reinforcement learning collaborative strategy |
| url | https://www.mdpi.com/2076-3417/11/4/1884 |
| work_keys_str_mv | AT shuailiu dynamiccooperativespectrumsensingbasedondeepmultiuserreinforcementlearning AT jinghe dynamiccooperativespectrumsensingbasedondeepmultiuserreinforcementlearning AT jiayunwu dynamiccooperativespectrumsensingbasedondeepmultiuserreinforcementlearning |