Joint DDPG and Unsupervised Learning for Channel Allocation and Power Control in Centralized Wireless Cellular Networks
In order to solve the resource allocation problem in scenarios of centralized wireless cellular communication with multiple cells, users and channels, a novel resource allocation algorithm based on joint Deep Deterministic Policy Gradient (DDPG) reinforcement learning and unsupervised learning is pr...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2023-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/10107912/ |
| _version_ | 1797833239610523648 |
|---|---|
| author | Ming Sun Erzhuang Mei Shumei Wang Yanhui Jin |
| author_facet | Ming Sun Erzhuang Mei Shumei Wang Yanhui Jin |
| author_sort | Ming Sun |
| collection | DOAJ |
| description | In order to solve the resource allocation problem in scenarios of centralized wireless cellular communication with multiple cells, users and channels, a novel resource allocation algorithm based on joint Deep Deterministic Policy Gradient (DDPG) reinforcement learning and unsupervised learning is proposed. Firstly, the proposed algorithm constructs a channel allocation deep neural network based on DDPG to provide an optimized channel allocation scheme. Secondly, the proposed algorithm constructs a power control deep neural network based on unsupervised learning to provide an optimized power control scheme. In order to make the unsupervised learning have perceptions on dynamic wireless environments, the double experience replay is executed to train the channel allocation deep neural network with the DDPG reinforcement learning and the power control deep neural network with the unsupervised learning, respectively. Since the proposed joint algorithm combines the dynamic perception ability of the DDPG reinforcement learning and the continuous optimization ability of unsupervised learning, the energy efficiency can be effectively maximized. Simulation results show that the proposed algorithm outperforms other algorithms in terms of energy efficiency and transmit rate in time-varying dynamic environments. Furthermore, we discuss the implications of our results and possible future research directions. Our work contributes to the advancement of resource allocation techniques in multi-cell cellular networks to meet the increasing demands of modern wireless communication systems. |
| first_indexed | 2024-04-09T14:21:10Z |
| format | Article |
| id | doaj.art-ea094cbf95604a12af8dd33f6168688f |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-04-09T14:21:10Z |
| publishDate | 2023-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-ea094cbf95604a12af8dd33f6168688f2023-05-04T23:00:06ZengIEEEIEEE Access2169-35362023-01-0111421914220310.1109/ACCESS.2023.327031610107912Joint DDPG and Unsupervised Learning for Channel Allocation and Power Control in Centralized Wireless Cellular NetworksMing Sun0https://orcid.org/0000-0003-0506-2860Erzhuang Mei1Shumei Wang2Yanhui Jin3College of Computer and Control Engineering, Qiqihar University, Qiqihar, ChinaCollege of Computer and Control Engineering, Qiqihar University, Qiqihar, ChinaSchool of Computer and Information Engineering, Harbin University of Commerce, Harbin, ChinaCollege of Computer and Control Engineering, Qiqihar University, Qiqihar, ChinaIn order to solve the resource allocation problem in scenarios of centralized wireless cellular communication with multiple cells, users and channels, a novel resource allocation algorithm based on joint Deep Deterministic Policy Gradient (DDPG) reinforcement learning and unsupervised learning is proposed. Firstly, the proposed algorithm constructs a channel allocation deep neural network based on DDPG to provide an optimized channel allocation scheme. Secondly, the proposed algorithm constructs a power control deep neural network based on unsupervised learning to provide an optimized power control scheme. In order to make the unsupervised learning have perceptions on dynamic wireless environments, the double experience replay is executed to train the channel allocation deep neural network with the DDPG reinforcement learning and the power control deep neural network with the unsupervised learning, respectively. Since the proposed joint algorithm combines the dynamic perception ability of the DDPG reinforcement learning and the continuous optimization ability of unsupervised learning, the energy efficiency can be effectively maximized. Simulation results show that the proposed algorithm outperforms other algorithms in terms of energy efficiency and transmit rate in time-varying dynamic environments. Furthermore, we discuss the implications of our results and possible future research directions. Our work contributes to the advancement of resource allocation techniques in multi-cell cellular networks to meet the increasing demands of modern wireless communication systems.https://ieeexplore.ieee.org/document/10107912/Deep reinforcement learningDDPGunsupervised learningdouble experience replaychannel allocationpower control |
| spellingShingle | Ming Sun Erzhuang Mei Shumei Wang Yanhui Jin Joint DDPG and Unsupervised Learning for Channel Allocation and Power Control in Centralized Wireless Cellular Networks IEEE Access Deep reinforcement learning DDPG unsupervised learning double experience replay channel allocation power control |
| title | Joint DDPG and Unsupervised Learning for Channel Allocation and Power Control in Centralized Wireless Cellular Networks |
| title_full | Joint DDPG and Unsupervised Learning for Channel Allocation and Power Control in Centralized Wireless Cellular Networks |
| title_fullStr | Joint DDPG and Unsupervised Learning for Channel Allocation and Power Control in Centralized Wireless Cellular Networks |
| title_full_unstemmed | Joint DDPG and Unsupervised Learning for Channel Allocation and Power Control in Centralized Wireless Cellular Networks |
| title_short | Joint DDPG and Unsupervised Learning for Channel Allocation and Power Control in Centralized Wireless Cellular Networks |
| title_sort | joint ddpg and unsupervised learning for channel allocation and power control in centralized wireless cellular networks |
| topic | Deep reinforcement learning DDPG unsupervised learning double experience replay channel allocation power control |
| url | https://ieeexplore.ieee.org/document/10107912/ |
| work_keys_str_mv | AT mingsun jointddpgandunsupervisedlearningforchannelallocationandpowercontrolincentralizedwirelesscellularnetworks AT erzhuangmei jointddpgandunsupervisedlearningforchannelallocationandpowercontrolincentralizedwirelesscellularnetworks AT shumeiwang jointddpgandunsupervisedlearningforchannelallocationandpowercontrolincentralizedwirelesscellularnetworks AT yanhuijin jointddpgandunsupervisedlearningforchannelallocationandpowercontrolincentralizedwirelesscellularnetworks |