Deep Reinforcement Learning Based Intelligent User Selection in Massive MIMO Underlay Cognitive Radios

Cognitive radio (CR) and massive multiple-input multiple-output (MIMO) have attracted much interest recently due to the amazing ability to accommodate more users and improve spectrum utilization. This paper investigates the QoS-aware user selection approach for massive MIMO underlay cognitive radio....

Full description

Bibliographic Details
Main Authors: Zhaoyuan Shi, Xianzhong Xie, Huabing Lu
Format: Article
Language:English
Published: IEEE 2019-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/8781916/
_version_ 1818566462042800128
author Zhaoyuan Shi
Xianzhong Xie
Huabing Lu
author_facet Zhaoyuan Shi
Xianzhong Xie
Huabing Lu
author_sort Zhaoyuan Shi
collection DOAJ
description Cognitive radio (CR) and massive multiple-input multiple-output (MIMO) have attracted much interest recently due to the amazing ability to accommodate more users and improve spectrum utilization. This paper investigates the QoS-aware user selection approach for massive MIMO underlay cognitive radio. Two main CR scenarios are considered: 1) the channel state information (CSI) of the cross channels are available at the secondary base station (SBS), and 2) any CSI of cross-network is unavailable at SBS. For the former, we develop the low-complexity increase-user-with-minimum-power algorithm (IUMP) and decrease-user-with-maximum-power algorithm (DUMP) which both can address the problem of user selection with power allocation. However, the CSI is typically not available in practice. To address the intractable issue, we propose a deep reinforcement learning-based approach, which can enable the SBS to realize efficient and intelligent user selection. The simulation results show that the IUMP and DUMP algorithms have obvious performance advantages over traditional user selection methods. In addition, results also verify that our constructed neural network can efficiently learn the optimal user selection policy in the unknown dynamic environment with fast convergence and high success rate.
first_indexed 2024-12-14T01:53:59Z
format Article
id doaj.art-1ecc18ac3df14ced8cbbd68b7bbbc8d4
institution Directory Open Access Journal
issn 2169-3536
language English
last_indexed 2024-12-14T01:53:59Z
publishDate 2019-01-01
publisher IEEE
record_format Article
series IEEE Access
spelling doaj.art-1ecc18ac3df14ced8cbbd68b7bbbc8d42022-12-21T23:21:16ZengIEEEIEEE Access2169-35362019-01-01711088411089410.1109/ACCESS.2019.29320168781916Deep Reinforcement Learning Based Intelligent User Selection in Massive MIMO Underlay Cognitive RadiosZhaoyuan Shi0https://orcid.org/0000-0002-6840-3477Xianzhong Xie1Huabing Lu2https://orcid.org/0000-0003-4782-6662School of Computer Science and Technology, Chongqing University of Posts and Telecommunications, Chongqing, ChinaSchool of Computer Science and Technology, Chongqing University of Posts and Telecommunications, Chongqing, ChinaSchool of Computer Science and Technology, Chongqing University of Posts and Telecommunications, Chongqing, ChinaCognitive radio (CR) and massive multiple-input multiple-output (MIMO) have attracted much interest recently due to the amazing ability to accommodate more users and improve spectrum utilization. This paper investigates the QoS-aware user selection approach for massive MIMO underlay cognitive radio. Two main CR scenarios are considered: 1) the channel state information (CSI) of the cross channels are available at the secondary base station (SBS), and 2) any CSI of cross-network is unavailable at SBS. For the former, we develop the low-complexity increase-user-with-minimum-power algorithm (IUMP) and decrease-user-with-maximum-power algorithm (DUMP) which both can address the problem of user selection with power allocation. However, the CSI is typically not available in practice. To address the intractable issue, we propose a deep reinforcement learning-based approach, which can enable the SBS to realize efficient and intelligent user selection. The simulation results show that the IUMP and DUMP algorithms have obvious performance advantages over traditional user selection methods. In addition, results also verify that our constructed neural network can efficiently learn the optimal user selection policy in the unknown dynamic environment with fast convergence and high success rate.https://ieeexplore.ieee.org/document/8781916/Cognitive radiomassive MIMOpower allocationdeep reinforcement learninguser selection
spellingShingle Zhaoyuan Shi
Xianzhong Xie
Huabing Lu
Deep Reinforcement Learning Based Intelligent User Selection in Massive MIMO Underlay Cognitive Radios
IEEE Access
Cognitive radio
massive MIMO
power allocation
deep reinforcement learning
user selection
title Deep Reinforcement Learning Based Intelligent User Selection in Massive MIMO Underlay Cognitive Radios
title_full Deep Reinforcement Learning Based Intelligent User Selection in Massive MIMO Underlay Cognitive Radios
title_fullStr Deep Reinforcement Learning Based Intelligent User Selection in Massive MIMO Underlay Cognitive Radios
title_full_unstemmed Deep Reinforcement Learning Based Intelligent User Selection in Massive MIMO Underlay Cognitive Radios
title_short Deep Reinforcement Learning Based Intelligent User Selection in Massive MIMO Underlay Cognitive Radios
title_sort deep reinforcement learning based intelligent user selection in massive mimo underlay cognitive radios
topic Cognitive radio
massive MIMO
power allocation
deep reinforcement learning
user selection
url https://ieeexplore.ieee.org/document/8781916/
work_keys_str_mv AT zhaoyuanshi deepreinforcementlearningbasedintelligentuserselectioninmassivemimounderlaycognitiveradios
AT xianzhongxie deepreinforcementlearningbasedintelligentuserselectioninmassivemimounderlaycognitiveradios
AT huabinglu deepreinforcementlearningbasedintelligentuserselectioninmassivemimounderlaycognitiveradios