Bandit-Based Power Control in Full-Duplex Cooperative Relay Networks With Strict-Sense Stationary and Non-Stationary Wireless Communication Channels
Full-duplex relaying is an enabling technique of sixth generation (6G) mobile networks, promising tremendous rate and spectral efficiency gains. In order to improve the performance of full-duplex communications, power control is a viable way of avoiding excessive loop interference at the relay. Unfo...
Main Authors: | , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
IEEE
2022-01-01
|
Series: | IEEE Open Journal of the Communications Society |
Subjects: | |
Online Access: | https://ieeexplore.ieee.org/document/9722918/ |
_version_ | 1811177351995719680 |
---|---|
author | Nikolaos Nomikos Mohammad Sadegh Talebi Themistoklis Charalambous Risto Wichman |
author_facet | Nikolaos Nomikos Mohammad Sadegh Talebi Themistoklis Charalambous Risto Wichman |
author_sort | Nikolaos Nomikos |
collection | DOAJ |
description | Full-duplex relaying is an enabling technique of sixth generation (6G) mobile networks, promising tremendous rate and spectral efficiency gains. In order to improve the performance of full-duplex communications, power control is a viable way of avoiding excessive loop interference at the relay. Unfortunately, power control requires channel state information of source-relay, relay-destination and loop interference channels, thus resulting in increased overheads. Aiming to offer a low-complexity alternative for power control in such networks, we adopt reward-based learning in the sense of multi-armed bandits. More specifically, we present bandit-based power control, relying on acknowledgements/negative-acknowledgements observations by the relay. Our distributed algorithms avoid channel state information acquisition and exchange, and can alleviate the impact of outdated channel state information. Two cases are examined regarding the channel statistics of the wireless network, namely, strict-sense stationary and non-stationary channels. For the latter, a sliding window approach is adopted to further improve the performance. Performance evaluation highlights a performance-complexity trade-off, compared to optimal power control with full channel knowledge and significant gains over cases considering channel estimation and feedback overheads, outdated channel knowledge, no power control and random power level selection. Finally, it is shown that the sliding-window bandit-based algorithm provides improved performance in non-stationary settings by efficiently adapting to abrupt changes of the wireless channels. |
first_indexed | 2024-04-10T23:00:24Z |
format | Article |
id | doaj.art-9fdb9c2081df4a2ba9fe1c47b817d834 |
institution | Directory Open Access Journal |
issn | 2644-125X |
language | English |
last_indexed | 2024-04-10T23:00:24Z |
publishDate | 2022-01-01 |
publisher | IEEE |
record_format | Article |
series | IEEE Open Journal of the Communications Society |
spelling | doaj.art-9fdb9c2081df4a2ba9fe1c47b817d8342023-01-14T00:00:27ZengIEEEIEEE Open Journal of the Communications Society2644-125X2022-01-01336637810.1109/OJCOMS.2022.31542929722918Bandit-Based Power Control in Full-Duplex Cooperative Relay Networks With Strict-Sense Stationary and Non-Stationary Wireless Communication ChannelsNikolaos Nomikos0https://orcid.org/0000-0002-9210-9796Mohammad Sadegh Talebi1Themistoklis Charalambous2https://orcid.org/0000-0003-4800-6738Risto Wichman3https://orcid.org/0000-0002-5261-5037IRIDA Research Centre for Communication Technologies, University of Cyprus, Nicosia, CyprusDepartment of Computer Science, University of Copenhagen, Copenhagen, DenmarkSchool of Electrical Engineering, Aalto University, Espoo, FinlandSchool of Electrical Engineering, Aalto University, Espoo, FinlandFull-duplex relaying is an enabling technique of sixth generation (6G) mobile networks, promising tremendous rate and spectral efficiency gains. In order to improve the performance of full-duplex communications, power control is a viable way of avoiding excessive loop interference at the relay. Unfortunately, power control requires channel state information of source-relay, relay-destination and loop interference channels, thus resulting in increased overheads. Aiming to offer a low-complexity alternative for power control in such networks, we adopt reward-based learning in the sense of multi-armed bandits. More specifically, we present bandit-based power control, relying on acknowledgements/negative-acknowledgements observations by the relay. Our distributed algorithms avoid channel state information acquisition and exchange, and can alleviate the impact of outdated channel state information. Two cases are examined regarding the channel statistics of the wireless network, namely, strict-sense stationary and non-stationary channels. For the latter, a sliding window approach is adopted to further improve the performance. Performance evaluation highlights a performance-complexity trade-off, compared to optimal power control with full channel knowledge and significant gains over cases considering channel estimation and feedback overheads, outdated channel knowledge, no power control and random power level selection. Finally, it is shown that the sliding-window bandit-based algorithm provides improved performance in non-stationary settings by efficiently adapting to abrupt changes of the wireless channels.https://ieeexplore.ieee.org/document/9722918/Full-duplex relayingpower controlreinforcement learningmulti-armed banditsnon-stationary wireless channelsoutdated CSI |
spellingShingle | Nikolaos Nomikos Mohammad Sadegh Talebi Themistoklis Charalambous Risto Wichman Bandit-Based Power Control in Full-Duplex Cooperative Relay Networks With Strict-Sense Stationary and Non-Stationary Wireless Communication Channels IEEE Open Journal of the Communications Society Full-duplex relaying power control reinforcement learning multi-armed bandits non-stationary wireless channels outdated CSI |
title | Bandit-Based Power Control in Full-Duplex Cooperative Relay Networks With Strict-Sense Stationary and Non-Stationary Wireless Communication Channels |
title_full | Bandit-Based Power Control in Full-Duplex Cooperative Relay Networks With Strict-Sense Stationary and Non-Stationary Wireless Communication Channels |
title_fullStr | Bandit-Based Power Control in Full-Duplex Cooperative Relay Networks With Strict-Sense Stationary and Non-Stationary Wireless Communication Channels |
title_full_unstemmed | Bandit-Based Power Control in Full-Duplex Cooperative Relay Networks With Strict-Sense Stationary and Non-Stationary Wireless Communication Channels |
title_short | Bandit-Based Power Control in Full-Duplex Cooperative Relay Networks With Strict-Sense Stationary and Non-Stationary Wireless Communication Channels |
title_sort | bandit based power control in full duplex cooperative relay networks with strict sense stationary and non stationary wireless communication channels |
topic | Full-duplex relaying power control reinforcement learning multi-armed bandits non-stationary wireless channels outdated CSI |
url | https://ieeexplore.ieee.org/document/9722918/ |
work_keys_str_mv | AT nikolaosnomikos banditbasedpowercontrolinfullduplexcooperativerelaynetworkswithstrictsensestationaryandnonstationarywirelesscommunicationchannels AT mohammadsadeghtalebi banditbasedpowercontrolinfullduplexcooperativerelaynetworkswithstrictsensestationaryandnonstationarywirelesscommunicationchannels AT themistoklischaralambous banditbasedpowercontrolinfullduplexcooperativerelaynetworkswithstrictsensestationaryandnonstationarywirelesscommunicationchannels AT ristowichman banditbasedpowercontrolinfullduplexcooperativerelaynetworkswithstrictsensestationaryandnonstationarywirelesscommunicationchannels |