Bandit-Based Power Control in Full-Duplex Cooperative Relay Networks With Strict-Sense Stationary and Non-Stationary Wireless Communication Channels

Full-duplex relaying is an enabling technique of sixth generation (6G) mobile networks, promising tremendous rate and spectral efficiency gains. In order to improve the performance of full-duplex communications, power control is a viable way of avoiding excessive loop interference at the relay. Unfo...

Full description

Bibliographic Details
Main Authors: Nikolaos Nomikos, Mohammad Sadegh Talebi, Themistoklis Charalambous, Risto Wichman
Format: Article
Language:English
Published: IEEE 2022-01-01
Series:IEEE Open Journal of the Communications Society
Subjects:
Online Access:https://ieeexplore.ieee.org/document/9722918/
_version_ 1811177351995719680
author Nikolaos Nomikos
Mohammad Sadegh Talebi
Themistoklis Charalambous
Risto Wichman
author_facet Nikolaos Nomikos
Mohammad Sadegh Talebi
Themistoklis Charalambous
Risto Wichman
author_sort Nikolaos Nomikos
collection DOAJ
description Full-duplex relaying is an enabling technique of sixth generation (6G) mobile networks, promising tremendous rate and spectral efficiency gains. In order to improve the performance of full-duplex communications, power control is a viable way of avoiding excessive loop interference at the relay. Unfortunately, power control requires channel state information of source-relay, relay-destination and loop interference channels, thus resulting in increased overheads. Aiming to offer a low-complexity alternative for power control in such networks, we adopt reward-based learning in the sense of multi-armed bandits. More specifically, we present bandit-based power control, relying on acknowledgements/negative-acknowledgements observations by the relay. Our distributed algorithms avoid channel state information acquisition and exchange, and can alleviate the impact of outdated channel state information. Two cases are examined regarding the channel statistics of the wireless network, namely, strict-sense stationary and non-stationary channels. For the latter, a sliding window approach is adopted to further improve the performance. Performance evaluation highlights a performance-complexity trade-off, compared to optimal power control with full channel knowledge and significant gains over cases considering channel estimation and feedback overheads, outdated channel knowledge, no power control and random power level selection. Finally, it is shown that the sliding-window bandit-based algorithm provides improved performance in non-stationary settings by efficiently adapting to abrupt changes of the wireless channels.
first_indexed 2024-04-10T23:00:24Z
format Article
id doaj.art-9fdb9c2081df4a2ba9fe1c47b817d834
institution Directory Open Access Journal
issn 2644-125X
language English
last_indexed 2024-04-10T23:00:24Z
publishDate 2022-01-01
publisher IEEE
record_format Article
series IEEE Open Journal of the Communications Society
spelling doaj.art-9fdb9c2081df4a2ba9fe1c47b817d8342023-01-14T00:00:27ZengIEEEIEEE Open Journal of the Communications Society2644-125X2022-01-01336637810.1109/OJCOMS.2022.31542929722918Bandit-Based Power Control in Full-Duplex Cooperative Relay Networks With Strict-Sense Stationary and Non-Stationary Wireless Communication ChannelsNikolaos Nomikos0https://orcid.org/0000-0002-9210-9796Mohammad Sadegh Talebi1Themistoklis Charalambous2https://orcid.org/0000-0003-4800-6738Risto Wichman3https://orcid.org/0000-0002-5261-5037IRIDA Research Centre for Communication Technologies, University of Cyprus, Nicosia, CyprusDepartment of Computer Science, University of Copenhagen, Copenhagen, DenmarkSchool of Electrical Engineering, Aalto University, Espoo, FinlandSchool of Electrical Engineering, Aalto University, Espoo, FinlandFull-duplex relaying is an enabling technique of sixth generation (6G) mobile networks, promising tremendous rate and spectral efficiency gains. In order to improve the performance of full-duplex communications, power control is a viable way of avoiding excessive loop interference at the relay. Unfortunately, power control requires channel state information of source-relay, relay-destination and loop interference channels, thus resulting in increased overheads. Aiming to offer a low-complexity alternative for power control in such networks, we adopt reward-based learning in the sense of multi-armed bandits. More specifically, we present bandit-based power control, relying on acknowledgements/negative-acknowledgements observations by the relay. Our distributed algorithms avoid channel state information acquisition and exchange, and can alleviate the impact of outdated channel state information. Two cases are examined regarding the channel statistics of the wireless network, namely, strict-sense stationary and non-stationary channels. For the latter, a sliding window approach is adopted to further improve the performance. Performance evaluation highlights a performance-complexity trade-off, compared to optimal power control with full channel knowledge and significant gains over cases considering channel estimation and feedback overheads, outdated channel knowledge, no power control and random power level selection. Finally, it is shown that the sliding-window bandit-based algorithm provides improved performance in non-stationary settings by efficiently adapting to abrupt changes of the wireless channels.https://ieeexplore.ieee.org/document/9722918/Full-duplex relayingpower controlreinforcement learningmulti-armed banditsnon-stationary wireless channelsoutdated CSI
spellingShingle Nikolaos Nomikos
Mohammad Sadegh Talebi
Themistoklis Charalambous
Risto Wichman
Bandit-Based Power Control in Full-Duplex Cooperative Relay Networks With Strict-Sense Stationary and Non-Stationary Wireless Communication Channels
IEEE Open Journal of the Communications Society
Full-duplex relaying
power control
reinforcement learning
multi-armed bandits
non-stationary wireless channels
outdated CSI
title Bandit-Based Power Control in Full-Duplex Cooperative Relay Networks With Strict-Sense Stationary and Non-Stationary Wireless Communication Channels
title_full Bandit-Based Power Control in Full-Duplex Cooperative Relay Networks With Strict-Sense Stationary and Non-Stationary Wireless Communication Channels
title_fullStr Bandit-Based Power Control in Full-Duplex Cooperative Relay Networks With Strict-Sense Stationary and Non-Stationary Wireless Communication Channels
title_full_unstemmed Bandit-Based Power Control in Full-Duplex Cooperative Relay Networks With Strict-Sense Stationary and Non-Stationary Wireless Communication Channels
title_short Bandit-Based Power Control in Full-Duplex Cooperative Relay Networks With Strict-Sense Stationary and Non-Stationary Wireless Communication Channels
title_sort bandit based power control in full duplex cooperative relay networks with strict sense stationary and non stationary wireless communication channels
topic Full-duplex relaying
power control
reinforcement learning
multi-armed bandits
non-stationary wireless channels
outdated CSI
url https://ieeexplore.ieee.org/document/9722918/
work_keys_str_mv AT nikolaosnomikos banditbasedpowercontrolinfullduplexcooperativerelaynetworkswithstrictsensestationaryandnonstationarywirelesscommunicationchannels
AT mohammadsadeghtalebi banditbasedpowercontrolinfullduplexcooperativerelaynetworkswithstrictsensestationaryandnonstationarywirelesscommunicationchannels
AT themistoklischaralambous banditbasedpowercontrolinfullduplexcooperativerelaynetworkswithstrictsensestationaryandnonstationarywirelesscommunicationchannels
AT ristowichman banditbasedpowercontrolinfullduplexcooperativerelaynetworkswithstrictsensestationaryandnonstationarywirelesscommunicationchannels