Sum Rate Optimization for Multi-IRS-Aided Multi-BS Communication System Based on Multi-Agent

Intelligent reflecting surface (IRS) is a revolutionizing technology for improving the spectral and energy efficiency of future wireless networks. In this paper, we consider a downlink large-scale system empowered by multi-IRS to aid communication between the multiple base stations (BSs) and multipl...

Full description

Bibliographic Details
Main Authors: Maha Fathy, Zesong Fei, Jing Guo, Mohamed Salah Abood
Format: Article
Language:English
Published: MDPI AG 2024-02-01
Series:Electronics
Subjects:
Online Access:https://www.mdpi.com/2079-9292/13/4/735
_version_ 1797298443437211648
author Maha Fathy
Zesong Fei
Jing Guo
Mohamed Salah Abood
author_facet Maha Fathy
Zesong Fei
Jing Guo
Mohamed Salah Abood
author_sort Maha Fathy
collection DOAJ
description Intelligent reflecting surface (IRS) is a revolutionizing technology for improving the spectral and energy efficiency of future wireless networks. In this paper, we consider a downlink large-scale system empowered by multi-IRS to aid communication between the multiple base stations (BSs) and multiple user equipment (UEs). We target maximizing the sum rate by jointly optimizing the UE association, the transmit powers of BSs, and the configurations of the IRS beamforming. Due to the applicability restrictions of conventional optimization methods and their high complexity with large-scale networks in dynamic environments, deep reinforcement (DRL) learning is adopted as an alternative approach to finding optimal solutions. First, we model the optimization problem as a multi-agent Markov decision problem (MAMDP). Then, because large-scale wireless networks are naturally complex and changeable, and because many entities interact and affect how the whole system works, it is important to use a multi-agent approach to understand the complex dependencies and relationships between the different parts. In order to solve the problem, we propose a cooperative multi-agent deep reinforcement learning (MADRL)-based algorithm that works for both continuous and discrete IRS phase shifts. Simulation results validate that the proposed algorithm surpasses iterative optimization benchmarks regarding both sum rate performance and convergence.
first_indexed 2024-03-07T22:34:56Z
format Article
id doaj.art-d905584415d54790a435ac3aab5a7520
institution Directory Open Access Journal
issn 2079-9292
language English
last_indexed 2024-03-07T22:34:56Z
publishDate 2024-02-01
publisher MDPI AG
record_format Article
series Electronics
spelling doaj.art-d905584415d54790a435ac3aab5a75202024-02-23T15:14:47ZengMDPI AGElectronics2079-92922024-02-0113473510.3390/electronics13040735Sum Rate Optimization for Multi-IRS-Aided Multi-BS Communication System Based on Multi-AgentMaha Fathy0Zesong Fei1Jing Guo2Mohamed Salah Abood3School of Information and Electronics Engineering, Beijing Institute of Technology, Beijing 100081, ChinaSchool of Information and Electronics Engineering, Beijing Institute of Technology, Beijing 100081, ChinaSchool of Information and Electronics Engineering, Beijing Institute of Technology, Beijing 100081, ChinaSchool of Information and Electronics Engineering, Beijing Institute of Technology, Beijing 100081, ChinaIntelligent reflecting surface (IRS) is a revolutionizing technology for improving the spectral and energy efficiency of future wireless networks. In this paper, we consider a downlink large-scale system empowered by multi-IRS to aid communication between the multiple base stations (BSs) and multiple user equipment (UEs). We target maximizing the sum rate by jointly optimizing the UE association, the transmit powers of BSs, and the configurations of the IRS beamforming. Due to the applicability restrictions of conventional optimization methods and their high complexity with large-scale networks in dynamic environments, deep reinforcement (DRL) learning is adopted as an alternative approach to finding optimal solutions. First, we model the optimization problem as a multi-agent Markov decision problem (MAMDP). Then, because large-scale wireless networks are naturally complex and changeable, and because many entities interact and affect how the whole system works, it is important to use a multi-agent approach to understand the complex dependencies and relationships between the different parts. In order to solve the problem, we propose a cooperative multi-agent deep reinforcement learning (MADRL)-based algorithm that works for both continuous and discrete IRS phase shifts. Simulation results validate that the proposed algorithm surpasses iterative optimization benchmarks regarding both sum rate performance and convergence.https://www.mdpi.com/2079-9292/13/4/735intelligent reflecting surfacepassive beamformingpower controluser associationmulti-agent
spellingShingle Maha Fathy
Zesong Fei
Jing Guo
Mohamed Salah Abood
Sum Rate Optimization for Multi-IRS-Aided Multi-BS Communication System Based on Multi-Agent
Electronics
intelligent reflecting surface
passive beamforming
power control
user association
multi-agent
title Sum Rate Optimization for Multi-IRS-Aided Multi-BS Communication System Based on Multi-Agent
title_full Sum Rate Optimization for Multi-IRS-Aided Multi-BS Communication System Based on Multi-Agent
title_fullStr Sum Rate Optimization for Multi-IRS-Aided Multi-BS Communication System Based on Multi-Agent
title_full_unstemmed Sum Rate Optimization for Multi-IRS-Aided Multi-BS Communication System Based on Multi-Agent
title_short Sum Rate Optimization for Multi-IRS-Aided Multi-BS Communication System Based on Multi-Agent
title_sort sum rate optimization for multi irs aided multi bs communication system based on multi agent
topic intelligent reflecting surface
passive beamforming
power control
user association
multi-agent
url https://www.mdpi.com/2079-9292/13/4/735
work_keys_str_mv AT mahafathy sumrateoptimizationformultiirsaidedmultibscommunicationsystembasedonmultiagent
AT zesongfei sumrateoptimizationformultiirsaidedmultibscommunicationsystembasedonmultiagent
AT jingguo sumrateoptimizationformultiirsaidedmultibscommunicationsystembasedonmultiagent
AT mohamedsalahabood sumrateoptimizationformultiirsaidedmultibscommunicationsystembasedonmultiagent