Sum Rate Optimization for Multi-IRS-Aided Multi-BS Communication System Based on Multi-Agent
Intelligent reflecting surface (IRS) is a revolutionizing technology for improving the spectral and energy efficiency of future wireless networks. In this paper, we consider a downlink large-scale system empowered by multi-IRS to aid communication between the multiple base stations (BSs) and multipl...
Main Authors: | , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
MDPI AG
2024-02-01
|
Series: | Electronics |
Subjects: | |
Online Access: | https://www.mdpi.com/2079-9292/13/4/735 |
_version_ | 1797298443437211648 |
---|---|
author | Maha Fathy Zesong Fei Jing Guo Mohamed Salah Abood |
author_facet | Maha Fathy Zesong Fei Jing Guo Mohamed Salah Abood |
author_sort | Maha Fathy |
collection | DOAJ |
description | Intelligent reflecting surface (IRS) is a revolutionizing technology for improving the spectral and energy efficiency of future wireless networks. In this paper, we consider a downlink large-scale system empowered by multi-IRS to aid communication between the multiple base stations (BSs) and multiple user equipment (UEs). We target maximizing the sum rate by jointly optimizing the UE association, the transmit powers of BSs, and the configurations of the IRS beamforming. Due to the applicability restrictions of conventional optimization methods and their high complexity with large-scale networks in dynamic environments, deep reinforcement (DRL) learning is adopted as an alternative approach to finding optimal solutions. First, we model the optimization problem as a multi-agent Markov decision problem (MAMDP). Then, because large-scale wireless networks are naturally complex and changeable, and because many entities interact and affect how the whole system works, it is important to use a multi-agent approach to understand the complex dependencies and relationships between the different parts. In order to solve the problem, we propose a cooperative multi-agent deep reinforcement learning (MADRL)-based algorithm that works for both continuous and discrete IRS phase shifts. Simulation results validate that the proposed algorithm surpasses iterative optimization benchmarks regarding both sum rate performance and convergence. |
first_indexed | 2024-03-07T22:34:56Z |
format | Article |
id | doaj.art-d905584415d54790a435ac3aab5a7520 |
institution | Directory Open Access Journal |
issn | 2079-9292 |
language | English |
last_indexed | 2024-03-07T22:34:56Z |
publishDate | 2024-02-01 |
publisher | MDPI AG |
record_format | Article |
series | Electronics |
spelling | doaj.art-d905584415d54790a435ac3aab5a75202024-02-23T15:14:47ZengMDPI AGElectronics2079-92922024-02-0113473510.3390/electronics13040735Sum Rate Optimization for Multi-IRS-Aided Multi-BS Communication System Based on Multi-AgentMaha Fathy0Zesong Fei1Jing Guo2Mohamed Salah Abood3School of Information and Electronics Engineering, Beijing Institute of Technology, Beijing 100081, ChinaSchool of Information and Electronics Engineering, Beijing Institute of Technology, Beijing 100081, ChinaSchool of Information and Electronics Engineering, Beijing Institute of Technology, Beijing 100081, ChinaSchool of Information and Electronics Engineering, Beijing Institute of Technology, Beijing 100081, ChinaIntelligent reflecting surface (IRS) is a revolutionizing technology for improving the spectral and energy efficiency of future wireless networks. In this paper, we consider a downlink large-scale system empowered by multi-IRS to aid communication between the multiple base stations (BSs) and multiple user equipment (UEs). We target maximizing the sum rate by jointly optimizing the UE association, the transmit powers of BSs, and the configurations of the IRS beamforming. Due to the applicability restrictions of conventional optimization methods and their high complexity with large-scale networks in dynamic environments, deep reinforcement (DRL) learning is adopted as an alternative approach to finding optimal solutions. First, we model the optimization problem as a multi-agent Markov decision problem (MAMDP). Then, because large-scale wireless networks are naturally complex and changeable, and because many entities interact and affect how the whole system works, it is important to use a multi-agent approach to understand the complex dependencies and relationships between the different parts. In order to solve the problem, we propose a cooperative multi-agent deep reinforcement learning (MADRL)-based algorithm that works for both continuous and discrete IRS phase shifts. Simulation results validate that the proposed algorithm surpasses iterative optimization benchmarks regarding both sum rate performance and convergence.https://www.mdpi.com/2079-9292/13/4/735intelligent reflecting surfacepassive beamformingpower controluser associationmulti-agent |
spellingShingle | Maha Fathy Zesong Fei Jing Guo Mohamed Salah Abood Sum Rate Optimization for Multi-IRS-Aided Multi-BS Communication System Based on Multi-Agent Electronics intelligent reflecting surface passive beamforming power control user association multi-agent |
title | Sum Rate Optimization for Multi-IRS-Aided Multi-BS Communication System Based on Multi-Agent |
title_full | Sum Rate Optimization for Multi-IRS-Aided Multi-BS Communication System Based on Multi-Agent |
title_fullStr | Sum Rate Optimization for Multi-IRS-Aided Multi-BS Communication System Based on Multi-Agent |
title_full_unstemmed | Sum Rate Optimization for Multi-IRS-Aided Multi-BS Communication System Based on Multi-Agent |
title_short | Sum Rate Optimization for Multi-IRS-Aided Multi-BS Communication System Based on Multi-Agent |
title_sort | sum rate optimization for multi irs aided multi bs communication system based on multi agent |
topic | intelligent reflecting surface passive beamforming power control user association multi-agent |
url | https://www.mdpi.com/2079-9292/13/4/735 |
work_keys_str_mv | AT mahafathy sumrateoptimizationformultiirsaidedmultibscommunicationsystembasedonmultiagent AT zesongfei sumrateoptimizationformultiirsaidedmultibscommunicationsystembasedonmultiagent AT jingguo sumrateoptimizationformultiirsaidedmultibscommunicationsystembasedonmultiagent AT mohamedsalahabood sumrateoptimizationformultiirsaidedmultibscommunicationsystembasedonmultiagent |