Joint Q-Learning Based Resource Allocation and Multi-Numerology B5G Network Slicing Exploiting LWA Technology
The emergence of the sixth generation (6G) era has highlighted the importance of Network Slicing (NS) technology as a promising solution for catering the diverse service requests of users. With the presence of a large number of devices with different service requests and since each service has diffe...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2024-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/10423760/ |
| _version_ | 1797305316424024064 |
|---|---|
| author | Noha A. Elmosilhy Mahmoud M. Elmesalawy Ibrahim I. Ibrahim Ahmed M. Abd El-Haleem |
| author_facet | Noha A. Elmosilhy Mahmoud M. Elmesalawy Ibrahim I. Ibrahim Ahmed M. Abd El-Haleem |
| author_sort | Noha A. Elmosilhy |
| collection | DOAJ |
| description | The emergence of the sixth generation (6G) era has highlighted the importance of Network Slicing (NS) technology as a promising solution for catering the diverse service requests of users. With the presence of a large number of devices with different service requests and since each service has different goals and requirements; efficiently allocating Resource Blocks (RBs) to each network slice is a challenging task to meet the desired Quality of Service (QoS) standards. However, it is worth noting that the majority of research efforts have primarily concentrated on cellular technologies, leaving behind the potential benefits of utilizing unlicensed bands to alleviate traffic congestion and enhance the capacity of existing LTE networks. In this paper we propose a novel idea by exploiting LTE-WLAN Aggregation technology (LWA) in Multi-Radio Access Technology (RAT) Heterogeneous Networks (HetNet), aiming to solve radio resource allocation problem based on the Radio Access Network (RAN) slicing and 5G New Radio (NR) scalable numerology technique. A joint optimization problem is proposed by jointly finding an efficient resource allocation ratio for each slice in each Base Station (BS) and by finding the optimum value of scalable numerology with the objective of maximizing users’ satisfaction. In order to solve this problem, a novel three-stage framework is proposed which is based on channel state information as a pre-association stage, Reinforcement Learning (RL) algorithm as finding the optimum value of slice resource ratio and scalable numerology, and finally Regret Learning Algorithm (RLA) as users’ re-association phase. Furthermore, a comprehensive performance evaluation is conducted against different baseline approaches. The simulation results show that our proposed model balances and achieves improvement in users’ satisfaction by deploying the proposed Multi-RAT Het-Net architecture that leverages LWA technology. |
| first_indexed | 2024-03-08T00:25:09Z |
| format | Article |
| id | doaj.art-b762976b026f4b37a9f52cc3d921ed9a |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-03-08T00:25:09Z |
| publishDate | 2024-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-b762976b026f4b37a9f52cc3d921ed9a2024-02-16T00:01:31ZengIEEEIEEE Access2169-35362024-01-0112220432205810.1109/ACCESS.2024.336316210423760Joint Q-Learning Based Resource Allocation and Multi-Numerology B5G Network Slicing Exploiting LWA TechnologyNoha A. Elmosilhy0https://orcid.org/0000-0001-7481-4283Mahmoud M. Elmesalawy1Ibrahim I. Ibrahim2Ahmed M. Abd El-Haleem3Electronics and Communications Department, Canadian International College, Cairo, EgyptElectronics and Communications Engineering Department, Helwan University, Cairo, EgyptElectronics and Communications Engineering Department, Helwan University, Cairo, EgyptElectronics and Communications Engineering Department, Helwan University, Cairo, EgyptThe emergence of the sixth generation (6G) era has highlighted the importance of Network Slicing (NS) technology as a promising solution for catering the diverse service requests of users. With the presence of a large number of devices with different service requests and since each service has different goals and requirements; efficiently allocating Resource Blocks (RBs) to each network slice is a challenging task to meet the desired Quality of Service (QoS) standards. However, it is worth noting that the majority of research efforts have primarily concentrated on cellular technologies, leaving behind the potential benefits of utilizing unlicensed bands to alleviate traffic congestion and enhance the capacity of existing LTE networks. In this paper we propose a novel idea by exploiting LTE-WLAN Aggregation technology (LWA) in Multi-Radio Access Technology (RAT) Heterogeneous Networks (HetNet), aiming to solve radio resource allocation problem based on the Radio Access Network (RAN) slicing and 5G New Radio (NR) scalable numerology technique. A joint optimization problem is proposed by jointly finding an efficient resource allocation ratio for each slice in each Base Station (BS) and by finding the optimum value of scalable numerology with the objective of maximizing users’ satisfaction. In order to solve this problem, a novel three-stage framework is proposed which is based on channel state information as a pre-association stage, Reinforcement Learning (RL) algorithm as finding the optimum value of slice resource ratio and scalable numerology, and finally Regret Learning Algorithm (RLA) as users’ re-association phase. Furthermore, a comprehensive performance evaluation is conducted against different baseline approaches. The simulation results show that our proposed model balances and achieves improvement in users’ satisfaction by deploying the proposed Multi-RAT Het-Net architecture that leverages LWA technology.https://ieeexplore.ieee.org/document/10423760/HetNetLWAmulti-RATnetwork slicingnumerologyregret matching |
| spellingShingle | Noha A. Elmosilhy Mahmoud M. Elmesalawy Ibrahim I. Ibrahim Ahmed M. Abd El-Haleem Joint Q-Learning Based Resource Allocation and Multi-Numerology B5G Network Slicing Exploiting LWA Technology IEEE Access HetNet LWA multi-RAT network slicing numerology regret matching |
| title | Joint Q-Learning Based Resource Allocation and Multi-Numerology B5G Network Slicing Exploiting LWA Technology |
| title_full | Joint Q-Learning Based Resource Allocation and Multi-Numerology B5G Network Slicing Exploiting LWA Technology |
| title_fullStr | Joint Q-Learning Based Resource Allocation and Multi-Numerology B5G Network Slicing Exploiting LWA Technology |
| title_full_unstemmed | Joint Q-Learning Based Resource Allocation and Multi-Numerology B5G Network Slicing Exploiting LWA Technology |
| title_short | Joint Q-Learning Based Resource Allocation and Multi-Numerology B5G Network Slicing Exploiting LWA Technology |
| title_sort | joint q learning based resource allocation and multi numerology b5g network slicing exploiting lwa technology |
| topic | HetNet LWA multi-RAT network slicing numerology regret matching |
| url | https://ieeexplore.ieee.org/document/10423760/ |
| work_keys_str_mv | AT nohaaelmosilhy jointqlearningbasedresourceallocationandmultinumerologyb5gnetworkslicingexploitinglwatechnology AT mahmoudmelmesalawy jointqlearningbasedresourceallocationandmultinumerologyb5gnetworkslicingexploitinglwatechnology AT ibrahimiibrahim jointqlearningbasedresourceallocationandmultinumerologyb5gnetworkslicingexploitinglwatechnology AT ahmedmabdelhaleem jointqlearningbasedresourceallocationandmultinumerologyb5gnetworkslicingexploitinglwatechnology |