Resource Allocation Based on Radio Intelligence Controller for Open RAN Toward 6G
In recent years, the open and standardized interfaces for radio access networks (Open RAN), promoted by the standard organization O-RAN alliance, demonstrate the potential to apply artificial intelligence in 6G networks. Among O-RAN, the newly introduced radio intelligence controller (RIC), includin...
| Main Authors: | , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2023-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/10239168/ |
| _version_ | 1797685383711948800 |
|---|---|
| author | Qingtian Wang Yang Liu Yanchao Wang Xiong Xiong Jiaying Zong Jianxiu Wang Peng Chen |
| author_facet | Qingtian Wang Yang Liu Yanchao Wang Xiong Xiong Jiaying Zong Jianxiu Wang Peng Chen |
| author_sort | Qingtian Wang |
| collection | DOAJ |
| description | In recent years, the open and standardized interfaces for radio access networks (Open RAN), promoted by the standard organization O-RAN alliance, demonstrate the potential to apply artificial intelligence in 6G networks. Among O-RAN, the newly introduced radio intelligence controller (RIC), including near-real-time RIC and non-real-time RIC, provides intelligent control of the radio network. However, existing research on RIC only focuses on the implementation of interfaces and progress, while ignoring the resource allocation between near-RT RIC and non-RT RIC which is essential for ultra-low latency in 6G networks. In this paper, we propose a reinforcement learning-based resource allocation scheme that minimizes service latency by optimizing requests allocated and processed between near-RT RIC and non-RT RIC. Specifically, we aim at improving the request acceptance and minimum the average service latency, in our policy, we apply the Double DQN to decide whether the requests are processed at near-RT RIC or non-RT RIC and then allocate the near-RT RIC resource to finish the requests. Firstly, we define and formulate the resource allocation problem in RIC by the Markov decision process framework. Then we propose an allocation scheme based on the Double Deep Q network technique (Double DQN), with two variations (Double DQN with cache and Double DQN without cache) for handling different request types. Extensive simulations demonstrate the effectiveness of the proposed method in offering the maximum reward. Additionally, we conduct experiments to analyze the updating of cached AI models and the results show that the performance of the proposed method is always optimal compared to other algorithms in terms of latency and accepted number of requests. |
| first_indexed | 2024-03-12T00:43:22Z |
| format | Article |
| id | doaj.art-a569b5be3c034916b09d2f3fee6fd4a9 |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-03-12T00:43:22Z |
| publishDate | 2023-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-a569b5be3c034916b09d2f3fee6fd4a92023-09-14T23:01:36ZengIEEEIEEE Access2169-35362023-01-0111979099791910.1109/ACCESS.2023.331188810239168Resource Allocation Based on Radio Intelligence Controller for Open RAN Toward 6GQingtian Wang0https://orcid.org/0000-0003-0153-9166Yang Liu1Yanchao Wang2Xiong Xiong3Jiaying Zong4Jianxiu Wang5Peng Chen6China Telecom Research Institute, Beijing, ChinaChina Telecom Research Institute, Beijing, ChinaSchool of Computer Science and Engineering, Nanyang Technological University, Jurong West, SingaporeChina Telecom Research Institute, Beijing, ChinaChina Telecom Research Institute, Beijing, ChinaChina Telecom Research Institute, Beijing, ChinaChina Telecom Research Institute, Beijing, ChinaIn recent years, the open and standardized interfaces for radio access networks (Open RAN), promoted by the standard organization O-RAN alliance, demonstrate the potential to apply artificial intelligence in 6G networks. Among O-RAN, the newly introduced radio intelligence controller (RIC), including near-real-time RIC and non-real-time RIC, provides intelligent control of the radio network. However, existing research on RIC only focuses on the implementation of interfaces and progress, while ignoring the resource allocation between near-RT RIC and non-RT RIC which is essential for ultra-low latency in 6G networks. In this paper, we propose a reinforcement learning-based resource allocation scheme that minimizes service latency by optimizing requests allocated and processed between near-RT RIC and non-RT RIC. Specifically, we aim at improving the request acceptance and minimum the average service latency, in our policy, we apply the Double DQN to decide whether the requests are processed at near-RT RIC or non-RT RIC and then allocate the near-RT RIC resource to finish the requests. Firstly, we define and formulate the resource allocation problem in RIC by the Markov decision process framework. Then we propose an allocation scheme based on the Double Deep Q network technique (Double DQN), with two variations (Double DQN with cache and Double DQN without cache) for handling different request types. Extensive simulations demonstrate the effectiveness of the proposed method in offering the maximum reward. Additionally, we conduct experiments to analyze the updating of cached AI models and the results show that the performance of the proposed method is always optimal compared to other algorithms in terms of latency and accepted number of requests.https://ieeexplore.ieee.org/document/10239168/Radio intelligence controllerAI nativeO-RANdouble DQN6G |
| spellingShingle | Qingtian Wang Yang Liu Yanchao Wang Xiong Xiong Jiaying Zong Jianxiu Wang Peng Chen Resource Allocation Based on Radio Intelligence Controller for Open RAN Toward 6G IEEE Access Radio intelligence controller AI native O-RAN double DQN 6G |
| title | Resource Allocation Based on Radio Intelligence Controller for Open RAN Toward 6G |
| title_full | Resource Allocation Based on Radio Intelligence Controller for Open RAN Toward 6G |
| title_fullStr | Resource Allocation Based on Radio Intelligence Controller for Open RAN Toward 6G |
| title_full_unstemmed | Resource Allocation Based on Radio Intelligence Controller for Open RAN Toward 6G |
| title_short | Resource Allocation Based on Radio Intelligence Controller for Open RAN Toward 6G |
| title_sort | resource allocation based on radio intelligence controller for open ran toward 6g |
| topic | Radio intelligence controller AI native O-RAN double DQN 6G |
| url | https://ieeexplore.ieee.org/document/10239168/ |
| work_keys_str_mv | AT qingtianwang resourceallocationbasedonradiointelligencecontrollerforopenrantoward6g AT yangliu resourceallocationbasedonradiointelligencecontrollerforopenrantoward6g AT yanchaowang resourceallocationbasedonradiointelligencecontrollerforopenrantoward6g AT xiongxiong resourceallocationbasedonradiointelligencecontrollerforopenrantoward6g AT jiayingzong resourceallocationbasedonradiointelligencecontrollerforopenrantoward6g AT jianxiuwang resourceallocationbasedonradiointelligencecontrollerforopenrantoward6g AT pengchen resourceallocationbasedonradiointelligencecontrollerforopenrantoward6g |