Impact of network settings on reinforcement learning based caching policy in cooperative edge networks

Reinforcement learning (RL) has been used in combination with cooperative caching to deal with growing traffic in mobile networks, but the performance of RL based caching policies depends heavily on network settings. This paper investigates the impact of access delays within network infrastructures...

Full description

Bibliographic Details
Main Authors: Xiaobao Cheng, Minghan Gao, Qiang Gao, Xiao-Hong Peng
Format: Article
Language:English
Published: Elsevier 2023-12-01
Series:ICT Express
Subjects:
Online Access:http://www.sciencedirect.com/science/article/pii/S240595952300005X
Description
Summary:Reinforcement learning (RL) has been used in combination with cooperative caching to deal with growing traffic in mobile networks, but the performance of RL based caching policies depends heavily on network settings. This paper investigates the impact of access delays within network infrastructures and popularity and similarity properties of the contents requested on network performance. A deep Q-network based caching framework is established in both basic and extended cooperative edge networks. Our simulation results reveal explicit relationships between the performance and influential parameters, which can provide a guidance and benchmark for the design of effective caching polices with RL and cooperation technologies.
ISSN:2405-9595