A Hybrid Proactive Caching System in Vehicular Networks Based on Contextual Multi-Armed Bandit Learning
Proactive edge caching has been regarded as an effective approach to satisfy user experience in mobile networks by providing seamless content transmission and reducing network delay. This is particularly useful in rapidly changing vehicular networks. This paper addresses the proactive edge caching (...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Jezik: | English |
| Izdano: |
IEEE
2023-01-01
|
| Serija: | IEEE Access |
| Teme: | |
| Online dostop: | https://ieeexplore.ieee.org/document/10077392/ |
| _version_ | 1826938488661999616 |
|---|---|
| author | Qiao Wang David Grace |
| author_facet | Qiao Wang David Grace |
| author_sort | Qiao Wang |
| collection | DOAJ |
| description | Proactive edge caching has been regarded as an effective approach to satisfy user experience in mobile networks by providing seamless content transmission and reducing network delay. This is particularly useful in rapidly changing vehicular networks. This paper addresses the proactive edge caching (at the roadside unit (RSU)) problem in vehicular networks by mobility prediction, i.e., the next RSU prediction. Specifically, the paper proposes a distributed Hybrid cMAB Proactive Caching System where RSUs act as independent learners that implement two parallel online reinforcement learning-based mobility prediction algorithms between which they can adaptively finalize their predictions for the next RSU. The two parallel prediction algorithms are based on Contextual Multi-armed bandit (cMAB) learning, called Dual-context cMAB and Single-context cMAB. The hybrid system is further developed into two variants: Vehicle-Centric and RSU-Centric. In addition, the paper also conducts comprehensive simulation experiments to evaluate the prediction performance of the proposed hybrid system. They include three traffic scenarios: Commuting traffic, Random traffic and Mixed traffic in Las Vegas, USA and Manchester, UK. With the different road layouts in the two urban areas, the paper aims to generalize the application of the system. Simulation results show that the hybrid Vehicle-Centric system can reach nearly 95% cumulative prediction accuracy in the Commuting traffic scenario and outperform the other methods used for comparison by reaching nearly 80% accuracy in Mixed traffic scenario. Even in the completely Random traffic scenario, it also guarantees a minimum accuracy of nearly 60%. |
| first_indexed | 2024-04-09T21:24:22Z |
| format | Article |
| id | doaj.art-eed91a84b34847ca8c07b51a44eefa0d |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2025-02-17T18:58:44Z |
| publishDate | 2023-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-eed91a84b34847ca8c07b51a44eefa0d2024-12-11T00:03:28ZengIEEEIEEE Access2169-35362023-01-0111290742909010.1109/ACCESS.2023.325954710077392A Hybrid Proactive Caching System in Vehicular Networks Based on Contextual Multi-Armed Bandit LearningQiao Wang0https://orcid.org/0000-0003-1952-4253David Grace1https://orcid.org/0000-0003-4493-7498Communication Technologies Research Group, Institute for Safe Autonomy, University of York, York, U.KCommunication Technologies Research Group, Institute for Safe Autonomy, University of York, York, U.KProactive edge caching has been regarded as an effective approach to satisfy user experience in mobile networks by providing seamless content transmission and reducing network delay. This is particularly useful in rapidly changing vehicular networks. This paper addresses the proactive edge caching (at the roadside unit (RSU)) problem in vehicular networks by mobility prediction, i.e., the next RSU prediction. Specifically, the paper proposes a distributed Hybrid cMAB Proactive Caching System where RSUs act as independent learners that implement two parallel online reinforcement learning-based mobility prediction algorithms between which they can adaptively finalize their predictions for the next RSU. The two parallel prediction algorithms are based on Contextual Multi-armed bandit (cMAB) learning, called Dual-context cMAB and Single-context cMAB. The hybrid system is further developed into two variants: Vehicle-Centric and RSU-Centric. In addition, the paper also conducts comprehensive simulation experiments to evaluate the prediction performance of the proposed hybrid system. They include three traffic scenarios: Commuting traffic, Random traffic and Mixed traffic in Las Vegas, USA and Manchester, UK. With the different road layouts in the two urban areas, the paper aims to generalize the application of the system. Simulation results show that the hybrid Vehicle-Centric system can reach nearly 95% cumulative prediction accuracy in the Commuting traffic scenario and outperform the other methods used for comparison by reaching nearly 80% accuracy in Mixed traffic scenario. Even in the completely Random traffic scenario, it also guarantees a minimum accuracy of nearly 60%.https://ieeexplore.ieee.org/document/10077392/Proactive edge cachingreinforcement learningmulti-armed bandit learningmobility predictionvehicular networksroadside units (RSUs) |
| spellingShingle | Qiao Wang David Grace A Hybrid Proactive Caching System in Vehicular Networks Based on Contextual Multi-Armed Bandit Learning IEEE Access Proactive edge caching reinforcement learning multi-armed bandit learning mobility prediction vehicular networks roadside units (RSUs) |
| title | A Hybrid Proactive Caching System in Vehicular Networks Based on Contextual Multi-Armed Bandit Learning |
| title_full | A Hybrid Proactive Caching System in Vehicular Networks Based on Contextual Multi-Armed Bandit Learning |
| title_fullStr | A Hybrid Proactive Caching System in Vehicular Networks Based on Contextual Multi-Armed Bandit Learning |
| title_full_unstemmed | A Hybrid Proactive Caching System in Vehicular Networks Based on Contextual Multi-Armed Bandit Learning |
| title_short | A Hybrid Proactive Caching System in Vehicular Networks Based on Contextual Multi-Armed Bandit Learning |
| title_sort | hybrid proactive caching system in vehicular networks based on contextual multi armed bandit learning |
| topic | Proactive edge caching reinforcement learning multi-armed bandit learning mobility prediction vehicular networks roadside units (RSUs) |
| url | https://ieeexplore.ieee.org/document/10077392/ |
| work_keys_str_mv | AT qiaowang ahybridproactivecachingsysteminvehicularnetworksbasedoncontextualmultiarmedbanditlearning AT davidgrace ahybridproactivecachingsysteminvehicularnetworksbasedoncontextualmultiarmedbanditlearning AT qiaowang hybridproactivecachingsysteminvehicularnetworksbasedoncontextualmultiarmedbanditlearning AT davidgrace hybridproactivecachingsysteminvehicularnetworksbasedoncontextualmultiarmedbanditlearning |