Intelligent task migration with deep Qlearning in multi‐access edge computing

Abstract Multi‐access edge computing provides computation and network resources in proximity to user applications in mobile environments. Deploying edge servers in network boundary can not only offload the heavy task loading on the cloud, but also alleviate resource‐limited capabilities of mobile de...

Full description

Bibliographic Details
Main Authors: Sheng‐Zhi Huang, Kun‐Yu Lin, Chin‐Lin Hu
Format: Article
Language:English
Published: Wiley 2022-07-01
Series:IET Communications
Online Access:https://doi.org/10.1049/cmu2.12309
_version_ 1811269798865141760
author Sheng‐Zhi Huang
Kun‐Yu Lin
Chin‐Lin Hu
author_facet Sheng‐Zhi Huang
Kun‐Yu Lin
Chin‐Lin Hu
author_sort Sheng‐Zhi Huang
collection DOAJ
description Abstract Multi‐access edge computing provides computation and network resources in proximity to user applications in mobile environments. Deploying edge servers in network boundary can not only offload the heavy task loading on the cloud, but also alleviate resource‐limited capabilities of mobile devices. Rather than many stand‐alone edge servers, the concept of multi‐server edge computing is recently advocated to contend with the issues of system scalability and service quality against dynamic task workload. This study exploits collaborative computing resources and designs a task migration strategy for multiple edge servers in mobile networks. This study formulates a queueing optimization problem of minimizing the overall service time in a multi‐server system. An intelligent task migration scheme is then developed using the deep reinforcement learning and Q‐learning techniques. With a variety of numerical attributes derived from the queueing model, this intelligent scheme can arrange the task distribution among edge servers to enhance the task processing capability. Simulation‐based results show that the proposed task migration scheme can sustain service efficiency and resource utilization, which is promising as compared with conventional designs without collaborative intelligence in mobile environments.
first_indexed 2024-04-12T21:48:31Z
format Article
id doaj.art-3f0297b459a04c9aa9700d6e1736f8a4
institution Directory Open Access Journal
issn 1751-8628
1751-8636
language English
last_indexed 2024-04-12T21:48:31Z
publishDate 2022-07-01
publisher Wiley
record_format Article
series IET Communications
spelling doaj.art-3f0297b459a04c9aa9700d6e1736f8a42022-12-22T03:15:33ZengWileyIET Communications1751-86281751-86362022-07-0116111290130210.1049/cmu2.12309Intelligent task migration with deep Qlearning in multi‐access edge computingSheng‐Zhi Huang0Kun‐Yu Lin1Chin‐Lin Hu2Department of Communication Engineering National Central University Taoyuan City Taiwan (ROC)Department of Communication Engineering National Central University Taoyuan City Taiwan (ROC)Department of Communication Engineering National Central University Taoyuan City Taiwan (ROC)Abstract Multi‐access edge computing provides computation and network resources in proximity to user applications in mobile environments. Deploying edge servers in network boundary can not only offload the heavy task loading on the cloud, but also alleviate resource‐limited capabilities of mobile devices. Rather than many stand‐alone edge servers, the concept of multi‐server edge computing is recently advocated to contend with the issues of system scalability and service quality against dynamic task workload. This study exploits collaborative computing resources and designs a task migration strategy for multiple edge servers in mobile networks. This study formulates a queueing optimization problem of minimizing the overall service time in a multi‐server system. An intelligent task migration scheme is then developed using the deep reinforcement learning and Q‐learning techniques. With a variety of numerical attributes derived from the queueing model, this intelligent scheme can arrange the task distribution among edge servers to enhance the task processing capability. Simulation‐based results show that the proposed task migration scheme can sustain service efficiency and resource utilization, which is promising as compared with conventional designs without collaborative intelligence in mobile environments.https://doi.org/10.1049/cmu2.12309
spellingShingle Sheng‐Zhi Huang
Kun‐Yu Lin
Chin‐Lin Hu
Intelligent task migration with deep Qlearning in multi‐access edge computing
IET Communications
title Intelligent task migration with deep Qlearning in multi‐access edge computing
title_full Intelligent task migration with deep Qlearning in multi‐access edge computing
title_fullStr Intelligent task migration with deep Qlearning in multi‐access edge computing
title_full_unstemmed Intelligent task migration with deep Qlearning in multi‐access edge computing
title_short Intelligent task migration with deep Qlearning in multi‐access edge computing
title_sort intelligent task migration with deep qlearning in multi access edge computing
url https://doi.org/10.1049/cmu2.12309
work_keys_str_mv AT shengzhihuang intelligenttaskmigrationwithdeepqlearninginmultiaccessedgecomputing
AT kunyulin intelligenttaskmigrationwithdeepqlearninginmultiaccessedgecomputing
AT chinlinhu intelligenttaskmigrationwithdeepqlearninginmultiaccessedgecomputing