Multi-objective virtual network embedding algorithm based on Q-learning and curiosity-driven
Abstract Network virtualization is a vital technology that helps overcome shortcomings such as network ossification of the current Internet architecture. However, virtual network embedding (VNE) involving the allocation of resources for heterogeneous virtual network requests (VNRs) on the substrate...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
SpringerOpen
2018-06-01
|
| Series: | EURASIP Journal on Wireless Communications and Networking |
| Subjects: | |
| Online Access: | http://link.springer.com/article/10.1186/s13638-018-1170-x |
| _version_ | 1819103423392382976 |
|---|---|
| author | Mengyang He Lei Zhuang Shuaikui Tian Guoqing Wang Kunli Zhang |
| author_facet | Mengyang He Lei Zhuang Shuaikui Tian Guoqing Wang Kunli Zhang |
| author_sort | Mengyang He |
| collection | DOAJ |
| description | Abstract Network virtualization is a vital technology that helps overcome shortcomings such as network ossification of the current Internet architecture. However, virtual network embedding (VNE) involving the allocation of resources for heterogeneous virtual network requests (VNRs) on the substrate network (SN) is considered as NP-hard problem. VNE process may involve conflicting objectives, including energy saving and VNR acceptance rate as the most critical. In this paper, we propose a virtual network multi-objective embedding algorithm based on Q-learning and curiosity-driven (Q-CD-VNE) for improving the performance of the system by optimizing conflicting objectives, namely energy saving and acceptance rate. The proposed algorithm employs Q-learning and curiosity-driven mechanism by considering other non-deterministic factors to avoid falling into a local optimum. The major contributions of this work involve (1) modeling of the multi-objective deterministic factors as binary (0, 1) integer programming problem, (2) formulating the virtual node mapping problem using the Markov decision process (MDP), (3) solving the VNE problem using Q-learning algorithm, (4) mining non-deterministic factors using curiosity-driven mechanism for avoiding prematurely falling into the Exploration-Exploitation dilemma and local optimal. Experimental results in comparison with representative researches in the field prove that the proposed algorithm can reduce energy consumption, improve the request acceptance rate, and improve the long-term average income. |
| first_indexed | 2024-12-22T01:50:13Z |
| format | Article |
| id | doaj.art-9fcf41cd38c343acb9df3d6bb1ce8956 |
| institution | Directory Open Access Journal |
| issn | 1687-1499 |
| language | English |
| last_indexed | 2024-12-22T01:50:13Z |
| publishDate | 2018-06-01 |
| publisher | SpringerOpen |
| record_format | Article |
| series | EURASIP Journal on Wireless Communications and Networking |
| spelling | doaj.art-9fcf41cd38c343acb9df3d6bb1ce89562022-12-21T18:42:57ZengSpringerOpenEURASIP Journal on Wireless Communications and Networking1687-14992018-06-012018111210.1186/s13638-018-1170-xMulti-objective virtual network embedding algorithm based on Q-learning and curiosity-drivenMengyang He0Lei Zhuang1Shuaikui Tian2Guoqing Wang3Kunli Zhang4School of Information and Engineering, Zhengzhou UniversitySchool of Information and Engineering, Zhengzhou UniversitySchool of Information and Engineering, Zhengzhou UniversitySchool of Information and Engineering, Zhengzhou UniversitySchool of Information and Engineering, Zhengzhou UniversityAbstract Network virtualization is a vital technology that helps overcome shortcomings such as network ossification of the current Internet architecture. However, virtual network embedding (VNE) involving the allocation of resources for heterogeneous virtual network requests (VNRs) on the substrate network (SN) is considered as NP-hard problem. VNE process may involve conflicting objectives, including energy saving and VNR acceptance rate as the most critical. In this paper, we propose a virtual network multi-objective embedding algorithm based on Q-learning and curiosity-driven (Q-CD-VNE) for improving the performance of the system by optimizing conflicting objectives, namely energy saving and acceptance rate. The proposed algorithm employs Q-learning and curiosity-driven mechanism by considering other non-deterministic factors to avoid falling into a local optimum. The major contributions of this work involve (1) modeling of the multi-objective deterministic factors as binary (0, 1) integer programming problem, (2) formulating the virtual node mapping problem using the Markov decision process (MDP), (3) solving the VNE problem using Q-learning algorithm, (4) mining non-deterministic factors using curiosity-driven mechanism for avoiding prematurely falling into the Exploration-Exploitation dilemma and local optimal. Experimental results in comparison with representative researches in the field prove that the proposed algorithm can reduce energy consumption, improve the request acceptance rate, and improve the long-term average income.http://link.springer.com/article/10.1186/s13638-018-1170-xNetwork virtualizationQ-learningCuriosity-drivenEnergy-aware |
| spellingShingle | Mengyang He Lei Zhuang Shuaikui Tian Guoqing Wang Kunli Zhang Multi-objective virtual network embedding algorithm based on Q-learning and curiosity-driven EURASIP Journal on Wireless Communications and Networking Network virtualization Q-learning Curiosity-driven Energy-aware |
| title | Multi-objective virtual network embedding algorithm based on Q-learning and curiosity-driven |
| title_full | Multi-objective virtual network embedding algorithm based on Q-learning and curiosity-driven |
| title_fullStr | Multi-objective virtual network embedding algorithm based on Q-learning and curiosity-driven |
| title_full_unstemmed | Multi-objective virtual network embedding algorithm based on Q-learning and curiosity-driven |
| title_short | Multi-objective virtual network embedding algorithm based on Q-learning and curiosity-driven |
| title_sort | multi objective virtual network embedding algorithm based on q learning and curiosity driven |
| topic | Network virtualization Q-learning Curiosity-driven Energy-aware |
| url | http://link.springer.com/article/10.1186/s13638-018-1170-x |
| work_keys_str_mv | AT mengyanghe multiobjectivevirtualnetworkembeddingalgorithmbasedonqlearningandcuriositydriven AT leizhuang multiobjectivevirtualnetworkembeddingalgorithmbasedonqlearningandcuriositydriven AT shuaikuitian multiobjectivevirtualnetworkembeddingalgorithmbasedonqlearningandcuriositydriven AT guoqingwang multiobjectivevirtualnetworkembeddingalgorithmbasedonqlearningandcuriositydriven AT kunlizhang multiobjectivevirtualnetworkembeddingalgorithmbasedonqlearningandcuriositydriven |