Reliability Assurance Dynamic SSC Placement Using Reinforcement Learning
Software-defined networking (SDN) and network function virtualization (NFV) make a network programmable, resulting in a more flexible and agile network. An important and promising application for these two technologies is network security, where they can dynamically chain virtual security functions...
| Main Authors: | , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2022-01-01
|
| Series: | Information |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2078-2489/13/2/53 |
| _version_ | 1827654459671445504 |
|---|---|
| author | Wei Li Yuan Jiang Xiaoliang Zhang Fangfang Dang Feng Gao Haomin Wang Qi Fan |
| author_facet | Wei Li Yuan Jiang Xiaoliang Zhang Fangfang Dang Feng Gao Haomin Wang Qi Fan |
| author_sort | Wei Li |
| collection | DOAJ |
| description | Software-defined networking (SDN) and network function virtualization (NFV) make a network programmable, resulting in a more flexible and agile network. An important and promising application for these two technologies is network security, where they can dynamically chain virtual security functions (VSFs), such as firewalls, intrusion detection systems, and intrusion prevention systems, and thus inspect, monitor, or filter traffic flows in cloud data center networks. In view of the strict delay constraints of security services and the high failure probability of VSFs, we propose the use of a security service chain (SSC) orchestration algorithm that is latency aware with reliability assurance (LARA). This algorithm includes an SSC orchestration module and VSF backup module. We first use a reinforcement learning (RL) based Q-learning algorithm to achieve efficient SSC orchestration and try to reduce the end-to-end delay of services. Then, we measure the importance of the physical nodes carrying the VSF instance and backup VSF according to the node importance of VSF. Extensive simulation results indicate that the LARA algorithm is more effective in reducing delay and ensuring reliability compared with other algorithms. |
| first_indexed | 2024-03-09T21:43:25Z |
| format | Article |
| id | doaj.art-c206aabb7cac418a86b81290630ecf45 |
| institution | Directory Open Access Journal |
| issn | 2078-2489 |
| language | English |
| last_indexed | 2024-03-09T21:43:25Z |
| publishDate | 2022-01-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Information |
| spelling | doaj.art-c206aabb7cac418a86b81290630ecf452023-11-23T20:25:03ZengMDPI AGInformation2078-24892022-01-011325310.3390/info13020053Reliability Assurance Dynamic SSC Placement Using Reinforcement LearningWei Li0Yuan Jiang1Xiaoliang Zhang2Fangfang Dang3Feng Gao4Haomin Wang5Qi Fan6School of Control and Computer Engineering, North China Electric Power University, Beijing 102206, ChinaSchool of Control and Computer Engineering, North China Electric Power University, Beijing 102206, ChinaSchool of Control and Computer Engineering, North China Electric Power University, Beijing 102206, ChinaThe State Grid Henan Information & Communication Company, Zhengzhou 450052, ChinaThe State Grid Henan Information & Communication Company, Zhengzhou 450052, ChinaSchool of Control and Computer Engineering, North China Electric Power University, Beijing 102206, ChinaSchool of Control and Computer Engineering, North China Electric Power University, Beijing 102206, ChinaSoftware-defined networking (SDN) and network function virtualization (NFV) make a network programmable, resulting in a more flexible and agile network. An important and promising application for these two technologies is network security, where they can dynamically chain virtual security functions (VSFs), such as firewalls, intrusion detection systems, and intrusion prevention systems, and thus inspect, monitor, or filter traffic flows in cloud data center networks. In view of the strict delay constraints of security services and the high failure probability of VSFs, we propose the use of a security service chain (SSC) orchestration algorithm that is latency aware with reliability assurance (LARA). This algorithm includes an SSC orchestration module and VSF backup module. We first use a reinforcement learning (RL) based Q-learning algorithm to achieve efficient SSC orchestration and try to reduce the end-to-end delay of services. Then, we measure the importance of the physical nodes carrying the VSF instance and backup VSF according to the node importance of VSF. Extensive simulation results indicate that the LARA algorithm is more effective in reducing delay and ensuring reliability compared with other algorithms.https://www.mdpi.com/2078-2489/13/2/53security service chainreinforcement learninglow delayreliability assurancebackup |
| spellingShingle | Wei Li Yuan Jiang Xiaoliang Zhang Fangfang Dang Feng Gao Haomin Wang Qi Fan Reliability Assurance Dynamic SSC Placement Using Reinforcement Learning Information security service chain reinforcement learning low delay reliability assurance backup |
| title | Reliability Assurance Dynamic SSC Placement Using Reinforcement Learning |
| title_full | Reliability Assurance Dynamic SSC Placement Using Reinforcement Learning |
| title_fullStr | Reliability Assurance Dynamic SSC Placement Using Reinforcement Learning |
| title_full_unstemmed | Reliability Assurance Dynamic SSC Placement Using Reinforcement Learning |
| title_short | Reliability Assurance Dynamic SSC Placement Using Reinforcement Learning |
| title_sort | reliability assurance dynamic ssc placement using reinforcement learning |
| topic | security service chain reinforcement learning low delay reliability assurance backup |
| url | https://www.mdpi.com/2078-2489/13/2/53 |
| work_keys_str_mv | AT weili reliabilityassurancedynamicsscplacementusingreinforcementlearning AT yuanjiang reliabilityassurancedynamicsscplacementusingreinforcementlearning AT xiaoliangzhang reliabilityassurancedynamicsscplacementusingreinforcementlearning AT fangfangdang reliabilityassurancedynamicsscplacementusingreinforcementlearning AT fenggao reliabilityassurancedynamicsscplacementusingreinforcementlearning AT haominwang reliabilityassurancedynamicsscplacementusingreinforcementlearning AT qifan reliabilityassurancedynamicsscplacementusingreinforcementlearning |