Toward a Superintelligent Action Recommender for Network Operation Centers Using Reinforcement Learning
Today’s Network Operation Centres (NOC) consist of teams of network professionals responsible for monitoring and taking actions for their network’s health. Most of these NOC actions are relatively complex and executed manually; only the simplest tasks can be automated with rule...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2023-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/10051839/ |
| _version_ | 1827999952186376192 |
|---|---|
| author | Sa'di Altamimi Basel Altamimi David Cote Shervin Shirmohammadi |
| author_facet | Sa'di Altamimi Basel Altamimi David Cote Shervin Shirmohammadi |
| author_sort | Sa'di Altamimi |
| collection | DOAJ |
| description | Today’s Network Operation Centres (NOC) consist of teams of network professionals responsible for monitoring and taking actions for their network’s health. Most of these NOC actions are relatively complex and executed manually; only the simplest tasks can be automated with rules-based software. But today’s networks are getting larger and more complex. Therefore, deciding what action to take in the face of non-trivial problems has essentially become an art that depends on collective human intelligence of NOC technicians, specialized support teams organized by technology domains, and vendors’ technical support. But this model is getting increasingly expensive and inefficient; hence, the automation of all or at least some NOC tasks is now considered a desirable step towards autonomous and self-healing networks. In this article, we investigate whether an autonomous NOC can achieve superintelligence; i.e., recommend or take actions that lead to better results than those achieved by rules designed by human experts. Our investigation is inspired by the superintelligence achieved in computer games recently. Specifically, we build an Action Recommendation Engine using Reinforcement Learning, train it with expert rules, and let it explore actions by itself. We then show that it can learn new and more efficient strategies that outperform expert rules designed by humans. This can be used in the face of network problems to either quickly recommend actions to NOC technicians or autonomously take actions for fast recovery. |
| first_indexed | 2024-04-10T06:06:31Z |
| format | Article |
| id | doaj.art-b47380f18e9641e3aa6bc94e5d87e55c |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-04-10T06:06:31Z |
| publishDate | 2023-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-b47380f18e9641e3aa6bc94e5d87e55c2023-03-03T00:01:23ZengIEEEIEEE Access2169-35362023-01-0111202162022910.1109/ACCESS.2023.324865210051839Toward a Superintelligent Action Recommender for Network Operation Centers Using Reinforcement LearningSa'di Altamimi0https://orcid.org/0000-0003-1517-8170Basel Altamimi1David Cote2https://orcid.org/0000-0001-7468-0430Shervin Shirmohammadi3https://orcid.org/0000-0002-3973-4445School of Electrical Engineering and Computer Science, University of Ottawa, Ottawa, ON, CanadaSchool of Electrical Engineering and Computer Science, University of Ottawa, Ottawa, ON, CanadaBlue Planet Analytics, Ciena Corporation, Ottawa, ON, CanadaSchool of Electrical Engineering and Computer Science, University of Ottawa, Ottawa, ON, CanadaToday’s Network Operation Centres (NOC) consist of teams of network professionals responsible for monitoring and taking actions for their network’s health. Most of these NOC actions are relatively complex and executed manually; only the simplest tasks can be automated with rules-based software. But today’s networks are getting larger and more complex. Therefore, deciding what action to take in the face of non-trivial problems has essentially become an art that depends on collective human intelligence of NOC technicians, specialized support teams organized by technology domains, and vendors’ technical support. But this model is getting increasingly expensive and inefficient; hence, the automation of all or at least some NOC tasks is now considered a desirable step towards autonomous and self-healing networks. In this article, we investigate whether an autonomous NOC can achieve superintelligence; i.e., recommend or take actions that lead to better results than those achieved by rules designed by human experts. Our investigation is inspired by the superintelligence achieved in computer games recently. Specifically, we build an Action Recommendation Engine using Reinforcement Learning, train it with expert rules, and let it explore actions by itself. We then show that it can learn new and more efficient strategies that outperform expert rules designed by humans. This can be used in the face of network problems to either quickly recommend actions to NOC technicians or autonomously take actions for fast recovery.https://ieeexplore.ieee.org/document/10051839/Network automationnetwork operation centerreinforcement learningself-healing networks |
| spellingShingle | Sa'di Altamimi Basel Altamimi David Cote Shervin Shirmohammadi Toward a Superintelligent Action Recommender for Network Operation Centers Using Reinforcement Learning IEEE Access Network automation network operation center reinforcement learning self-healing networks |
| title | Toward a Superintelligent Action Recommender for Network Operation Centers Using Reinforcement Learning |
| title_full | Toward a Superintelligent Action Recommender for Network Operation Centers Using Reinforcement Learning |
| title_fullStr | Toward a Superintelligent Action Recommender for Network Operation Centers Using Reinforcement Learning |
| title_full_unstemmed | Toward a Superintelligent Action Recommender for Network Operation Centers Using Reinforcement Learning |
| title_short | Toward a Superintelligent Action Recommender for Network Operation Centers Using Reinforcement Learning |
| title_sort | toward a superintelligent action recommender for network operation centers using reinforcement learning |
| topic | Network automation network operation center reinforcement learning self-healing networks |
| url | https://ieeexplore.ieee.org/document/10051839/ |
| work_keys_str_mv | AT sadialtamimi towardasuperintelligentactionrecommenderfornetworkoperationcentersusingreinforcementlearning AT baselaltamimi towardasuperintelligentactionrecommenderfornetworkoperationcentersusingreinforcementlearning AT davidcote towardasuperintelligentactionrecommenderfornetworkoperationcentersusingreinforcementlearning AT shervinshirmohammadi towardasuperintelligentactionrecommenderfornetworkoperationcentersusingreinforcementlearning |