Distributed Big Data Driven Framework for Cellular Network Monitoring Data
The smart monitoring system (SMS) vision relies on the use of ICT to efficiently manage and maximize the utility of network infrastructures and services in order to improve the quality of service and network performance. Many aspects of SMS projects are dynamic data driven application system where d...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
FRUCT
2019-04-01
|
| Series: | Proceedings of the XXth Conference of Open Innovations Association FRUCT |
| Subjects: | |
| Online Access: | https://fruct.org/publications/fruct24/files/Sul.pdf
|
| _version_ | 1818335987613302784 |
|---|---|
| author | Alexander Suleykin Peter Panfilov |
| author_facet | Alexander Suleykin Peter Panfilov |
| author_sort | Alexander Suleykin |
| collection | DOAJ |
| description | The smart monitoring system (SMS) vision relies on the use of ICT to efficiently manage and maximize the utility of network infrastructures and services in order to improve the quality of service and network performance. Many aspects of SMS projects are dynamic data driven application system where data from sensors monitoring the system state are used to drive computations that in turn can dynamically adapt and improve the monitoring process as the complex system evolves. In this context, a research and development of new paradigm of Distributed Big Data Driven Framework (DBDF) for monitoring data in mobile network infrastructures entails the ability to dynamically incorporate more accurate information for network monitoring and controlling purposes through obtaining real-time measurements from the base stations, user demands and claims, and other sensors (for weather conditions, etc.). The proposed framework consists of network probes, data parsing application, Message-Oriented Middleware, real-time and offline data models, Big Data storage and Decision layers, and Other data sources. Each Big Data layer might be implemented using comparative analysis of the most effective Big Data solutions. In addition, as a proof of concept, the roaming users detection model was created based on Apache Spark application. The model filters streaming protocols data, deserializes it into Json format and finally sends it to Kafka application. The experiments with the model demonstrated and acknowledged the capacities of the Apache Spark in building foundation for Big Data hub as a basic application for online mobile network data processing. |
| first_indexed | 2024-12-13T14:32:09Z |
| format | Article |
| id | doaj.art-d7eb871b71e34d6bb9451bdf6a2024cd |
| institution | Directory Open Access Journal |
| issn | 2305-7254 2343-0737 |
| language | English |
| last_indexed | 2024-12-13T14:32:09Z |
| publishDate | 2019-04-01 |
| publisher | FRUCT |
| record_format | Article |
| series | Proceedings of the XXth Conference of Open Innovations Association FRUCT |
| spelling | doaj.art-d7eb871b71e34d6bb9451bdf6a2024cd2022-12-21T23:41:48ZengFRUCTProceedings of the XXth Conference of Open Innovations Association FRUCT2305-72542343-07372019-04-0185424430436Distributed Big Data Driven Framework for Cellular Network Monitoring DataAlexander Suleykin0Peter Panfilov1V.A. Trapeznikov Institute of Control Sciences, Russian Academy of Sciences, Moscow, RussiaSchool of Business Informatics National Research University - Higher School of Economics, Moscow, RussiaThe smart monitoring system (SMS) vision relies on the use of ICT to efficiently manage and maximize the utility of network infrastructures and services in order to improve the quality of service and network performance. Many aspects of SMS projects are dynamic data driven application system where data from sensors monitoring the system state are used to drive computations that in turn can dynamically adapt and improve the monitoring process as the complex system evolves. In this context, a research and development of new paradigm of Distributed Big Data Driven Framework (DBDF) for monitoring data in mobile network infrastructures entails the ability to dynamically incorporate more accurate information for network monitoring and controlling purposes through obtaining real-time measurements from the base stations, user demands and claims, and other sensors (for weather conditions, etc.). The proposed framework consists of network probes, data parsing application, Message-Oriented Middleware, real-time and offline data models, Big Data storage and Decision layers, and Other data sources. Each Big Data layer might be implemented using comparative analysis of the most effective Big Data solutions. In addition, as a proof of concept, the roaming users detection model was created based on Apache Spark application. The model filters streaming protocols data, deserializes it into Json format and finally sends it to Kafka application. The experiments with the model demonstrated and acknowledged the capacities of the Apache Spark in building foundation for Big Data hub as a basic application for online mobile network data processing.https://fruct.org/publications/fruct24/files/Sul.pdf Distributed Data-Driven Application Systems Streaming dataBig Data solutionsCellular networksDDSMRoaming users detection model |
| spellingShingle | Alexander Suleykin Peter Panfilov Distributed Big Data Driven Framework for Cellular Network Monitoring Data Proceedings of the XXth Conference of Open Innovations Association FRUCT Distributed Data-Driven Application Systems Streaming data Big Data solutions Cellular networks DDSM Roaming users detection model |
| title | Distributed Big Data Driven Framework for Cellular Network Monitoring Data |
| title_full | Distributed Big Data Driven Framework for Cellular Network Monitoring Data |
| title_fullStr | Distributed Big Data Driven Framework for Cellular Network Monitoring Data |
| title_full_unstemmed | Distributed Big Data Driven Framework for Cellular Network Monitoring Data |
| title_short | Distributed Big Data Driven Framework for Cellular Network Monitoring Data |
| title_sort | distributed big data driven framework for cellular network monitoring data |
| topic | Distributed Data-Driven Application Systems Streaming data Big Data solutions Cellular networks DDSM Roaming users detection model |
| url | https://fruct.org/publications/fruct24/files/Sul.pdf
|
| work_keys_str_mv | AT alexandersuleykin distributedbigdatadrivenframeworkforcellularnetworkmonitoringdata AT peterpanfilov distributedbigdatadrivenframeworkforcellularnetworkmonitoringdata |