Machine learning based data collection protocol for intelligent transport systems: a real-time implementation on Dublin M50, Ireland

Abstract The continuous global urbanization with rapid and dynamic transitioning in traffic situations among highly populated cities results in difficulty for data collection and communication. Data collection for millions of vehicles hinders by various problems, i.e., higher cost of energy, time, s...

Full description

Bibliographic Details
Main Authors: Maryam Gillani, Hafiz Adnan Niaz
Format: Article
Language:English
Published: Springer 2023-10-01
Series:Complex & Intelligent Systems
Subjects:
Online Access:https://doi.org/10.1007/s40747-023-01241-x
_version_ 1797233214444535808
author Maryam Gillani
Hafiz Adnan Niaz
author_facet Maryam Gillani
Hafiz Adnan Niaz
author_sort Maryam Gillani
collection DOAJ
description Abstract The continuous global urbanization with rapid and dynamic transitioning in traffic situations among highly populated cities results in difficulty for data collection and communication. Data collection for millions of vehicles hinders by various problems, i.e., higher cost of energy, time, space, and storage resources. Moreover, higher data traffic results in higher delays, larger throughput, excessive bottlenecks, and frequent repetition of data. To better facilitate the aforementioned challenges and to provide a solution, we have proposed a lightweight Machine Learning based data collection protocol named ML-TDG to effectively deal with higher data volumes in a real-time traffic environment capable of bringing the least burden on the network while utilizing less space, time, and energy. ML-TDG is functional based on Apache Spark, an effective data processing engine that indexes the data based on two logs, i.e., old commuters or frequent/daily commuters and second new/occasional commuters. The proposed protocol’s main idea is to utilize real-time traffic, distinguish the indexes in parallel based on two assigned logs criteria to train the network, and collect data with the least sources. For energy and time optimization, dynamic segmentation switching is introduced which is an intelligent road segments division and switching for reducing bottlenecks and replication. ML-TDG is tested and verified on Dublin, Ireland’s busiest motorway M50. ML-TDG performs the data collection, data sorting, and network training to decide the next execution altogether for better optimization every time. The experimental results verify that our proposed protocol is attaining higher performance with lower resource requirements along with rich and time-efficient sustainable data collection clusters in comparison with baseline protocols.
first_indexed 2024-04-24T16:12:37Z
format Article
id doaj.art-d402b75cb0d24739864f3c375086dd4f
institution Directory Open Access Journal
issn 2199-4536
2198-6053
language English
last_indexed 2024-04-24T16:12:37Z
publishDate 2023-10-01
publisher Springer
record_format Article
series Complex & Intelligent Systems
spelling doaj.art-d402b75cb0d24739864f3c375086dd4f2024-03-31T11:39:08ZengSpringerComplex & Intelligent Systems2199-45362198-60532023-10-011021879189710.1007/s40747-023-01241-xMachine learning based data collection protocol for intelligent transport systems: a real-time implementation on Dublin M50, IrelandMaryam Gillani0Hafiz Adnan Niaz1School of Computer Science, University College Dublin (UCD)School of Computer Science, University College Dublin (UCD)Abstract The continuous global urbanization with rapid and dynamic transitioning in traffic situations among highly populated cities results in difficulty for data collection and communication. Data collection for millions of vehicles hinders by various problems, i.e., higher cost of energy, time, space, and storage resources. Moreover, higher data traffic results in higher delays, larger throughput, excessive bottlenecks, and frequent repetition of data. To better facilitate the aforementioned challenges and to provide a solution, we have proposed a lightweight Machine Learning based data collection protocol named ML-TDG to effectively deal with higher data volumes in a real-time traffic environment capable of bringing the least burden on the network while utilizing less space, time, and energy. ML-TDG is functional based on Apache Spark, an effective data processing engine that indexes the data based on two logs, i.e., old commuters or frequent/daily commuters and second new/occasional commuters. The proposed protocol’s main idea is to utilize real-time traffic, distinguish the indexes in parallel based on two assigned logs criteria to train the network, and collect data with the least sources. For energy and time optimization, dynamic segmentation switching is introduced which is an intelligent road segments division and switching for reducing bottlenecks and replication. ML-TDG is tested and verified on Dublin, Ireland’s busiest motorway M50. ML-TDG performs the data collection, data sorting, and network training to decide the next execution altogether for better optimization every time. The experimental results verify that our proposed protocol is attaining higher performance with lower resource requirements along with rich and time-efficient sustainable data collection clusters in comparison with baseline protocols.https://doi.org/10.1007/s40747-023-01241-xMachine learningData collection protocolData information systemsIntelligent transport systemsSmart citiesReal-time protocol
spellingShingle Maryam Gillani
Hafiz Adnan Niaz
Machine learning based data collection protocol for intelligent transport systems: a real-time implementation on Dublin M50, Ireland
Complex & Intelligent Systems
Machine learning
Data collection protocol
Data information systems
Intelligent transport systems
Smart cities
Real-time protocol
title Machine learning based data collection protocol for intelligent transport systems: a real-time implementation on Dublin M50, Ireland
title_full Machine learning based data collection protocol for intelligent transport systems: a real-time implementation on Dublin M50, Ireland
title_fullStr Machine learning based data collection protocol for intelligent transport systems: a real-time implementation on Dublin M50, Ireland
title_full_unstemmed Machine learning based data collection protocol for intelligent transport systems: a real-time implementation on Dublin M50, Ireland
title_short Machine learning based data collection protocol for intelligent transport systems: a real-time implementation on Dublin M50, Ireland
title_sort machine learning based data collection protocol for intelligent transport systems a real time implementation on dublin m50 ireland
topic Machine learning
Data collection protocol
Data information systems
Intelligent transport systems
Smart cities
Real-time protocol
url https://doi.org/10.1007/s40747-023-01241-x
work_keys_str_mv AT maryamgillani machinelearningbaseddatacollectionprotocolforintelligenttransportsystemsarealtimeimplementationondublinm50ireland
AT hafizadnanniaz machinelearningbaseddatacollectionprotocolforintelligenttransportsystemsarealtimeimplementationondublinm50ireland