Mixed Traffic Flow State Detection: A Connected Vehicles-Assisted Roadside Radar and Video Data Fusion Scheme

An increasing number of connected vehicles (CVs) driving together with regular vehicles (RVs) on the road is an inevitable stage of future traffic development. As accurate traffic flow state detection is essential for ensuring safe and efficient traffic, the level of road intelligence is being enhan...

Full description

Bibliographic Details
Main Authors: Rui Chen, Jiameng Ning, Yu Lei, Yilong Hui, Nan Cheng
Format: Article
Language:English
Published: IEEE 2023-01-01
Series:IEEE Open Journal of Intelligent Transportation Systems
Subjects:
Online Access:https://ieeexplore.ieee.org/document/10131965/
_version_ 1797813945907544064
author Rui Chen
Jiameng Ning
Yu Lei
Yilong Hui
Nan Cheng
author_facet Rui Chen
Jiameng Ning
Yu Lei
Yilong Hui
Nan Cheng
author_sort Rui Chen
collection DOAJ
description An increasing number of connected vehicles (CVs) driving together with regular vehicles (RVs) on the road is an inevitable stage of future traffic development. As accurate traffic flow state detection is essential for ensuring safe and efficient traffic, the level of road intelligence is being enhanced by the mass deployment of roadside perception devices, which is capable of sensing the mixed traffic flow consisting of RVs and CVs. In this background, we propose a roadside radar and camera data fusion framework to improve the accuracy of traffic flow state detection, which utilizes relatively more accurate traffic parameters obtained from real-time communication between CVs and roadside unit (RSU) as calibration values for training the back propagation (BP) neural network. Then, with the perception data collected by roadside sensors, the BP neural network-based data fusion model is applied to all vehicles including RVs. Furthermore, considering the changes of road environments, a dynamic BP fusion method is proposed, which adopts dynamic training by updating samples conditionally, and are applied to fuse traffic flow, occupancy and RVs speed data. Simulation results demonstrate that for CVs data and all vehicles (including RVs) data, the proposed dynamic BP fusion method is more accurate than single sensor detection, entropy based Bayesian fusion method and traditional BP fusion without training by CVs. It can achieve smaller error, and the accuracies of vehicle speed, traffic flow, and occupancy are all above 95%.
first_indexed 2024-03-13T07:59:18Z
format Article
id doaj.art-86ad3eb919f8491bb26ec2bcbbe029a8
institution Directory Open Access Journal
issn 2687-7813
language English
last_indexed 2024-03-13T07:59:18Z
publishDate 2023-01-01
publisher IEEE
record_format Article
series IEEE Open Journal of Intelligent Transportation Systems
spelling doaj.art-86ad3eb919f8491bb26ec2bcbbe029a82023-06-01T23:00:40ZengIEEEIEEE Open Journal of Intelligent Transportation Systems2687-78132023-01-01436037110.1109/OJITS.2023.327926410131965Mixed Traffic Flow State Detection: A Connected Vehicles-Assisted Roadside Radar and Video Data Fusion SchemeRui Chen0https://orcid.org/0000-0002-3690-7902Jiameng Ning1Yu Lei2Yilong Hui3https://orcid.org/0000-0001-5543-2669Nan Cheng4https://orcid.org/0000-0001-7907-2071State Key Laboratory of Integrated Services Networks, Xidian University, Xi’an, ChinaState Key Laboratory of Integrated Services Networks, Xidian University, Xi’an, ChinaState Key Laboratory of Integrated Services Networks, Xidian University, Xi’an, ChinaState Key Laboratory of Integrated Services Networks, Xidian University, Xi’an, ChinaState Key Laboratory of Integrated Services Networks, Xidian University, Xi’an, ChinaAn increasing number of connected vehicles (CVs) driving together with regular vehicles (RVs) on the road is an inevitable stage of future traffic development. As accurate traffic flow state detection is essential for ensuring safe and efficient traffic, the level of road intelligence is being enhanced by the mass deployment of roadside perception devices, which is capable of sensing the mixed traffic flow consisting of RVs and CVs. In this background, we propose a roadside radar and camera data fusion framework to improve the accuracy of traffic flow state detection, which utilizes relatively more accurate traffic parameters obtained from real-time communication between CVs and roadside unit (RSU) as calibration values for training the back propagation (BP) neural network. Then, with the perception data collected by roadside sensors, the BP neural network-based data fusion model is applied to all vehicles including RVs. Furthermore, considering the changes of road environments, a dynamic BP fusion method is proposed, which adopts dynamic training by updating samples conditionally, and are applied to fuse traffic flow, occupancy and RVs speed data. Simulation results demonstrate that for CVs data and all vehicles (including RVs) data, the proposed dynamic BP fusion method is more accurate than single sensor detection, entropy based Bayesian fusion method and traditional BP fusion without training by CVs. It can achieve smaller error, and the accuracies of vehicle speed, traffic flow, and occupancy are all above 95%.https://ieeexplore.ieee.org/document/10131965/Connected vehiclesV2X communicationradarvideodata fusionstate detection
spellingShingle Rui Chen
Jiameng Ning
Yu Lei
Yilong Hui
Nan Cheng
Mixed Traffic Flow State Detection: A Connected Vehicles-Assisted Roadside Radar and Video Data Fusion Scheme
IEEE Open Journal of Intelligent Transportation Systems
Connected vehicles
V2X communication
radar
video
data fusion
state detection
title Mixed Traffic Flow State Detection: A Connected Vehicles-Assisted Roadside Radar and Video Data Fusion Scheme
title_full Mixed Traffic Flow State Detection: A Connected Vehicles-Assisted Roadside Radar and Video Data Fusion Scheme
title_fullStr Mixed Traffic Flow State Detection: A Connected Vehicles-Assisted Roadside Radar and Video Data Fusion Scheme
title_full_unstemmed Mixed Traffic Flow State Detection: A Connected Vehicles-Assisted Roadside Radar and Video Data Fusion Scheme
title_short Mixed Traffic Flow State Detection: A Connected Vehicles-Assisted Roadside Radar and Video Data Fusion Scheme
title_sort mixed traffic flow state detection a connected vehicles assisted roadside radar and video data fusion scheme
topic Connected vehicles
V2X communication
radar
video
data fusion
state detection
url https://ieeexplore.ieee.org/document/10131965/
work_keys_str_mv AT ruichen mixedtrafficflowstatedetectionaconnectedvehiclesassistedroadsideradarandvideodatafusionscheme
AT jiamengning mixedtrafficflowstatedetectionaconnectedvehiclesassistedroadsideradarandvideodatafusionscheme
AT yulei mixedtrafficflowstatedetectionaconnectedvehiclesassistedroadsideradarandvideodatafusionscheme
AT yilonghui mixedtrafficflowstatedetectionaconnectedvehiclesassistedroadsideradarandvideodatafusionscheme
AT nancheng mixedtrafficflowstatedetectionaconnectedvehiclesassistedroadsideradarandvideodatafusionscheme