A Framework for Trajectory Prediction of Preceding Target Vehicles in Urban Scenario Using Multi-Sensor Fusion

Preceding vehicles have a significant impact on the safety of the vehicle, whether or not it has the same driving direction as an ego-vehicle. Reliable trajectory prediction of preceding vehicles is crucial for making safer planning. In this paper, we propose a framework for trajectory prediction of...

Full description

Bibliographic Details
Main Authors: Bin Zou, Wenbo Li, Xianjun Hou, Luqi Tang, Quan Yuan
Format: Article
Language:English
Published: MDPI AG 2022-06-01
Series:Sensors
Subjects:
Online Access:https://www.mdpi.com/1424-8220/22/13/4808
_version_ 1797441947282964480
author Bin Zou
Wenbo Li
Xianjun Hou
Luqi Tang
Quan Yuan
author_facet Bin Zou
Wenbo Li
Xianjun Hou
Luqi Tang
Quan Yuan
author_sort Bin Zou
collection DOAJ
description Preceding vehicles have a significant impact on the safety of the vehicle, whether or not it has the same driving direction as an ego-vehicle. Reliable trajectory prediction of preceding vehicles is crucial for making safer planning. In this paper, we propose a framework for trajectory prediction of preceding target vehicles in an urban scenario using multi-sensor fusion. First, the preceding target vehicles historical trajectory is acquired using LIDAR, camera, and combined inertial navigation system fusion in the dynamic scene. Next, the Savitzky–Golay filter is taken to smooth the vehicle trajectory. Then, two transformer-based networks are built to predict preceding target vehicles’ future trajectory, which are the traditional transformer and the cluster-based transformer. In a traditional transformer, preceding target vehicles trajectories are predicted using velocities in the X-axis and Y-axis. In the cluster-based transformer, the k-means algorithm and transformer are combined to predict trajectory in a high-dimensional space based on classification. Driving data from the real-world environment in Wuhan, China, are collected to train and validate the proposed preceding target vehicles trajectory prediction algorithm in the experiments. The result of the performance analysis confirms that the proposed two transformers methods can effectively predict the trajectory using multi-sensor fusion and cluster-based transformer method can achieve better performance than the traditional transformer.
first_indexed 2024-03-09T12:34:34Z
format Article
id doaj.art-22e3d7f17f1a4a7e9a9827585b1e20e1
institution Directory Open Access Journal
issn 1424-8220
language English
last_indexed 2024-03-09T12:34:34Z
publishDate 2022-06-01
publisher MDPI AG
record_format Article
series Sensors
spelling doaj.art-22e3d7f17f1a4a7e9a9827585b1e20e12023-11-30T22:25:20ZengMDPI AGSensors1424-82202022-06-012213480810.3390/s22134808A Framework for Trajectory Prediction of Preceding Target Vehicles in Urban Scenario Using Multi-Sensor FusionBin Zou0Wenbo Li1Xianjun Hou2Luqi Tang3Quan Yuan4Hubei Key Laboratory of Advanced Technology for Automotive Components, Wuhan University of Technology, Wuhan 430070, ChinaHubei Key Laboratory of Advanced Technology for Automotive Components, Wuhan University of Technology, Wuhan 430070, ChinaHubei Key Laboratory of Advanced Technology for Automotive Components, Wuhan University of Technology, Wuhan 430070, ChinaHubei Key Laboratory of Advanced Technology for Automotive Components, Wuhan University of Technology, Wuhan 430070, ChinaHubei Key Laboratory of Advanced Technology for Automotive Components, Wuhan University of Technology, Wuhan 430070, ChinaPreceding vehicles have a significant impact on the safety of the vehicle, whether or not it has the same driving direction as an ego-vehicle. Reliable trajectory prediction of preceding vehicles is crucial for making safer planning. In this paper, we propose a framework for trajectory prediction of preceding target vehicles in an urban scenario using multi-sensor fusion. First, the preceding target vehicles historical trajectory is acquired using LIDAR, camera, and combined inertial navigation system fusion in the dynamic scene. Next, the Savitzky–Golay filter is taken to smooth the vehicle trajectory. Then, two transformer-based networks are built to predict preceding target vehicles’ future trajectory, which are the traditional transformer and the cluster-based transformer. In a traditional transformer, preceding target vehicles trajectories are predicted using velocities in the X-axis and Y-axis. In the cluster-based transformer, the k-means algorithm and transformer are combined to predict trajectory in a high-dimensional space based on classification. Driving data from the real-world environment in Wuhan, China, are collected to train and validate the proposed preceding target vehicles trajectory prediction algorithm in the experiments. The result of the performance analysis confirms that the proposed two transformers methods can effectively predict the trajectory using multi-sensor fusion and cluster-based transformer method can achieve better performance than the traditional transformer.https://www.mdpi.com/1424-8220/22/13/4808trajectory predictiontransformerclustermulti-sensor fusiondetection and trackingdifferent driving direction
spellingShingle Bin Zou
Wenbo Li
Xianjun Hou
Luqi Tang
Quan Yuan
A Framework for Trajectory Prediction of Preceding Target Vehicles in Urban Scenario Using Multi-Sensor Fusion
Sensors
trajectory prediction
transformer
cluster
multi-sensor fusion
detection and tracking
different driving direction
title A Framework for Trajectory Prediction of Preceding Target Vehicles in Urban Scenario Using Multi-Sensor Fusion
title_full A Framework for Trajectory Prediction of Preceding Target Vehicles in Urban Scenario Using Multi-Sensor Fusion
title_fullStr A Framework for Trajectory Prediction of Preceding Target Vehicles in Urban Scenario Using Multi-Sensor Fusion
title_full_unstemmed A Framework for Trajectory Prediction of Preceding Target Vehicles in Urban Scenario Using Multi-Sensor Fusion
title_short A Framework for Trajectory Prediction of Preceding Target Vehicles in Urban Scenario Using Multi-Sensor Fusion
title_sort framework for trajectory prediction of preceding target vehicles in urban scenario using multi sensor fusion
topic trajectory prediction
transformer
cluster
multi-sensor fusion
detection and tracking
different driving direction
url https://www.mdpi.com/1424-8220/22/13/4808
work_keys_str_mv AT binzou aframeworkfortrajectorypredictionofprecedingtargetvehiclesinurbanscenariousingmultisensorfusion
AT wenboli aframeworkfortrajectorypredictionofprecedingtargetvehiclesinurbanscenariousingmultisensorfusion
AT xianjunhou aframeworkfortrajectorypredictionofprecedingtargetvehiclesinurbanscenariousingmultisensorfusion
AT luqitang aframeworkfortrajectorypredictionofprecedingtargetvehiclesinurbanscenariousingmultisensorfusion
AT quanyuan aframeworkfortrajectorypredictionofprecedingtargetvehiclesinurbanscenariousingmultisensorfusion
AT binzou frameworkfortrajectorypredictionofprecedingtargetvehiclesinurbanscenariousingmultisensorfusion
AT wenboli frameworkfortrajectorypredictionofprecedingtargetvehiclesinurbanscenariousingmultisensorfusion
AT xianjunhou frameworkfortrajectorypredictionofprecedingtargetvehiclesinurbanscenariousingmultisensorfusion
AT luqitang frameworkfortrajectorypredictionofprecedingtargetvehiclesinurbanscenariousingmultisensorfusion
AT quanyuan frameworkfortrajectorypredictionofprecedingtargetvehiclesinurbanscenariousingmultisensorfusion