Deep Learning Based Data Fusion for Sensor Fault Diagnosis and Tolerance in Autonomous Vehicles
Abstract Environmental perception is one of the key technologies to realize autonomous vehicles. Autonomous vehicles are often equipped with multiple sensors to form a multi-source environmental perception system. Those sensors are very sensitive to light or background conditions, which will introdu...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
SpringerOpen
2021-07-01
|
| Series: | Chinese Journal of Mechanical Engineering |
| Subjects: | |
| Online Access: | https://doi.org/10.1186/s10033-021-00568-1 |
| _version_ | 1819091782437175296 |
|---|---|
| author | Huihui Pan Weichao Sun Qiming Sun Huijun Gao |
| author_facet | Huihui Pan Weichao Sun Qiming Sun Huijun Gao |
| author_sort | Huihui Pan |
| collection | DOAJ |
| description | Abstract Environmental perception is one of the key technologies to realize autonomous vehicles. Autonomous vehicles are often equipped with multiple sensors to form a multi-source environmental perception system. Those sensors are very sensitive to light or background conditions, which will introduce a variety of global and local fault signals that bring great safety risks to autonomous driving system during long-term running. In this paper, a real-time data fusion network with fault diagnosis and fault tolerance mechanism is designed. By introducing prior features to realize the lightweight network, the features of the input data can be extracted in real time. A new sensor reliability evaluation method is proposed by calculating the global and local confidence of sensors. Through the temporal and spatial correlation between sensor data, the sensor redundancy is utilized to diagnose the local and global confidence level of sensor data in real time, eliminate the fault data, and ensure the accuracy and reliability of data fusion. Experiments show that the network achieves state-of-the-art results in speed and accuracy, and can accurately detect the location of the target when some sensors are out of focus or out of order. The fusion framework proposed in this paper is proved to be effective for intelligent vehicles in terms of real-time performance and reliability. |
| first_indexed | 2024-12-21T22:45:12Z |
| format | Article |
| id | doaj.art-5726809435034bafbfab00bb11a662cc |
| institution | Directory Open Access Journal |
| issn | 1000-9345 2192-8258 |
| language | English |
| last_indexed | 2024-12-21T22:45:12Z |
| publishDate | 2021-07-01 |
| publisher | SpringerOpen |
| record_format | Article |
| series | Chinese Journal of Mechanical Engineering |
| spelling | doaj.art-5726809435034bafbfab00bb11a662cc2022-12-21T18:47:43ZengSpringerOpenChinese Journal of Mechanical Engineering1000-93452192-82582021-07-0134111110.1186/s10033-021-00568-1Deep Learning Based Data Fusion for Sensor Fault Diagnosis and Tolerance in Autonomous VehiclesHuihui Pan0Weichao Sun1Qiming Sun2Huijun Gao3Research Institute of Intelligent Control and Systems, Harbin Institute of TechnologyResearch Institute of Intelligent Control and Systems, Harbin Institute of TechnologyResearch Institute of Intelligent Control and Systems, Harbin Institute of TechnologyResearch Institute of Intelligent Control and Systems, Harbin Institute of TechnologyAbstract Environmental perception is one of the key technologies to realize autonomous vehicles. Autonomous vehicles are often equipped with multiple sensors to form a multi-source environmental perception system. Those sensors are very sensitive to light or background conditions, which will introduce a variety of global and local fault signals that bring great safety risks to autonomous driving system during long-term running. In this paper, a real-time data fusion network with fault diagnosis and fault tolerance mechanism is designed. By introducing prior features to realize the lightweight network, the features of the input data can be extracted in real time. A new sensor reliability evaluation method is proposed by calculating the global and local confidence of sensors. Through the temporal and spatial correlation between sensor data, the sensor redundancy is utilized to diagnose the local and global confidence level of sensor data in real time, eliminate the fault data, and ensure the accuracy and reliability of data fusion. Experiments show that the network achieves state-of-the-art results in speed and accuracy, and can accurately detect the location of the target when some sensors are out of focus or out of order. The fusion framework proposed in this paper is proved to be effective for intelligent vehicles in terms of real-time performance and reliability.https://doi.org/10.1186/s10033-021-00568-1Autonomous vehiclesFault diagnosis and toleranceObject detectionData fusion |
| spellingShingle | Huihui Pan Weichao Sun Qiming Sun Huijun Gao Deep Learning Based Data Fusion for Sensor Fault Diagnosis and Tolerance in Autonomous Vehicles Chinese Journal of Mechanical Engineering Autonomous vehicles Fault diagnosis and tolerance Object detection Data fusion |
| title | Deep Learning Based Data Fusion for Sensor Fault Diagnosis and Tolerance in Autonomous Vehicles |
| title_full | Deep Learning Based Data Fusion for Sensor Fault Diagnosis and Tolerance in Autonomous Vehicles |
| title_fullStr | Deep Learning Based Data Fusion for Sensor Fault Diagnosis and Tolerance in Autonomous Vehicles |
| title_full_unstemmed | Deep Learning Based Data Fusion for Sensor Fault Diagnosis and Tolerance in Autonomous Vehicles |
| title_short | Deep Learning Based Data Fusion for Sensor Fault Diagnosis and Tolerance in Autonomous Vehicles |
| title_sort | deep learning based data fusion for sensor fault diagnosis and tolerance in autonomous vehicles |
| topic | Autonomous vehicles Fault diagnosis and tolerance Object detection Data fusion |
| url | https://doi.org/10.1186/s10033-021-00568-1 |
| work_keys_str_mv | AT huihuipan deeplearningbaseddatafusionforsensorfaultdiagnosisandtoleranceinautonomousvehicles AT weichaosun deeplearningbaseddatafusionforsensorfaultdiagnosisandtoleranceinautonomousvehicles AT qimingsun deeplearningbaseddatafusionforsensorfaultdiagnosisandtoleranceinautonomousvehicles AT huijungao deeplearningbaseddatafusionforsensorfaultdiagnosisandtoleranceinautonomousvehicles |