Event Cameras in Automotive Sensing: A Review

Event cameras (EC) represent a paradigm shift and are emerging as valuable tools in the automotive industry, particularly for in-cabin and out-of-cabin monitoring. These cameras capture pixel intensity changes as ”events” with ultra-low latency, making them suitable for real- t...

Full description

Bibliographic Details
Main Authors: Waseem Shariff, Mehdi Sefidgar Dilmaghani, Paul Kielty, Mohamed Moustafa, Joe Lemley, Peter Corcoran
Format: Article
Language:English
Published: IEEE 2024-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/10494342/
_version_ 1797206128406298624
author Waseem Shariff
Mehdi Sefidgar Dilmaghani
Paul Kielty
Mohamed Moustafa
Joe Lemley
Peter Corcoran
author_facet Waseem Shariff
Mehdi Sefidgar Dilmaghani
Paul Kielty
Mohamed Moustafa
Joe Lemley
Peter Corcoran
author_sort Waseem Shariff
collection DOAJ
description Event cameras (EC) represent a paradigm shift and are emerging as valuable tools in the automotive industry, particularly for in-cabin and out-of-cabin monitoring. These cameras capture pixel intensity changes as ”events” with ultra-low latency, making them suitable for real- time applications. In the context of in-cabin monitoring, EC offer solution for driver and passenger tracking, enhancing safety and comfort. For out-of-cabin monitoring, they excel in tracking objects and detecting potential hazards on the road. This article explores the applications, benefits, and challenges of event cameras in these two critical domains within the automotive industry. This review also highlights relevant datasets and methodologies, enabling researchers to make informed decisions tailored to their specific vehicular-technology and place their work in the broader context of EC sensing. Through an exploration of the hardware, the complexities of data processing, and customized algorithms for both in-cabin and out-of-cabin surveillance, this paper outlines a framework encompassing methodologies, tools, and datasets critical for the implementation of event camera sensing in automotive systems.
first_indexed 2024-04-24T09:02:05Z
format Article
id doaj.art-a8faf3ec0a594ef799b28d2d4518af27
institution Directory Open Access Journal
issn 2169-3536
language English
last_indexed 2024-04-24T09:02:05Z
publishDate 2024-01-01
publisher IEEE
record_format Article
series IEEE Access
spelling doaj.art-a8faf3ec0a594ef799b28d2d4518af272024-04-15T23:00:14ZengIEEEIEEE Access2169-35362024-01-0112512755130610.1109/ACCESS.2024.338603210494342Event Cameras in Automotive Sensing: A ReviewWaseem Shariff0https://orcid.org/0000-0001-7298-9389Mehdi Sefidgar Dilmaghani1Paul Kielty2https://orcid.org/0000-0002-6259-1163Mohamed Moustafa3https://orcid.org/0000-0002-6251-7115Joe Lemley4Peter Corcoran5https://orcid.org/0000-0003-1670-4793Department of Electronic and Electrical Engineering, C3I Imaging Laboratory, University of Galway, Galway, IrelandDepartment of Electronic and Electrical Engineering, C3I Imaging Laboratory, University of Galway, Galway, IrelandDepartment of Electronic and Electrical Engineering, C3I Imaging Laboratory, University of Galway, Galway, IrelandDepartment of Electronic and Electrical Engineering, C3I Imaging Laboratory, University of Galway, Galway, IrelandSensing Team, FotoNation, Galway, IrelandDepartment of Electronic and Electrical Engineering, C3I Imaging Laboratory, University of Galway, Galway, IrelandEvent cameras (EC) represent a paradigm shift and are emerging as valuable tools in the automotive industry, particularly for in-cabin and out-of-cabin monitoring. These cameras capture pixel intensity changes as ”events” with ultra-low latency, making them suitable for real- time applications. In the context of in-cabin monitoring, EC offer solution for driver and passenger tracking, enhancing safety and comfort. For out-of-cabin monitoring, they excel in tracking objects and detecting potential hazards on the road. This article explores the applications, benefits, and challenges of event cameras in these two critical domains within the automotive industry. This review also highlights relevant datasets and methodologies, enabling researchers to make informed decisions tailored to their specific vehicular-technology and place their work in the broader context of EC sensing. Through an exploration of the hardware, the complexities of data processing, and customized algorithms for both in-cabin and out-of-cabin surveillance, this paper outlines a framework encompassing methodologies, tools, and datasets critical for the implementation of event camera sensing in automotive systems.https://ieeexplore.ieee.org/document/10494342/Neuromorphic event cameraevent based visiondriver monitoring systemout-of-cabin monitoringin-cabin monitoring
spellingShingle Waseem Shariff
Mehdi Sefidgar Dilmaghani
Paul Kielty
Mohamed Moustafa
Joe Lemley
Peter Corcoran
Event Cameras in Automotive Sensing: A Review
IEEE Access
Neuromorphic event camera
event based vision
driver monitoring system
out-of-cabin monitoring
in-cabin monitoring
title Event Cameras in Automotive Sensing: A Review
title_full Event Cameras in Automotive Sensing: A Review
title_fullStr Event Cameras in Automotive Sensing: A Review
title_full_unstemmed Event Cameras in Automotive Sensing: A Review
title_short Event Cameras in Automotive Sensing: A Review
title_sort event cameras in automotive sensing a review
topic Neuromorphic event camera
event based vision
driver monitoring system
out-of-cabin monitoring
in-cabin monitoring
url https://ieeexplore.ieee.org/document/10494342/
work_keys_str_mv AT waseemshariff eventcamerasinautomotivesensingareview
AT mehdisefidgardilmaghani eventcamerasinautomotivesensingareview
AT paulkielty eventcamerasinautomotivesensingareview
AT mohamedmoustafa eventcamerasinautomotivesensingareview
AT joelemley eventcamerasinautomotivesensingareview
AT petercorcoran eventcamerasinautomotivesensingareview