System and Method for Driver Drowsiness Detection Using Behavioral and Sensor-Based Physiological Measures
The amount of road accidents caused by driver drowsiness is one of the world’s major challenges. These accidents lead to numerous fatal and non-fatal injuries which impose substantial financial strain on individuals and governments every year. As a result, it is critical to prevent catastrophic acci...
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2023-01-01
|
| Series: | Sensors |
| Subjects: | |
| Online Access: | https://www.mdpi.com/1424-8220/23/3/1292 |
| _version_ | 1797623251132743680 |
|---|---|
| author | Jaspreet Singh Bajaj Naveen Kumar Rajesh Kumar Kaushal H. L. Gururaj Francesco Flammini Rajesh Natarajan |
| author_facet | Jaspreet Singh Bajaj Naveen Kumar Rajesh Kumar Kaushal H. L. Gururaj Francesco Flammini Rajesh Natarajan |
| author_sort | Jaspreet Singh Bajaj |
| collection | DOAJ |
| description | The amount of road accidents caused by driver drowsiness is one of the world’s major challenges. These accidents lead to numerous fatal and non-fatal injuries which impose substantial financial strain on individuals and governments every year. As a result, it is critical to prevent catastrophic accidents and reduce the financial burden on society caused by driver drowsiness. The research community has primarily focused on two approaches to identify driver drowsiness during the last decade: intrusive and non-intrusive. The intrusive approach includes physiological measures, and the non-intrusive approach includes vehicle-based and behavioral measures. In an intrusive approach, sensors are used to detect driver drowsiness by placing them on the driver’s body, whereas in a non-intrusive approach, a camera is used for drowsiness detection by identifying yawning patterns, eyelid movement and head inclination. Noticeably, most research has been conducted in driver drowsiness detection methods using only single measures that failed to produce good outcomes. Furthermore, these measures were only functional in certain conditions. This paper proposes a model that combines the two approaches, non-intrusive and intrusive, to detect driver drowsiness. Behavioral measures as a non-intrusive approach and sensor-based physiological measures as an intrusive approach are combined to detect driver drowsiness. The proposed hybrid model uses AI-based Multi-Task Cascaded Convolutional Neural Networks (MTCNN) as a behavioral measure to recognize the driver’s facial features, and the Galvanic Skin Response (GSR) sensor as a physiological measure to collect the skin conductance of the driver that helps to increase the overall accuracy. Furthermore, the model’s efficacy has been computed in a simulated environment. The outcome shows that the proposed hybrid model is capable of identifying the transition from awake to a drowsy state in the driver in all conditions with the efficacy of 91%. |
| first_indexed | 2024-03-11T09:26:01Z |
| format | Article |
| id | doaj.art-4c6cd779e8194dd9826dcd1b948f349b |
| institution | Directory Open Access Journal |
| issn | 1424-8220 |
| language | English |
| last_indexed | 2024-03-11T09:26:01Z |
| publishDate | 2023-01-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Sensors |
| spelling | doaj.art-4c6cd779e8194dd9826dcd1b948f349b2023-11-16T17:58:57ZengMDPI AGSensors1424-82202023-01-01233129210.3390/s23031292System and Method for Driver Drowsiness Detection Using Behavioral and Sensor-Based Physiological MeasuresJaspreet Singh Bajaj0Naveen Kumar1Rajesh Kumar Kaushal2H. L. Gururaj3Francesco Flammini4Rajesh Natarajan5Chitkara University Institute of Engineering and Technology, Chitkara University, Punjab 140401, IndiaChitkara University Institute of Engineering and Technology, Chitkara University, Punjab 140401, IndiaChitkara University Institute of Engineering and Technology, Chitkara University, Punjab 140401, IndiaDepartment of Information Technology, Manipal Institute of Technology Bengaluru, Manipal Academy of Higher Education, Manipal 576104, IndiaIDSIA USI-SUPSI, University of Applied Sciences and Arts of Southern Switzerland, 6928 Manno, SwitzerlandInformation Technology Department, University of Technology and Applied Sciences-Shinas, Shinas 324, OmanThe amount of road accidents caused by driver drowsiness is one of the world’s major challenges. These accidents lead to numerous fatal and non-fatal injuries which impose substantial financial strain on individuals and governments every year. As a result, it is critical to prevent catastrophic accidents and reduce the financial burden on society caused by driver drowsiness. The research community has primarily focused on two approaches to identify driver drowsiness during the last decade: intrusive and non-intrusive. The intrusive approach includes physiological measures, and the non-intrusive approach includes vehicle-based and behavioral measures. In an intrusive approach, sensors are used to detect driver drowsiness by placing them on the driver’s body, whereas in a non-intrusive approach, a camera is used for drowsiness detection by identifying yawning patterns, eyelid movement and head inclination. Noticeably, most research has been conducted in driver drowsiness detection methods using only single measures that failed to produce good outcomes. Furthermore, these measures were only functional in certain conditions. This paper proposes a model that combines the two approaches, non-intrusive and intrusive, to detect driver drowsiness. Behavioral measures as a non-intrusive approach and sensor-based physiological measures as an intrusive approach are combined to detect driver drowsiness. The proposed hybrid model uses AI-based Multi-Task Cascaded Convolutional Neural Networks (MTCNN) as a behavioral measure to recognize the driver’s facial features, and the Galvanic Skin Response (GSR) sensor as a physiological measure to collect the skin conductance of the driver that helps to increase the overall accuracy. Furthermore, the model’s efficacy has been computed in a simulated environment. The outcome shows that the proposed hybrid model is capable of identifying the transition from awake to a drowsy state in the driver in all conditions with the efficacy of 91%.https://www.mdpi.com/1424-8220/23/3/1292artificial intelligencedriver drowsinesshybrid measuresMTCNN |
| spellingShingle | Jaspreet Singh Bajaj Naveen Kumar Rajesh Kumar Kaushal H. L. Gururaj Francesco Flammini Rajesh Natarajan System and Method for Driver Drowsiness Detection Using Behavioral and Sensor-Based Physiological Measures Sensors artificial intelligence driver drowsiness hybrid measures MTCNN |
| title | System and Method for Driver Drowsiness Detection Using Behavioral and Sensor-Based Physiological Measures |
| title_full | System and Method for Driver Drowsiness Detection Using Behavioral and Sensor-Based Physiological Measures |
| title_fullStr | System and Method for Driver Drowsiness Detection Using Behavioral and Sensor-Based Physiological Measures |
| title_full_unstemmed | System and Method for Driver Drowsiness Detection Using Behavioral and Sensor-Based Physiological Measures |
| title_short | System and Method for Driver Drowsiness Detection Using Behavioral and Sensor-Based Physiological Measures |
| title_sort | system and method for driver drowsiness detection using behavioral and sensor based physiological measures |
| topic | artificial intelligence driver drowsiness hybrid measures MTCNN |
| url | https://www.mdpi.com/1424-8220/23/3/1292 |
| work_keys_str_mv | AT jaspreetsinghbajaj systemandmethodfordriverdrowsinessdetectionusingbehavioralandsensorbasedphysiologicalmeasures AT naveenkumar systemandmethodfordriverdrowsinessdetectionusingbehavioralandsensorbasedphysiologicalmeasures AT rajeshkumarkaushal systemandmethodfordriverdrowsinessdetectionusingbehavioralandsensorbasedphysiologicalmeasures AT hlgururaj systemandmethodfordriverdrowsinessdetectionusingbehavioralandsensorbasedphysiologicalmeasures AT francescoflammini systemandmethodfordriverdrowsinessdetectionusingbehavioralandsensorbasedphysiologicalmeasures AT rajeshnatarajan systemandmethodfordriverdrowsinessdetectionusingbehavioralandsensorbasedphysiologicalmeasures |