A Multi-Feature Fusion and Situation Awareness-Based Method for Fatigue Driving Level Determination

The detection and evaluation of fatigue levels in drivers play a crucial role in reducing traffic accidents and improving the overall quality of life. However, existing studies in this domain often focus on fatigue detection alone, with limited research on fatigue level evaluation. These limitations...

Full description

Bibliographic Details
Main Authors: Fei-Fei Wei, Tao Chi, Xuebo Chen
Format: Article
Language:English
Published: MDPI AG 2023-06-01
Series:Electronics
Subjects:
Online Access:https://www.mdpi.com/2079-9292/12/13/2884
_version_ 1797591863086022656
author Fei-Fei Wei
Tao Chi
Xuebo Chen
author_facet Fei-Fei Wei
Tao Chi
Xuebo Chen
author_sort Fei-Fei Wei
collection DOAJ
description The detection and evaluation of fatigue levels in drivers play a crucial role in reducing traffic accidents and improving the overall quality of life. However, existing studies in this domain often focus on fatigue detection alone, with limited research on fatigue level evaluation. These limitations include the use of single evaluation methods and relatively low accuracy rates. To address these issues, this paper introduces an innovative approach for determining fatigue driving levels. We employ the Dlib library and fatigue state detection algorithms to develop a novel method specifically designed to assess fatigue levels. Unlike conventional approaches, our method adopts a multi-feature fusion strategy, integrating fatigue features from the eyes, mouth, and head pose. By combining these features, we achieve a more precise evaluation of the driver’s fatigue state level. Additionally, we propose a comprehensive evaluation method based on the analytic hierarchy process (AHP) and fuzzy comprehensive evaluation, combined with situational prediction. This approach effectively evaluates the fatigue state level of drivers at specific moments or stages and provides accurate predictions. Furthermore, we optimize the gated recurrent unit (GRU) network using an enhanced marine predator algorithm (MAP), which results in significant improvements in predicting fatigue levels during situational prediction. Experimental results demonstrate a classification accuracy of 92% across various scenarios while maintaining real-time performance. In summary, this paper introduces a novel approach for determining fatigue driving levels through multi-feature fusion. We also incorporate AHP-fuzzy comprehensive evaluation and situational prediction techniques, enhancing the accuracy and reliability of fatigue level evaluation. This research holds both theoretical and practical significance in the field of fatigue driving.
first_indexed 2024-03-11T01:43:26Z
format Article
id doaj.art-d766187677584f4cacb5d7b6dd60ac05
institution Directory Open Access Journal
issn 2079-9292
language English
last_indexed 2024-03-11T01:43:26Z
publishDate 2023-06-01
publisher MDPI AG
record_format Article
series Electronics
spelling doaj.art-d766187677584f4cacb5d7b6dd60ac052023-11-18T16:24:49ZengMDPI AGElectronics2079-92922023-06-011213288410.3390/electronics12132884A Multi-Feature Fusion and Situation Awareness-Based Method for Fatigue Driving Level DeterminationFei-Fei Wei0Tao Chi1Xuebo Chen2School of Electronic and Information Engineering, University of Science and Technology Liaoning, Anshan 114051, ChinaSchool of Electronic and Information Engineering, University of Science and Technology Liaoning, Anshan 114051, ChinaSchool of Electronic and Information Engineering, University of Science and Technology Liaoning, Anshan 114051, ChinaThe detection and evaluation of fatigue levels in drivers play a crucial role in reducing traffic accidents and improving the overall quality of life. However, existing studies in this domain often focus on fatigue detection alone, with limited research on fatigue level evaluation. These limitations include the use of single evaluation methods and relatively low accuracy rates. To address these issues, this paper introduces an innovative approach for determining fatigue driving levels. We employ the Dlib library and fatigue state detection algorithms to develop a novel method specifically designed to assess fatigue levels. Unlike conventional approaches, our method adopts a multi-feature fusion strategy, integrating fatigue features from the eyes, mouth, and head pose. By combining these features, we achieve a more precise evaluation of the driver’s fatigue state level. Additionally, we propose a comprehensive evaluation method based on the analytic hierarchy process (AHP) and fuzzy comprehensive evaluation, combined with situational prediction. This approach effectively evaluates the fatigue state level of drivers at specific moments or stages and provides accurate predictions. Furthermore, we optimize the gated recurrent unit (GRU) network using an enhanced marine predator algorithm (MAP), which results in significant improvements in predicting fatigue levels during situational prediction. Experimental results demonstrate a classification accuracy of 92% across various scenarios while maintaining real-time performance. In summary, this paper introduces a novel approach for determining fatigue driving levels through multi-feature fusion. We also incorporate AHP-fuzzy comprehensive evaluation and situational prediction techniques, enhancing the accuracy and reliability of fatigue level evaluation. This research holds both theoretical and practical significance in the field of fatigue driving.https://www.mdpi.com/2079-9292/12/13/2884multi-feature fusionfatigue driving detectionAHP-fuzzy comprehensive evaluationsituational awareness
spellingShingle Fei-Fei Wei
Tao Chi
Xuebo Chen
A Multi-Feature Fusion and Situation Awareness-Based Method for Fatigue Driving Level Determination
Electronics
multi-feature fusion
fatigue driving detection
AHP-fuzzy comprehensive evaluation
situational awareness
title A Multi-Feature Fusion and Situation Awareness-Based Method for Fatigue Driving Level Determination
title_full A Multi-Feature Fusion and Situation Awareness-Based Method for Fatigue Driving Level Determination
title_fullStr A Multi-Feature Fusion and Situation Awareness-Based Method for Fatigue Driving Level Determination
title_full_unstemmed A Multi-Feature Fusion and Situation Awareness-Based Method for Fatigue Driving Level Determination
title_short A Multi-Feature Fusion and Situation Awareness-Based Method for Fatigue Driving Level Determination
title_sort multi feature fusion and situation awareness based method for fatigue driving level determination
topic multi-feature fusion
fatigue driving detection
AHP-fuzzy comprehensive evaluation
situational awareness
url https://www.mdpi.com/2079-9292/12/13/2884
work_keys_str_mv AT feifeiwei amultifeaturefusionandsituationawarenessbasedmethodforfatiguedrivingleveldetermination
AT taochi amultifeaturefusionandsituationawarenessbasedmethodforfatiguedrivingleveldetermination
AT xuebochen amultifeaturefusionandsituationawarenessbasedmethodforfatiguedrivingleveldetermination
AT feifeiwei multifeaturefusionandsituationawarenessbasedmethodforfatiguedrivingleveldetermination
AT taochi multifeaturefusionandsituationawarenessbasedmethodforfatiguedrivingleveldetermination
AT xuebochen multifeaturefusionandsituationawarenessbasedmethodforfatiguedrivingleveldetermination