<i>ADABase</i>: A Multimodal Dataset for Cognitive Load Estimation

Driver monitoring systems play an important role in lower to mid-level autonomous vehicles. Our work focuses on the detection of cognitive load as a component of driver-state estimation to improve traffic safety. By inducing single and dual-task workloads of increasing intensity on 51 subjects, whil...

Full description

Bibliographic Details
Main Authors: Maximilian P. Oppelt, Andreas Foltyn, Jessica Deuschel, Nadine R. Lang, Nina Holzer, Bjoern M. Eskofier, Seung Hee Yang
Format: Article
Language:English
Published: MDPI AG 2022-12-01
Series:Sensors
Subjects:
Online Access:https://www.mdpi.com/1424-8220/23/1/340
Description
Summary:Driver monitoring systems play an important role in lower to mid-level autonomous vehicles. Our work focuses on the detection of cognitive load as a component of driver-state estimation to improve traffic safety. By inducing single and dual-task workloads of increasing intensity on 51 subjects, while continuously measuring signals from multiple modalities, based on <i>physiological</i> measurements such as ECG, EDA, EMG, PPG, respiration rate, skin temperature and eye tracker data, as well as <i>behavioral</i> measurements such as action units extracted from facial videos, <i>performance</i> metrics like reaction time and <i>subjective</i> feedback using questionnaires, we create <i>ADABase</i> (<b>A</b>utonomous <b>D</b>riving Cognitive Load <b>A</b>ssessment Data<b>base</b>) As a reference method to induce cognitive load onto subjects, we use the well-established <i>n</i>-back test, in addition to our novel simulator-based <i>k</i>-drive test, motivated by real-world semi-autonomously vehicles. We extract expert features of all measurements and find significant changes in multiple modalities. Ultimately we train and evaluate machine learning algorithms using single and multimodal inputs to distinguish cognitive load levels. We carefully evaluate model behavior and study feature importance. In summary, we introduce a novel cognitive load test, create a cognitive load database, validate changes using statistical tests, introduce novel classification and regression tasks for machine learning and train and evaluate machine learning models.
ISSN:1424-8220