Wearable-Based Affect Recognition—A Review
Affect recognition is an interdisciplinary research field bringing together researchers from natural and social sciences. Affect recognition research aims to detect the affective state of a person based on observables, with the goal to, for example, provide reasoning for the person’s decis...
Main Authors: | , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
MDPI AG
2019-09-01
|
Series: | Sensors |
Subjects: | |
Online Access: | https://www.mdpi.com/1424-8220/19/19/4079 |
_version_ | 1811307446224814080 |
---|---|
author | Philip Schmidt Attila Reiss Robert Dürichen Kristof Van Laerhoven |
author_facet | Philip Schmidt Attila Reiss Robert Dürichen Kristof Van Laerhoven |
author_sort | Philip Schmidt |
collection | DOAJ |
description | Affect recognition is an interdisciplinary research field bringing together researchers from natural and social sciences. Affect recognition research aims to detect the affective state of a person based on observables, with the goal to, for example, provide reasoning for the person’s decision making or to support mental wellbeing (e.g., stress monitoring). Recently, beside of approaches based on audio, visual or text information, solutions relying on wearable sensors as observables, recording mainly physiological and inertial parameters, have received increasing attention. Wearable systems enable an ideal platform for long-term affect recognition applications due to their rich functionality and form factor, while providing valuable insights during everyday life through integrated sensors. However, existing literature surveys lack a comprehensive overview of state-of-the-art research in wearable-based affect recognition. Therefore, the aim of this paper is to provide a broad overview and in-depth understanding of the theoretical background, methods and best practices of wearable affect and stress recognition. Following a summary of different psychological models, we detail the influence of affective states on the human physiology and the sensors commonly employed to measure physiological changes. Then, we outline lab protocols eliciting affective states and provide guidelines for ground truth generation in field studies. We also describe the standard data processing chain and review common approaches related to the preprocessing, feature extraction and classification steps. By providing a comprehensive summary of the state-of-the-art and guidelines to various aspects, we would like to enable other researchers in the field to conduct and evaluate user studies and develop wearable systems. |
first_indexed | 2024-04-13T09:04:32Z |
format | Article |
id | doaj.art-93ae919a826c4ee3821c37b22022be68 |
institution | Directory Open Access Journal |
issn | 1424-8220 |
language | English |
last_indexed | 2024-04-13T09:04:32Z |
publishDate | 2019-09-01 |
publisher | MDPI AG |
record_format | Article |
series | Sensors |
spelling | doaj.art-93ae919a826c4ee3821c37b22022be682022-12-22T02:53:01ZengMDPI AGSensors1424-82202019-09-011919407910.3390/s19194079s19194079Wearable-Based Affect Recognition—A ReviewPhilip Schmidt0Attila Reiss1Robert Dürichen2Kristof Van Laerhoven3Robert Bosch GmbH, Robert-Bosch-Campus 1, 71272 Renningen, GermanyRobert Bosch GmbH, Robert-Bosch-Campus 1, 71272 Renningen, GermanyRobert Bosch GmbH, Robert-Bosch-Campus 1, 71272 Renningen, GermanyUniversity Siegen , Hölderlinstr. 3, 57076 Siegen, GermanyAffect recognition is an interdisciplinary research field bringing together researchers from natural and social sciences. Affect recognition research aims to detect the affective state of a person based on observables, with the goal to, for example, provide reasoning for the person’s decision making or to support mental wellbeing (e.g., stress monitoring). Recently, beside of approaches based on audio, visual or text information, solutions relying on wearable sensors as observables, recording mainly physiological and inertial parameters, have received increasing attention. Wearable systems enable an ideal platform for long-term affect recognition applications due to their rich functionality and form factor, while providing valuable insights during everyday life through integrated sensors. However, existing literature surveys lack a comprehensive overview of state-of-the-art research in wearable-based affect recognition. Therefore, the aim of this paper is to provide a broad overview and in-depth understanding of the theoretical background, methods and best practices of wearable affect and stress recognition. Following a summary of different psychological models, we detail the influence of affective states on the human physiology and the sensors commonly employed to measure physiological changes. Then, we outline lab protocols eliciting affective states and provide guidelines for ground truth generation in field studies. We also describe the standard data processing chain and review common approaches related to the preprocessing, feature extraction and classification steps. By providing a comprehensive summary of the state-of-the-art and guidelines to various aspects, we would like to enable other researchers in the field to conduct and evaluate user studies and develop wearable systems.https://www.mdpi.com/1424-8220/19/19/4079reviewaffective computingaffect recognitionwearablesdata collectionphysiological signalsmachine learningphysiological featuresensors |
spellingShingle | Philip Schmidt Attila Reiss Robert Dürichen Kristof Van Laerhoven Wearable-Based Affect Recognition—A Review Sensors review affective computing affect recognition wearables data collection physiological signals machine learning physiological feature sensors |
title | Wearable-Based Affect Recognition—A Review |
title_full | Wearable-Based Affect Recognition—A Review |
title_fullStr | Wearable-Based Affect Recognition—A Review |
title_full_unstemmed | Wearable-Based Affect Recognition—A Review |
title_short | Wearable-Based Affect Recognition—A Review |
title_sort | wearable based affect recognition a review |
topic | review affective computing affect recognition wearables data collection physiological signals machine learning physiological feature sensors |
url | https://www.mdpi.com/1424-8220/19/19/4079 |
work_keys_str_mv | AT philipschmidt wearablebasedaffectrecognitionareview AT attilareiss wearablebasedaffectrecognitionareview AT robertdurichen wearablebasedaffectrecognitionareview AT kristofvanlaerhoven wearablebasedaffectrecognitionareview |