SensorHub: Multimodal Sensing in Real-Life Enables Home-Based Studies

Observational studies are an important tool for determining whether the findings from controlled experiments can be transferred into scenarios that are closer to subjects’ real-life circumstances. A rigorous approach to observational studies involves collecting data from different sensors to compreh...

Full description

Bibliographic Details
Main Authors: Jonas Chromik, Kristina Kirsten, Arne Herdick, Arpita Mallikarjuna Kappattanavar, Bert Arnrich
Format: Article
Language:English
Published: MDPI AG 2022-01-01
Series:Sensors
Subjects:
Online Access:https://www.mdpi.com/1424-8220/22/1/408
_version_ 1797497483432034304
author Jonas Chromik
Kristina Kirsten
Arne Herdick
Arpita Mallikarjuna Kappattanavar
Bert Arnrich
author_facet Jonas Chromik
Kristina Kirsten
Arne Herdick
Arpita Mallikarjuna Kappattanavar
Bert Arnrich
author_sort Jonas Chromik
collection DOAJ
description Observational studies are an important tool for determining whether the findings from controlled experiments can be transferred into scenarios that are closer to subjects’ real-life circumstances. A rigorous approach to observational studies involves collecting data from different sensors to comprehensively capture the situation of the subject. However, this leads to technical difficulties especially if the sensors are from different manufacturers, as multiple data collection tools have to run simultaneously. We present SensorHub, a system that can collect data from various wearable devices from different manufacturers, such as inertial measurement units, portable electrocardiographs, portable electroencephalographs, portable photoplethysmographs, and sensors for electrodermal activity. Additionally, our tool offers the possibility to include ecological momentary assessments (EMAs) in studies. Hence, SensorHub enables multimodal sensor data collection under real-world conditions and allows direct user feedback to be collected through questionnaires, enabling studies at home. In a first study with 11 participants, we successfully used SensorHub to record multiple signals with different devices and collected additional information with the help of EMAs. In addition, we evaluated SensorHub’s technical capabilities in several trials with up to 21 participants recording simultaneously using multiple sensors with sampling frequencies as high as 1000 Hz. We could show that although there is a theoretical limitation to the transmissible data rate, in practice this limitation is not an issue and data loss is rare. We conclude that with modern communication protocols and with the increasingly powerful smartphones and wearables, a system like our SensorHub establishes an interoperability framework to adequately combine consumer-grade sensing hardware which enables observational studies in real life.
first_indexed 2024-03-10T03:19:52Z
format Article
id doaj.art-1b3dbfb22b1a46edb1c8837743f8e71f
institution Directory Open Access Journal
issn 1424-8220
language English
last_indexed 2024-03-10T03:19:52Z
publishDate 2022-01-01
publisher MDPI AG
record_format Article
series Sensors
spelling doaj.art-1b3dbfb22b1a46edb1c8837743f8e71f2023-11-23T12:21:48ZengMDPI AGSensors1424-82202022-01-0122140810.3390/s22010408SensorHub: Multimodal Sensing in Real-Life Enables Home-Based StudiesJonas Chromik0Kristina Kirsten1Arne Herdick2Arpita Mallikarjuna Kappattanavar3Bert Arnrich4Hasso Plattner Institute, University of Potsdam, 14482 Potsdam, GermanyHasso Plattner Institute, University of Potsdam, 14482 Potsdam, GermanyHasso Plattner Institute, University of Potsdam, 14482 Potsdam, GermanyHasso Plattner Institute, University of Potsdam, 14482 Potsdam, GermanyHasso Plattner Institute, University of Potsdam, 14482 Potsdam, GermanyObservational studies are an important tool for determining whether the findings from controlled experiments can be transferred into scenarios that are closer to subjects’ real-life circumstances. A rigorous approach to observational studies involves collecting data from different sensors to comprehensively capture the situation of the subject. However, this leads to technical difficulties especially if the sensors are from different manufacturers, as multiple data collection tools have to run simultaneously. We present SensorHub, a system that can collect data from various wearable devices from different manufacturers, such as inertial measurement units, portable electrocardiographs, portable electroencephalographs, portable photoplethysmographs, and sensors for electrodermal activity. Additionally, our tool offers the possibility to include ecological momentary assessments (EMAs) in studies. Hence, SensorHub enables multimodal sensor data collection under real-world conditions and allows direct user feedback to be collected through questionnaires, enabling studies at home. In a first study with 11 participants, we successfully used SensorHub to record multiple signals with different devices and collected additional information with the help of EMAs. In addition, we evaluated SensorHub’s technical capabilities in several trials with up to 21 participants recording simultaneously using multiple sensors with sampling frequencies as high as 1000 Hz. We could show that although there is a theoretical limitation to the transmissible data rate, in practice this limitation is not an issue and data loss is rare. We conclude that with modern communication protocols and with the increasingly powerful smartphones and wearables, a system like our SensorHub establishes an interoperability framework to adequately combine consumer-grade sensing hardware which enables observational studies in real life.https://www.mdpi.com/1424-8220/22/1/408multimodal sensinghome-based studiesactivity recognitionsensor systemsecological momentary assessmentdigital health
spellingShingle Jonas Chromik
Kristina Kirsten
Arne Herdick
Arpita Mallikarjuna Kappattanavar
Bert Arnrich
SensorHub: Multimodal Sensing in Real-Life Enables Home-Based Studies
Sensors
multimodal sensing
home-based studies
activity recognition
sensor systems
ecological momentary assessment
digital health
title SensorHub: Multimodal Sensing in Real-Life Enables Home-Based Studies
title_full SensorHub: Multimodal Sensing in Real-Life Enables Home-Based Studies
title_fullStr SensorHub: Multimodal Sensing in Real-Life Enables Home-Based Studies
title_full_unstemmed SensorHub: Multimodal Sensing in Real-Life Enables Home-Based Studies
title_short SensorHub: Multimodal Sensing in Real-Life Enables Home-Based Studies
title_sort sensorhub multimodal sensing in real life enables home based studies
topic multimodal sensing
home-based studies
activity recognition
sensor systems
ecological momentary assessment
digital health
url https://www.mdpi.com/1424-8220/22/1/408
work_keys_str_mv AT jonaschromik sensorhubmultimodalsensinginreallifeenableshomebasedstudies
AT kristinakirsten sensorhubmultimodalsensinginreallifeenableshomebasedstudies
AT arneherdick sensorhubmultimodalsensinginreallifeenableshomebasedstudies
AT arpitamallikarjunakappattanavar sensorhubmultimodalsensinginreallifeenableshomebasedstudies
AT bertarnrich sensorhubmultimodalsensinginreallifeenableshomebasedstudies