Investigating Receptivity and Affect Using Machine Learning: Ecological Momentary Assessment and Wearable Sensing Study
BackgroundAs mobile health (mHealth) studies become increasingly productive owing to the advancements in wearable and mobile sensor technology, our ability to monitor and model human behavior will be constrained by participant receptivity. Many health constructs are dependent...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
JMIR Publications
2024-02-01
|
| Series: | JMIR mHealth and uHealth |
| Online Access: | https://mhealth.jmir.org/2024/1/e46347 |
| _version_ | 1827356303080554496 |
|---|---|
| author | Zachary D King Han Yu Thomas Vaessen Inez Myin-Germeys Akane Sano |
| author_facet | Zachary D King Han Yu Thomas Vaessen Inez Myin-Germeys Akane Sano |
| author_sort | Zachary D King |
| collection | DOAJ |
| description |
BackgroundAs mobile health (mHealth) studies become increasingly productive owing to the advancements in wearable and mobile sensor technology, our ability to monitor and model human behavior will be constrained by participant receptivity. Many health constructs are dependent on subjective responses, and without such responses, researchers are left with little to no ground truth to accompany our ever-growing biobehavioral data. This issue can significantly impact the quality of a study, particularly for populations known to exhibit lower compliance rates. To address this challenge, researchers have proposed innovative approaches that use machine learning (ML) and sensor data to modify the timing and delivery of surveys. However, an overarching concern is the potential introduction of biases or unintended influences on participants’ responses when implementing new survey delivery methods.
ObjectiveThis study aims to demonstrate the potential impact of an ML-based ecological momentary assessment (EMA) delivery system (using receptivity as the predictor variable) on the participants’ reported emotional state. We examine the factors that affect participants’ receptivity to EMAs in a 10-day wearable and EMA–based emotional state–sensing mHealth study. We study the physiological relationships indicative of receptivity and affect while also analyzing the interaction between the 2 constructs.
MethodsWe collected data from 45 healthy participants wearing 2 devices measuring electrodermal activity, accelerometer, electrocardiography, and skin temperature while answering 10 EMAs daily, containing questions about perceived mood. Owing to the nature of our constructs, we can only obtain ground truth measures for both affect and receptivity during responses. Therefore, we used unsupervised and supervised ML methods to infer affect when a participant did not respond. Our unsupervised method used k-means clustering to determine the relationship between physiology and receptivity and then inferred the emotional state during nonresponses. For the supervised learning method, we primarily used random forest and neural networks to predict the affect of unlabeled data points as well as receptivity.
ResultsOur findings showed that using a receptivity model to trigger EMAs decreased the reported negative affect by >3 points or 0.29 SDs in our self-reported affect measure, scored between 13 and 91. The findings also showed a bimodal distribution of our predicted affect during nonresponses. This indicates that this system initiates EMAs more commonly during states of higher positive emotions.
ConclusionsOur results showed a clear relationship between affect and receptivity. This relationship can affect the efficacy of an mHealth study, particularly those that use an ML algorithm to trigger EMAs. Therefore, we propose that future work should focus on a smart trigger that promotes EMA receptivity without influencing affect during sampled time points. |
| first_indexed | 2024-03-08T04:57:51Z |
| format | Article |
| id | doaj.art-caf4a1e92a304710872c2e630b98ffa3 |
| institution | Directory Open Access Journal |
| issn | 2291-5222 |
| language | English |
| last_indexed | 2024-03-08T04:57:51Z |
| publishDate | 2024-02-01 |
| publisher | JMIR Publications |
| record_format | Article |
| series | JMIR mHealth and uHealth |
| spelling | doaj.art-caf4a1e92a304710872c2e630b98ffa32024-02-07T15:00:45ZengJMIR PublicationsJMIR mHealth and uHealth2291-52222024-02-0112e4634710.2196/46347Investigating Receptivity and Affect Using Machine Learning: Ecological Momentary Assessment and Wearable Sensing StudyZachary D Kinghttps://orcid.org/0000-0002-3826-2909Han Yuhttps://orcid.org/0000-0003-1944-4173Thomas Vaessenhttps://orcid.org/0000-0002-9300-3117Inez Myin-Germeyshttps://orcid.org/0000-0002-3731-4930Akane Sanohttps://orcid.org/0000-0003-4484-8946 BackgroundAs mobile health (mHealth) studies become increasingly productive owing to the advancements in wearable and mobile sensor technology, our ability to monitor and model human behavior will be constrained by participant receptivity. Many health constructs are dependent on subjective responses, and without such responses, researchers are left with little to no ground truth to accompany our ever-growing biobehavioral data. This issue can significantly impact the quality of a study, particularly for populations known to exhibit lower compliance rates. To address this challenge, researchers have proposed innovative approaches that use machine learning (ML) and sensor data to modify the timing and delivery of surveys. However, an overarching concern is the potential introduction of biases or unintended influences on participants’ responses when implementing new survey delivery methods. ObjectiveThis study aims to demonstrate the potential impact of an ML-based ecological momentary assessment (EMA) delivery system (using receptivity as the predictor variable) on the participants’ reported emotional state. We examine the factors that affect participants’ receptivity to EMAs in a 10-day wearable and EMA–based emotional state–sensing mHealth study. We study the physiological relationships indicative of receptivity and affect while also analyzing the interaction between the 2 constructs. MethodsWe collected data from 45 healthy participants wearing 2 devices measuring electrodermal activity, accelerometer, electrocardiography, and skin temperature while answering 10 EMAs daily, containing questions about perceived mood. Owing to the nature of our constructs, we can only obtain ground truth measures for both affect and receptivity during responses. Therefore, we used unsupervised and supervised ML methods to infer affect when a participant did not respond. Our unsupervised method used k-means clustering to determine the relationship between physiology and receptivity and then inferred the emotional state during nonresponses. For the supervised learning method, we primarily used random forest and neural networks to predict the affect of unlabeled data points as well as receptivity. ResultsOur findings showed that using a receptivity model to trigger EMAs decreased the reported negative affect by >3 points or 0.29 SDs in our self-reported affect measure, scored between 13 and 91. The findings also showed a bimodal distribution of our predicted affect during nonresponses. This indicates that this system initiates EMAs more commonly during states of higher positive emotions. ConclusionsOur results showed a clear relationship between affect and receptivity. This relationship can affect the efficacy of an mHealth study, particularly those that use an ML algorithm to trigger EMAs. Therefore, we propose that future work should focus on a smart trigger that promotes EMA receptivity without influencing affect during sampled time points.https://mhealth.jmir.org/2024/1/e46347 |
| spellingShingle | Zachary D King Han Yu Thomas Vaessen Inez Myin-Germeys Akane Sano Investigating Receptivity and Affect Using Machine Learning: Ecological Momentary Assessment and Wearable Sensing Study JMIR mHealth and uHealth |
| title | Investigating Receptivity and Affect Using Machine Learning: Ecological Momentary Assessment and Wearable Sensing Study |
| title_full | Investigating Receptivity and Affect Using Machine Learning: Ecological Momentary Assessment and Wearable Sensing Study |
| title_fullStr | Investigating Receptivity and Affect Using Machine Learning: Ecological Momentary Assessment and Wearable Sensing Study |
| title_full_unstemmed | Investigating Receptivity and Affect Using Machine Learning: Ecological Momentary Assessment and Wearable Sensing Study |
| title_short | Investigating Receptivity and Affect Using Machine Learning: Ecological Momentary Assessment and Wearable Sensing Study |
| title_sort | investigating receptivity and affect using machine learning ecological momentary assessment and wearable sensing study |
| url | https://mhealth.jmir.org/2024/1/e46347 |
| work_keys_str_mv | AT zacharydking investigatingreceptivityandaffectusingmachinelearningecologicalmomentaryassessmentandwearablesensingstudy AT hanyu investigatingreceptivityandaffectusingmachinelearningecologicalmomentaryassessmentandwearablesensingstudy AT thomasvaessen investigatingreceptivityandaffectusingmachinelearningecologicalmomentaryassessmentandwearablesensingstudy AT inezmyingermeys investigatingreceptivityandaffectusingmachinelearningecologicalmomentaryassessmentandwearablesensingstudy AT akanesano investigatingreceptivityandaffectusingmachinelearningecologicalmomentaryassessmentandwearablesensingstudy |