A Novel Experience Sampling Method Tool Integrating Momentary Assessments of Cognitive Biases: Two Compliance, Usability, and Measurement Reactivity Studies
BackgroundExperience sampling methods (ESMs) are increasingly being used to study ecological emotion dynamics in daily functioning through repeated assessments taken over several days. However, most of these ESM approaches are only based on self-report assessments, and theref...
| Main Authors: | , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
JMIR Publications
2022-03-01
|
| Series: | JMIR Formative Research |
| Online Access: | https://formative.jmir.org/2022/3/e32537 |
| _version_ | 1797735206835191808 |
|---|---|
| author | Teresa Boemo Angela Socastro Ivan Blanco Oscar Martin-Garcia Ana Mar Pacheco-Romero Raquel Rodríguez-Carvajal Alvaro Sanchez-Lopez |
| author_facet | Teresa Boemo Angela Socastro Ivan Blanco Oscar Martin-Garcia Ana Mar Pacheco-Romero Raquel Rodríguez-Carvajal Alvaro Sanchez-Lopez |
| author_sort | Teresa Boemo |
| collection | DOAJ |
| description |
BackgroundExperience sampling methods (ESMs) are increasingly being used to study ecological emotion dynamics in daily functioning through repeated assessments taken over several days. However, most of these ESM approaches are only based on self-report assessments, and therefore, studies on the ecological trajectories of their underlying mechanisms are scarce (ie, cognitive biases) and require evaluation through experimental tasks. We developed a novel ESM tool that integrates self-report measures of emotion and emotion regulation with a previously validated app-based cognitive task that allows for the assessment of underlying mechanisms during daily functioning.
ObjectiveThe objective of the study is to test this new tool and study its usability and the possible factors related to compliance with it in terms of latency and missing responses. Among the compliance predictors, we considered psychological and time-related variables, as well as usability, measurement reactivity, and participants’ satisfaction with the tool.
MethodsWe conducted 2 extensive ESM studies—study 1 (N=84; a total of 3 assessments per day for 5 days) and study 2 (N=135; a total of 3 assessments per day for 10 days).
ResultsIn both studies, participants found the tool highly usable (average usability score >81). By using mixed regression models, we found both common and specific results for the compliance predictors. In both study 1 and study 2, latency was significantly predicted by the day (P<.001 and P=.003, respectively). Participants showed slower responses to the notification as the days of the study progressed. In study 2 but not in study 1, latency was further predicted by individual differences in overload with the use of the app, and missing responses were accounted for by individual differences in stress reactivity to notifications (P=.04). Thus, by using a more extensive design, participants who experienced higher overload during the study were characterized by slower responses to notifications (P=.01), whereas those who experienced higher stress reactivity to the notification system were characterized by higher missing responses.
ConclusionsThe new tool had high levels of usability. Furthermore, the study of compliance is of enormous importance when implementing novel ESM methods, including app-based cognitive tasks. The main predictors of latency and missing responses found across studies, specifically when using extensive ESM protocols (study 2), are methodology-related variables. Future research that integrates cognitive tasks in ESM designs should take these results into consideration by performing accurate estimations of participants’ response rates to facilitate the optimal quality of novel eHealth approaches, as in this study. |
| first_indexed | 2024-03-12T12:55:41Z |
| format | Article |
| id | doaj.art-895c473eac6749c0ae8f7ca222f7bc43 |
| institution | Directory Open Access Journal |
| issn | 2561-326X |
| language | English |
| last_indexed | 2024-03-12T12:55:41Z |
| publishDate | 2022-03-01 |
| publisher | JMIR Publications |
| record_format | Article |
| series | JMIR Formative Research |
| spelling | doaj.art-895c473eac6749c0ae8f7ca222f7bc432023-08-28T21:10:06ZengJMIR PublicationsJMIR Formative Research2561-326X2022-03-0163e3253710.2196/32537A Novel Experience Sampling Method Tool Integrating Momentary Assessments of Cognitive Biases: Two Compliance, Usability, and Measurement Reactivity StudiesTeresa Boemohttps://orcid.org/0000-0002-5543-2914Angela Socastrohttps://orcid.org/0000-0002-1777-258XIvan Blancohttps://orcid.org/0000-0003-3611-5814Oscar Martin-Garciahttps://orcid.org/0000-0003-3620-9896Ana Mar Pacheco-Romerohttps://orcid.org/0000-0001-6164-1918Raquel Rodríguez-Carvajalhttps://orcid.org/0000-0001-9015-5425Alvaro Sanchez-Lopezhttps://orcid.org/0000-0003-2815-7803 BackgroundExperience sampling methods (ESMs) are increasingly being used to study ecological emotion dynamics in daily functioning through repeated assessments taken over several days. However, most of these ESM approaches are only based on self-report assessments, and therefore, studies on the ecological trajectories of their underlying mechanisms are scarce (ie, cognitive biases) and require evaluation through experimental tasks. We developed a novel ESM tool that integrates self-report measures of emotion and emotion regulation with a previously validated app-based cognitive task that allows for the assessment of underlying mechanisms during daily functioning. ObjectiveThe objective of the study is to test this new tool and study its usability and the possible factors related to compliance with it in terms of latency and missing responses. Among the compliance predictors, we considered psychological and time-related variables, as well as usability, measurement reactivity, and participants’ satisfaction with the tool. MethodsWe conducted 2 extensive ESM studies—study 1 (N=84; a total of 3 assessments per day for 5 days) and study 2 (N=135; a total of 3 assessments per day for 10 days). ResultsIn both studies, participants found the tool highly usable (average usability score >81). By using mixed regression models, we found both common and specific results for the compliance predictors. In both study 1 and study 2, latency was significantly predicted by the day (P<.001 and P=.003, respectively). Participants showed slower responses to the notification as the days of the study progressed. In study 2 but not in study 1, latency was further predicted by individual differences in overload with the use of the app, and missing responses were accounted for by individual differences in stress reactivity to notifications (P=.04). Thus, by using a more extensive design, participants who experienced higher overload during the study were characterized by slower responses to notifications (P=.01), whereas those who experienced higher stress reactivity to the notification system were characterized by higher missing responses. ConclusionsThe new tool had high levels of usability. Furthermore, the study of compliance is of enormous importance when implementing novel ESM methods, including app-based cognitive tasks. The main predictors of latency and missing responses found across studies, specifically when using extensive ESM protocols (study 2), are methodology-related variables. Future research that integrates cognitive tasks in ESM designs should take these results into consideration by performing accurate estimations of participants’ response rates to facilitate the optimal quality of novel eHealth approaches, as in this study.https://formative.jmir.org/2022/3/e32537 |
| spellingShingle | Teresa Boemo Angela Socastro Ivan Blanco Oscar Martin-Garcia Ana Mar Pacheco-Romero Raquel Rodríguez-Carvajal Alvaro Sanchez-Lopez A Novel Experience Sampling Method Tool Integrating Momentary Assessments of Cognitive Biases: Two Compliance, Usability, and Measurement Reactivity Studies JMIR Formative Research |
| title | A Novel Experience Sampling Method Tool Integrating Momentary Assessments of Cognitive Biases: Two Compliance, Usability, and Measurement Reactivity Studies |
| title_full | A Novel Experience Sampling Method Tool Integrating Momentary Assessments of Cognitive Biases: Two Compliance, Usability, and Measurement Reactivity Studies |
| title_fullStr | A Novel Experience Sampling Method Tool Integrating Momentary Assessments of Cognitive Biases: Two Compliance, Usability, and Measurement Reactivity Studies |
| title_full_unstemmed | A Novel Experience Sampling Method Tool Integrating Momentary Assessments of Cognitive Biases: Two Compliance, Usability, and Measurement Reactivity Studies |
| title_short | A Novel Experience Sampling Method Tool Integrating Momentary Assessments of Cognitive Biases: Two Compliance, Usability, and Measurement Reactivity Studies |
| title_sort | novel experience sampling method tool integrating momentary assessments of cognitive biases two compliance usability and measurement reactivity studies |
| url | https://formative.jmir.org/2022/3/e32537 |
| work_keys_str_mv | AT teresaboemo anovelexperiencesamplingmethodtoolintegratingmomentaryassessmentsofcognitivebiasestwocomplianceusabilityandmeasurementreactivitystudies AT angelasocastro anovelexperiencesamplingmethodtoolintegratingmomentaryassessmentsofcognitivebiasestwocomplianceusabilityandmeasurementreactivitystudies AT ivanblanco anovelexperiencesamplingmethodtoolintegratingmomentaryassessmentsofcognitivebiasestwocomplianceusabilityandmeasurementreactivitystudies AT oscarmartingarcia anovelexperiencesamplingmethodtoolintegratingmomentaryassessmentsofcognitivebiasestwocomplianceusabilityandmeasurementreactivitystudies AT anamarpachecoromero anovelexperiencesamplingmethodtoolintegratingmomentaryassessmentsofcognitivebiasestwocomplianceusabilityandmeasurementreactivitystudies AT raquelrodriguezcarvajal anovelexperiencesamplingmethodtoolintegratingmomentaryassessmentsofcognitivebiasestwocomplianceusabilityandmeasurementreactivitystudies AT alvarosanchezlopez anovelexperiencesamplingmethodtoolintegratingmomentaryassessmentsofcognitivebiasestwocomplianceusabilityandmeasurementreactivitystudies AT teresaboemo novelexperiencesamplingmethodtoolintegratingmomentaryassessmentsofcognitivebiasestwocomplianceusabilityandmeasurementreactivitystudies AT angelasocastro novelexperiencesamplingmethodtoolintegratingmomentaryassessmentsofcognitivebiasestwocomplianceusabilityandmeasurementreactivitystudies AT ivanblanco novelexperiencesamplingmethodtoolintegratingmomentaryassessmentsofcognitivebiasestwocomplianceusabilityandmeasurementreactivitystudies AT oscarmartingarcia novelexperiencesamplingmethodtoolintegratingmomentaryassessmentsofcognitivebiasestwocomplianceusabilityandmeasurementreactivitystudies AT anamarpachecoromero novelexperiencesamplingmethodtoolintegratingmomentaryassessmentsofcognitivebiasestwocomplianceusabilityandmeasurementreactivitystudies AT raquelrodriguezcarvajal novelexperiencesamplingmethodtoolintegratingmomentaryassessmentsofcognitivebiasestwocomplianceusabilityandmeasurementreactivitystudies AT alvarosanchezlopez novelexperiencesamplingmethodtoolintegratingmomentaryassessmentsofcognitivebiasestwocomplianceusabilityandmeasurementreactivitystudies |