Content validity and methodological considerations in ecological momentary assessment studies on physical activity and sedentary behaviour: a systematic review
Abstract Background Ecological momentary assessment (EMA) is a method of collecting real-time data based on repeated measures and observations that take place in participant’s daily environment. EMA has many advantages over more traditional, retrospective questionnaires. However, EMA faces some chal...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
BMC
2020-03-01
|
| Series: | International Journal of Behavioral Nutrition and Physical Activity |
| Subjects: | |
| Online Access: | http://link.springer.com/article/10.1186/s12966-020-00932-9 |
| _version_ | 1818536486561120256 |
|---|---|
| author | L. Degroote A. DeSmet I. De Bourdeaudhuij D. Van Dyck G. Crombez |
| author_facet | L. Degroote A. DeSmet I. De Bourdeaudhuij D. Van Dyck G. Crombez |
| author_sort | L. Degroote |
| collection | DOAJ |
| description | Abstract Background Ecological momentary assessment (EMA) is a method of collecting real-time data based on repeated measures and observations that take place in participant’s daily environment. EMA has many advantages over more traditional, retrospective questionnaires. However, EMA faces some challenges to reach its full potential. The aims of this systematic review are to (1) investigate whether and how content validity of the items (i.e. the specific questions that are part of a larger EMA questionnaire) used in EMA studies on physical activity and sedentary behaviour was assessed, and (2) provide an overview of important methodological considerations of EMA in measuring physical activity and sedentary behaviour. Methods Thirty papers (twenty unique studies) were systematically reviewed and variables were coded and analysed within the following 4 domains: (1) Content validity, (2) Sampling approach, (3) Data input modalities and (4) Degree of EMA completion. Results Only about half of the studies reported the specific items (n = 12) and the source of the items (n = 11). None of the studies specifically assessed the content validity of the items used. Only a minority (n = 5) of the studies reported any training, and one tested the comprehensibility of the EMA items. A wide variability was found in the design and methodology of the EMA. A minority of the studies (n = 7) reported a rationale for the used prompt frequency, time selection, and monitoring period. Retrospective assessment periods varied from ‘now’ to ‘in the last 3.5 hours’. In some studies there was a possibility to delay (n = 6) or deactivate (n = 10) the prompt, and some provided reminders after the first prompt (n = 9). Conclusions Almost no EMA studies reported the content validation of the items used. We recommend using the COSMIN checklist (COnsensus-based Standards for the selection of health Measurement INstruments) to report on the content validity of EMA items. Furthermore, as often no rationale was provided for several methodological decisions, the following three recommendations are made. First, provide a rationale for choosing the sampling modalities. Second, to ensure assessment ‘in the moment’, think carefully about the retrospective assessment period, reminders, and deactivation of the prompt. Third, as high completion rates are important for representativeness of the data and generalizability of the findings, report completion rates. Trial registration This review is registered in PROSPERO, the International prospective register of systematic reviews (registration number: CRD42017077996 ). |
| first_indexed | 2024-12-11T18:38:35Z |
| format | Article |
| id | doaj.art-036c015d1a494f4fb7a1d5a6579ccda4 |
| institution | Directory Open Access Journal |
| issn | 1479-5868 |
| language | English |
| last_indexed | 2024-12-11T18:38:35Z |
| publishDate | 2020-03-01 |
| publisher | BMC |
| record_format | Article |
| series | International Journal of Behavioral Nutrition and Physical Activity |
| spelling | doaj.art-036c015d1a494f4fb7a1d5a6579ccda42022-12-22T00:54:41ZengBMCInternational Journal of Behavioral Nutrition and Physical Activity1479-58682020-03-0117111310.1186/s12966-020-00932-9Content validity and methodological considerations in ecological momentary assessment studies on physical activity and sedentary behaviour: a systematic reviewL. Degroote0A. DeSmet1I. De Bourdeaudhuij2D. Van Dyck3G. Crombez4Department of Movement and Sport Sciences, Ghent UniversityDepartment of Movement and Sport Sciences, Ghent UniversityDepartment of Movement and Sport Sciences, Ghent UniversityDepartment of Movement and Sport Sciences, Ghent UniversityDepartment of Clinical-Experimental Health Psychology, Ghent UniversityAbstract Background Ecological momentary assessment (EMA) is a method of collecting real-time data based on repeated measures and observations that take place in participant’s daily environment. EMA has many advantages over more traditional, retrospective questionnaires. However, EMA faces some challenges to reach its full potential. The aims of this systematic review are to (1) investigate whether and how content validity of the items (i.e. the specific questions that are part of a larger EMA questionnaire) used in EMA studies on physical activity and sedentary behaviour was assessed, and (2) provide an overview of important methodological considerations of EMA in measuring physical activity and sedentary behaviour. Methods Thirty papers (twenty unique studies) were systematically reviewed and variables were coded and analysed within the following 4 domains: (1) Content validity, (2) Sampling approach, (3) Data input modalities and (4) Degree of EMA completion. Results Only about half of the studies reported the specific items (n = 12) and the source of the items (n = 11). None of the studies specifically assessed the content validity of the items used. Only a minority (n = 5) of the studies reported any training, and one tested the comprehensibility of the EMA items. A wide variability was found in the design and methodology of the EMA. A minority of the studies (n = 7) reported a rationale for the used prompt frequency, time selection, and monitoring period. Retrospective assessment periods varied from ‘now’ to ‘in the last 3.5 hours’. In some studies there was a possibility to delay (n = 6) or deactivate (n = 10) the prompt, and some provided reminders after the first prompt (n = 9). Conclusions Almost no EMA studies reported the content validation of the items used. We recommend using the COSMIN checklist (COnsensus-based Standards for the selection of health Measurement INstruments) to report on the content validity of EMA items. Furthermore, as often no rationale was provided for several methodological decisions, the following three recommendations are made. First, provide a rationale for choosing the sampling modalities. Second, to ensure assessment ‘in the moment’, think carefully about the retrospective assessment period, reminders, and deactivation of the prompt. Third, as high completion rates are important for representativeness of the data and generalizability of the findings, report completion rates. Trial registration This review is registered in PROSPERO, the International prospective register of systematic reviews (registration number: CRD42017077996 ).http://link.springer.com/article/10.1186/s12966-020-00932-9Ecological momentary assessmentContent validityMethodological considerationsPhysical activitySedentary behaviour |
| spellingShingle | L. Degroote A. DeSmet I. De Bourdeaudhuij D. Van Dyck G. Crombez Content validity and methodological considerations in ecological momentary assessment studies on physical activity and sedentary behaviour: a systematic review International Journal of Behavioral Nutrition and Physical Activity Ecological momentary assessment Content validity Methodological considerations Physical activity Sedentary behaviour |
| title | Content validity and methodological considerations in ecological momentary assessment studies on physical activity and sedentary behaviour: a systematic review |
| title_full | Content validity and methodological considerations in ecological momentary assessment studies on physical activity and sedentary behaviour: a systematic review |
| title_fullStr | Content validity and methodological considerations in ecological momentary assessment studies on physical activity and sedentary behaviour: a systematic review |
| title_full_unstemmed | Content validity and methodological considerations in ecological momentary assessment studies on physical activity and sedentary behaviour: a systematic review |
| title_short | Content validity and methodological considerations in ecological momentary assessment studies on physical activity and sedentary behaviour: a systematic review |
| title_sort | content validity and methodological considerations in ecological momentary assessment studies on physical activity and sedentary behaviour a systematic review |
| topic | Ecological momentary assessment Content validity Methodological considerations Physical activity Sedentary behaviour |
| url | http://link.springer.com/article/10.1186/s12966-020-00932-9 |
| work_keys_str_mv | AT ldegroote contentvalidityandmethodologicalconsiderationsinecologicalmomentaryassessmentstudiesonphysicalactivityandsedentarybehaviourasystematicreview AT adesmet contentvalidityandmethodologicalconsiderationsinecologicalmomentaryassessmentstudiesonphysicalactivityandsedentarybehaviourasystematicreview AT idebourdeaudhuij contentvalidityandmethodologicalconsiderationsinecologicalmomentaryassessmentstudiesonphysicalactivityandsedentarybehaviourasystematicreview AT dvandyck contentvalidityandmethodologicalconsiderationsinecologicalmomentaryassessmentstudiesonphysicalactivityandsedentarybehaviourasystematicreview AT gcrombez contentvalidityandmethodologicalconsiderationsinecologicalmomentaryassessmentstudiesonphysicalactivityandsedentarybehaviourasystematicreview |