Assessing the Internal and External Validity of Mobile Health Physical Activity Promotion Interventions: A Systematic Literature Review Using the RE-AIM Framework
BackgroundMobile health (mHealth) interventions are effective in promoting physical activity (PA); however, the degree to which external validity indicators are reported is unclear. ObjectiveThe purpose of this systematic review was to use the RE-AIM (reach, effectiveness, adoption, impl...
| Main Authors: | , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
JMIR Publications
2013-10-01
|
| Series: | Journal of Medical Internet Research |
| Online Access: | http://www.jmir.org/2013/10/e224/ |
| _version_ | 1818892611755180032 |
|---|---|
| author | Blackman, Kacie CA Zoellner, Jamie Berrey, Leanna M Alexander, Ramine Fanning, Jason Hill, Jennie L Estabrooks, Paul A |
| author_facet | Blackman, Kacie CA Zoellner, Jamie Berrey, Leanna M Alexander, Ramine Fanning, Jason Hill, Jennie L Estabrooks, Paul A |
| author_sort | Blackman, Kacie CA |
| collection | DOAJ |
| description | BackgroundMobile health (mHealth) interventions are effective in promoting physical activity (PA); however, the degree to which external validity indicators are reported is unclear.
ObjectiveThe purpose of this systematic review was to use the RE-AIM (reach, effectiveness, adoption, implementation, and maintenance) framework to determine the extent to which mHealth intervention research for promoting PA reports on factors that inform generalizability across settings and populations and to provide recommendations for investigators planning to conduct this type of research.
MethodsTwenty articles reflecting 15 trials published between 2000 and 2012 were identified through a systematic review process (ie, queries of three online databases and reference lists of eligible articles) and met inclusion criteria (ie, implementation of mobile technologies, target physical activity, and provide original data). Two researchers coded each article using a validated RE-AIM data extraction tool (reach, efficacy/effectiveness, adoption, implementation, maintenance). Two members of the study team independently abstracted information from each article (inter-rater reliability >90%) and group meetings were used to gain consensus on discrepancies.
ResultsThe majority of studies were randomized controlled trials (n=14). The average reporting across RE-AIM indicators varied by dimension (reach=53.3%, 2.67/5; effectiveness/efficacy=60.0%, 2.4/4; adoption=11.1%, 0.7/6; implementation=24.4%, 0.7/3; maintenance=0%, 0/3). While most studies described changes in the primary outcome (effectiveness), few addressed the representativeness of participants (reach) or settings (adoption) and few reported on issues related to maintenance and degree of implementation fidelity.
ConclusionsThis review suggests that more focus is needed on research designs that highlight and report on both internal and external validity indicators. Specific recommendations are provided to encourage future mHealth interventionists and investigators to report on representativeness, settings, delivery agents for planned interventions, the extent to which protocol is delivered as intended, and maintenance of effects at the individual or organizational level. |
| first_indexed | 2024-12-19T17:59:28Z |
| format | Article |
| id | doaj.art-532b5a262e0e4f9390394680501a73bc |
| institution | Directory Open Access Journal |
| issn | 1438-8871 |
| language | English |
| last_indexed | 2024-12-19T17:59:28Z |
| publishDate | 2013-10-01 |
| publisher | JMIR Publications |
| record_format | Article |
| series | Journal of Medical Internet Research |
| spelling | doaj.art-532b5a262e0e4f9390394680501a73bc2022-12-21T20:11:43ZengJMIR PublicationsJournal of Medical Internet Research1438-88712013-10-011510e22410.2196/jmir.2745Assessing the Internal and External Validity of Mobile Health Physical Activity Promotion Interventions: A Systematic Literature Review Using the RE-AIM FrameworkBlackman, Kacie CAZoellner, JamieBerrey, Leanna MAlexander, RamineFanning, JasonHill, Jennie LEstabrooks, Paul ABackgroundMobile health (mHealth) interventions are effective in promoting physical activity (PA); however, the degree to which external validity indicators are reported is unclear. ObjectiveThe purpose of this systematic review was to use the RE-AIM (reach, effectiveness, adoption, implementation, and maintenance) framework to determine the extent to which mHealth intervention research for promoting PA reports on factors that inform generalizability across settings and populations and to provide recommendations for investigators planning to conduct this type of research. MethodsTwenty articles reflecting 15 trials published between 2000 and 2012 were identified through a systematic review process (ie, queries of three online databases and reference lists of eligible articles) and met inclusion criteria (ie, implementation of mobile technologies, target physical activity, and provide original data). Two researchers coded each article using a validated RE-AIM data extraction tool (reach, efficacy/effectiveness, adoption, implementation, maintenance). Two members of the study team independently abstracted information from each article (inter-rater reliability >90%) and group meetings were used to gain consensus on discrepancies. ResultsThe majority of studies were randomized controlled trials (n=14). The average reporting across RE-AIM indicators varied by dimension (reach=53.3%, 2.67/5; effectiveness/efficacy=60.0%, 2.4/4; adoption=11.1%, 0.7/6; implementation=24.4%, 0.7/3; maintenance=0%, 0/3). While most studies described changes in the primary outcome (effectiveness), few addressed the representativeness of participants (reach) or settings (adoption) and few reported on issues related to maintenance and degree of implementation fidelity. ConclusionsThis review suggests that more focus is needed on research designs that highlight and report on both internal and external validity indicators. Specific recommendations are provided to encourage future mHealth interventionists and investigators to report on representativeness, settings, delivery agents for planned interventions, the extent to which protocol is delivered as intended, and maintenance of effects at the individual or organizational level.http://www.jmir.org/2013/10/e224/ |
| spellingShingle | Blackman, Kacie CA Zoellner, Jamie Berrey, Leanna M Alexander, Ramine Fanning, Jason Hill, Jennie L Estabrooks, Paul A Assessing the Internal and External Validity of Mobile Health Physical Activity Promotion Interventions: A Systematic Literature Review Using the RE-AIM Framework Journal of Medical Internet Research |
| title | Assessing the Internal and External Validity of Mobile Health Physical Activity Promotion Interventions: A Systematic Literature Review Using the RE-AIM Framework |
| title_full | Assessing the Internal and External Validity of Mobile Health Physical Activity Promotion Interventions: A Systematic Literature Review Using the RE-AIM Framework |
| title_fullStr | Assessing the Internal and External Validity of Mobile Health Physical Activity Promotion Interventions: A Systematic Literature Review Using the RE-AIM Framework |
| title_full_unstemmed | Assessing the Internal and External Validity of Mobile Health Physical Activity Promotion Interventions: A Systematic Literature Review Using the RE-AIM Framework |
| title_short | Assessing the Internal and External Validity of Mobile Health Physical Activity Promotion Interventions: A Systematic Literature Review Using the RE-AIM Framework |
| title_sort | assessing the internal and external validity of mobile health physical activity promotion interventions a systematic literature review using the re aim framework |
| url | http://www.jmir.org/2013/10/e224/ |
| work_keys_str_mv | AT blackmankacieca assessingtheinternalandexternalvalidityofmobilehealthphysicalactivitypromotioninterventionsasystematicliteraturereviewusingthereaimframework AT zoellnerjamie assessingtheinternalandexternalvalidityofmobilehealthphysicalactivitypromotioninterventionsasystematicliteraturereviewusingthereaimframework AT berreyleannam assessingtheinternalandexternalvalidityofmobilehealthphysicalactivitypromotioninterventionsasystematicliteraturereviewusingthereaimframework AT alexanderramine assessingtheinternalandexternalvalidityofmobilehealthphysicalactivitypromotioninterventionsasystematicliteraturereviewusingthereaimframework AT fanningjason assessingtheinternalandexternalvalidityofmobilehealthphysicalactivitypromotioninterventionsasystematicliteraturereviewusingthereaimframework AT hilljenniel assessingtheinternalandexternalvalidityofmobilehealthphysicalactivitypromotioninterventionsasystematicliteraturereviewusingthereaimframework AT estabrookspaula assessingtheinternalandexternalvalidityofmobilehealthphysicalactivitypromotioninterventionsasystematicliteraturereviewusingthereaimframework |