A systematic review of school health policy measurement tools: implementation determinants and outcomes
Abstract Background Governments in some countries or states/provinces mandate school-based policies intended to improve the health and well-being of primary and secondary students and in some cases the health of school staff. Examples include mandating a minimum time spent per week in programmed phy...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
BMC
2021-06-01
|
| Series: | Implementation Science Communications |
| Subjects: | |
| Online Access: | https://doi.org/10.1186/s43058-021-00169-y |
| _version_ | 1818441019893481472 |
|---|---|
| author | Gabriella M. McLoughlin Peg Allen Callie Walsh-Bailey Ross C. Brownson |
| author_facet | Gabriella M. McLoughlin Peg Allen Callie Walsh-Bailey Ross C. Brownson |
| author_sort | Gabriella M. McLoughlin |
| collection | DOAJ |
| description | Abstract Background Governments in some countries or states/provinces mandate school-based policies intended to improve the health and well-being of primary and secondary students and in some cases the health of school staff. Examples include mandating a minimum time spent per week in programmed physical activity, mandating provision of healthy foods and limiting fat content of school meals, and banning tobacco products or use on school campuses. Although school health researchers have studied whether schools, districts, or states/provinces are meeting requirements, it is unclear to what extent implementation processes and determinants are assessed. The purposes of the present systematic review of quantitative measures of school policy implementation were to (1) identify quantitative school health policy measurement tools developed to measure implementation at the school, district, or state/provincial levels; (2) describe the policy implementation outcomes and determinants assessed and identify the trends in measurement; and (3) assess pragmatic and psychometric properties of identified implementation measures to understand their quality and suitability for broader application. Methods Peer-reviewed journal articles published 1995–2020 were included if they (1) had multiple-item quantitative measures of school policy implementation and (2) addressed overall wellness, tobacco, physical activity, nutrition, obesity prevention, or mental health/bullying/social-emotional learning. The final sample comprised 86 measurement tools from 67 peer-review articles. We extracted study characteristics, such as psychometric and pragmatic measure properties, from included articles based on three frameworks: (1) Implementation Outcomes Framework, (2) Consolidated Framework for Implementation Research, and (3) Policy Implementation Determinants Framework. Results Most implementation tools were developed to measure overall wellness policies which combined multiple policy topics (n = 35, 40%) and were in survey form (n = 75, 87%). Fidelity was the most frequently prevalent implementation outcome (n = 70, 81%), followed by adoption (n = 32, 81%). The implementation determinants most assessed were readiness for implementation, including resources (n = 43, 50%), leadership (n = 42, 49%), and policy communication (n = 41, 48%). Overall, measures were low-cost and had easy readability. However, lengthy tools and lack of reported validity/reliability data indicate low transferability. Conclusions Implementation science can contribute to more complete and rigorous assessment of school health policy implementation processes, which can improve implementation strategies and ultimately the intended health benefits. Several high-quality measures of implementation determinants and implementation outcomes can be applied to school health policy implementation assessment. Dissemination and implementation science researchers can also benefit from measurement experiences of school health researchers. |
| first_indexed | 2024-12-14T18:21:36Z |
| format | Article |
| id | doaj.art-41962a422fd4419d8056e94d43c6d235 |
| institution | Directory Open Access Journal |
| issn | 2662-2211 |
| language | English |
| last_indexed | 2024-12-14T18:21:36Z |
| publishDate | 2021-06-01 |
| publisher | BMC |
| record_format | Article |
| series | Implementation Science Communications |
| spelling | doaj.art-41962a422fd4419d8056e94d43c6d2352022-12-21T22:52:03ZengBMCImplementation Science Communications2662-22112021-06-012111510.1186/s43058-021-00169-yA systematic review of school health policy measurement tools: implementation determinants and outcomesGabriella M. McLoughlin0Peg Allen1Callie Walsh-Bailey2Ross C. Brownson3Implementation Science Center for Cancer Control (WU-ISC3) and Prevention Research Center, Brown School, Washington University in St. LouisImplementation Science Center for Cancer Control (WU-ISC3) and Prevention Research Center, Brown School, Washington University in St. LouisImplementation Science Center for Cancer Control (WU-ISC3) and Prevention Research Center, Brown School, Washington University in St. LouisImplementation Science Center for Cancer Control (WU-ISC3) and Prevention Research Center, Brown School, Washington University in St. LouisAbstract Background Governments in some countries or states/provinces mandate school-based policies intended to improve the health and well-being of primary and secondary students and in some cases the health of school staff. Examples include mandating a minimum time spent per week in programmed physical activity, mandating provision of healthy foods and limiting fat content of school meals, and banning tobacco products or use on school campuses. Although school health researchers have studied whether schools, districts, or states/provinces are meeting requirements, it is unclear to what extent implementation processes and determinants are assessed. The purposes of the present systematic review of quantitative measures of school policy implementation were to (1) identify quantitative school health policy measurement tools developed to measure implementation at the school, district, or state/provincial levels; (2) describe the policy implementation outcomes and determinants assessed and identify the trends in measurement; and (3) assess pragmatic and psychometric properties of identified implementation measures to understand their quality and suitability for broader application. Methods Peer-reviewed journal articles published 1995–2020 were included if they (1) had multiple-item quantitative measures of school policy implementation and (2) addressed overall wellness, tobacco, physical activity, nutrition, obesity prevention, or mental health/bullying/social-emotional learning. The final sample comprised 86 measurement tools from 67 peer-review articles. We extracted study characteristics, such as psychometric and pragmatic measure properties, from included articles based on three frameworks: (1) Implementation Outcomes Framework, (2) Consolidated Framework for Implementation Research, and (3) Policy Implementation Determinants Framework. Results Most implementation tools were developed to measure overall wellness policies which combined multiple policy topics (n = 35, 40%) and were in survey form (n = 75, 87%). Fidelity was the most frequently prevalent implementation outcome (n = 70, 81%), followed by adoption (n = 32, 81%). The implementation determinants most assessed were readiness for implementation, including resources (n = 43, 50%), leadership (n = 42, 49%), and policy communication (n = 41, 48%). Overall, measures were low-cost and had easy readability. However, lengthy tools and lack of reported validity/reliability data indicate low transferability. Conclusions Implementation science can contribute to more complete and rigorous assessment of school health policy implementation processes, which can improve implementation strategies and ultimately the intended health benefits. Several high-quality measures of implementation determinants and implementation outcomes can be applied to school health policy implementation assessment. Dissemination and implementation science researchers can also benefit from measurement experiences of school health researchers.https://doi.org/10.1186/s43058-021-00169-yDissemination and implementationHealth promotionMeasurementPolicySchools |
| spellingShingle | Gabriella M. McLoughlin Peg Allen Callie Walsh-Bailey Ross C. Brownson A systematic review of school health policy measurement tools: implementation determinants and outcomes Implementation Science Communications Dissemination and implementation Health promotion Measurement Policy Schools |
| title | A systematic review of school health policy measurement tools: implementation determinants and outcomes |
| title_full | A systematic review of school health policy measurement tools: implementation determinants and outcomes |
| title_fullStr | A systematic review of school health policy measurement tools: implementation determinants and outcomes |
| title_full_unstemmed | A systematic review of school health policy measurement tools: implementation determinants and outcomes |
| title_short | A systematic review of school health policy measurement tools: implementation determinants and outcomes |
| title_sort | systematic review of school health policy measurement tools implementation determinants and outcomes |
| topic | Dissemination and implementation Health promotion Measurement Policy Schools |
| url | https://doi.org/10.1186/s43058-021-00169-y |
| work_keys_str_mv | AT gabriellammcloughlin asystematicreviewofschoolhealthpolicymeasurementtoolsimplementationdeterminantsandoutcomes AT pegallen asystematicreviewofschoolhealthpolicymeasurementtoolsimplementationdeterminantsandoutcomes AT calliewalshbailey asystematicreviewofschoolhealthpolicymeasurementtoolsimplementationdeterminantsandoutcomes AT rosscbrownson asystematicreviewofschoolhealthpolicymeasurementtoolsimplementationdeterminantsandoutcomes AT gabriellammcloughlin systematicreviewofschoolhealthpolicymeasurementtoolsimplementationdeterminantsandoutcomes AT pegallen systematicreviewofschoolhealthpolicymeasurementtoolsimplementationdeterminantsandoutcomes AT calliewalshbailey systematicreviewofschoolhealthpolicymeasurementtoolsimplementationdeterminantsandoutcomes AT rosscbrownson systematicreviewofschoolhealthpolicymeasurementtoolsimplementationdeterminantsandoutcomes |