Measurement properties of a novel survey to assess stages of organizational readiness for evidence-based interventions in community chronic disease prevention settings
<p>Abstract</p> <p>Background</p> <p>There is a great deal of variation in the existing capacity of primary prevention programs and policies addressing chronic disease to deliver evidence-based interventions (EBIs). In order to develop and evaluate implementation strate...
| Main Authors: | , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
BMC
2012-07-01
|
| Series: | Implementation Science |
| Subjects: | |
| Online Access: | http://www.implementationscience.com/content/7/1/65 |
| _version_ | 1828476125858234368 |
|---|---|
| author | Stamatakis Katherine A McQueen Amy Filler Carl Boland Elizabeth Dreisinger Mariah Brownson Ross C Luke Douglas A |
| author_facet | Stamatakis Katherine A McQueen Amy Filler Carl Boland Elizabeth Dreisinger Mariah Brownson Ross C Luke Douglas A |
| author_sort | Stamatakis Katherine A |
| collection | DOAJ |
| description | <p>Abstract</p> <p>Background</p> <p>There is a great deal of variation in the existing capacity of primary prevention programs and policies addressing chronic disease to deliver evidence-based interventions (EBIs). In order to develop and evaluate implementation strategies that are tailored to the appropriate level of capacity, there is a need for an easy-to-administer tool to stage organizational readiness for EBIs.</p> <p>Methods</p> <p>Based on theoretical frameworks, including Rogers’ Diffusion of Innovations, we developed a survey instrument to measure four domains representing stages of readiness for EBI: awareness, adoption, implementation, and maintenance. A separate scale representing organizational climate as a potential mediator of readiness for EBIs was also included in the survey. Twenty-three questions comprised the four domains, with four to nine items each, using a seven-point response scale. Representatives from obesity, asthma, diabetes, and tobacco prevention programs serving diverse populations in the United States were surveyed (N = 243); test-retest reliability was assessed with 92 respondents.</p> <p>Results</p> <p>Confirmatory factor analysis (CFA) was used to test and refine readiness scales. Test-retest reliability of the readiness scales, as measured by intraclass correlation, ranged from 0.47–0.71. CFA found good fit for the five-item adoption and implementation scales and resulted in revisions of the awareness and maintenance scales. The awareness scale was split into two two-item scales, representing community and agency awareness. The maintenance scale was split into five- and four-item scales, representing infrastructural maintenance and evaluation maintenance, respectively. Internal reliability of scales (Cronbach’s α) ranged from 0.66–0.78. The model for the final revised scales approached good fit, with most factor loadings >0.6 and all >0.4.</p> <p>Conclusions</p> <p>The lack of adequate measurement tools hinders progress in dissemination and implementation research. These preliminary results help fill this gap by describing the reliability and measurement properties of a theory-based tool; the short, user-friendly instrument may be useful to researchers and practitioners seeking to assess organizational readiness for EBIs across a variety of chronic disease prevention programs and settings.</p> |
| first_indexed | 2024-12-11T06:24:11Z |
| format | Article |
| id | doaj.art-9fc3fd4eb3954167a86723da01affb01 |
| institution | Directory Open Access Journal |
| issn | 1748-5908 |
| language | English |
| last_indexed | 2024-12-11T06:24:11Z |
| publishDate | 2012-07-01 |
| publisher | BMC |
| record_format | Article |
| series | Implementation Science |
| spelling | doaj.art-9fc3fd4eb3954167a86723da01affb012022-12-22T01:17:44ZengBMCImplementation Science1748-59082012-07-01716510.1186/1748-5908-7-65Measurement properties of a novel survey to assess stages of organizational readiness for evidence-based interventions in community chronic disease prevention settingsStamatakis Katherine AMcQueen AmyFiller CarlBoland ElizabethDreisinger MariahBrownson Ross CLuke Douglas A<p>Abstract</p> <p>Background</p> <p>There is a great deal of variation in the existing capacity of primary prevention programs and policies addressing chronic disease to deliver evidence-based interventions (EBIs). In order to develop and evaluate implementation strategies that are tailored to the appropriate level of capacity, there is a need for an easy-to-administer tool to stage organizational readiness for EBIs.</p> <p>Methods</p> <p>Based on theoretical frameworks, including Rogers’ Diffusion of Innovations, we developed a survey instrument to measure four domains representing stages of readiness for EBI: awareness, adoption, implementation, and maintenance. A separate scale representing organizational climate as a potential mediator of readiness for EBIs was also included in the survey. Twenty-three questions comprised the four domains, with four to nine items each, using a seven-point response scale. Representatives from obesity, asthma, diabetes, and tobacco prevention programs serving diverse populations in the United States were surveyed (N = 243); test-retest reliability was assessed with 92 respondents.</p> <p>Results</p> <p>Confirmatory factor analysis (CFA) was used to test and refine readiness scales. Test-retest reliability of the readiness scales, as measured by intraclass correlation, ranged from 0.47–0.71. CFA found good fit for the five-item adoption and implementation scales and resulted in revisions of the awareness and maintenance scales. The awareness scale was split into two two-item scales, representing community and agency awareness. The maintenance scale was split into five- and four-item scales, representing infrastructural maintenance and evaluation maintenance, respectively. Internal reliability of scales (Cronbach’s α) ranged from 0.66–0.78. The model for the final revised scales approached good fit, with most factor loadings >0.6 and all >0.4.</p> <p>Conclusions</p> <p>The lack of adequate measurement tools hinders progress in dissemination and implementation research. These preliminary results help fill this gap by describing the reliability and measurement properties of a theory-based tool; the short, user-friendly instrument may be useful to researchers and practitioners seeking to assess organizational readiness for EBIs across a variety of chronic disease prevention programs and settings.</p>http://www.implementationscience.com/content/7/1/65Measurement toolChronic disease preventionEvidence-based practiceConfirmatory factor analysisDisseminationImplementation |
| spellingShingle | Stamatakis Katherine A McQueen Amy Filler Carl Boland Elizabeth Dreisinger Mariah Brownson Ross C Luke Douglas A Measurement properties of a novel survey to assess stages of organizational readiness for evidence-based interventions in community chronic disease prevention settings Implementation Science Measurement tool Chronic disease prevention Evidence-based practice Confirmatory factor analysis Dissemination Implementation |
| title | Measurement properties of a novel survey to assess stages of organizational readiness for evidence-based interventions in community chronic disease prevention settings |
| title_full | Measurement properties of a novel survey to assess stages of organizational readiness for evidence-based interventions in community chronic disease prevention settings |
| title_fullStr | Measurement properties of a novel survey to assess stages of organizational readiness for evidence-based interventions in community chronic disease prevention settings |
| title_full_unstemmed | Measurement properties of a novel survey to assess stages of organizational readiness for evidence-based interventions in community chronic disease prevention settings |
| title_short | Measurement properties of a novel survey to assess stages of organizational readiness for evidence-based interventions in community chronic disease prevention settings |
| title_sort | measurement properties of a novel survey to assess stages of organizational readiness for evidence based interventions in community chronic disease prevention settings |
| topic | Measurement tool Chronic disease prevention Evidence-based practice Confirmatory factor analysis Dissemination Implementation |
| url | http://www.implementationscience.com/content/7/1/65 |
| work_keys_str_mv | AT stamatakiskatherinea measurementpropertiesofanovelsurveytoassessstagesoforganizationalreadinessforevidencebasedinterventionsincommunitychronicdiseasepreventionsettings AT mcqueenamy measurementpropertiesofanovelsurveytoassessstagesoforganizationalreadinessforevidencebasedinterventionsincommunitychronicdiseasepreventionsettings AT fillercarl measurementpropertiesofanovelsurveytoassessstagesoforganizationalreadinessforevidencebasedinterventionsincommunitychronicdiseasepreventionsettings AT bolandelizabeth measurementpropertiesofanovelsurveytoassessstagesoforganizationalreadinessforevidencebasedinterventionsincommunitychronicdiseasepreventionsettings AT dreisingermariah measurementpropertiesofanovelsurveytoassessstagesoforganizationalreadinessforevidencebasedinterventionsincommunitychronicdiseasepreventionsettings AT brownsonrossc measurementpropertiesofanovelsurveytoassessstagesoforganizationalreadinessforevidencebasedinterventionsincommunitychronicdiseasepreventionsettings AT lukedouglasa measurementpropertiesofanovelsurveytoassessstagesoforganizationalreadinessforevidencebasedinterventionsincommunitychronicdiseasepreventionsettings |