The design of an evaluation framework for diabetes self-management education and support programs delivered nationally
Abstract Background The aim of this work was to develop a National Evaluation Framework to facilitate the standardization of delivery, quality, reporting, and evaluation of diabetes education and support programs delivered throughout Australia through the National Diabetes Services Scheme (NDSS). Th...
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
BMC
2022-01-01
|
| Series: | BMC Health Services Research |
| Subjects: | |
| Online Access: | https://doi.org/10.1186/s12913-021-07374-4 |
| _version_ | 1798026288647110656 |
|---|---|
| author | Jenny Louise Olson Becky White Helen Mitchell Jennifer Halliday Timothy Skinner Deborah Schofield Jennifer Sweeting Natasha Watson |
| author_facet | Jenny Louise Olson Becky White Helen Mitchell Jennifer Halliday Timothy Skinner Deborah Schofield Jennifer Sweeting Natasha Watson |
| author_sort | Jenny Louise Olson |
| collection | DOAJ |
| description | Abstract Background The aim of this work was to develop a National Evaluation Framework to facilitate the standardization of delivery, quality, reporting, and evaluation of diabetes education and support programs delivered throughout Australia through the National Diabetes Services Scheme (NDSS). The NDSS is funded by the Australian Government, and provides access to diabetes information, education, support, and subsidized product across diverse settings in each state and territory of Australia through seven independent service-providers. This article reports the approach undertaken to develop the Framework. Methods A participatory approach was undertaken, focused on adopting nationally consistent outcomes and indicators, nominating objectives and measurement tools, specifying evaluation processes, and developing quality standards. Existing programs were classified based on related, overarching indicators enabling the adoption of a tiered system of evaluation. Results Two outcomes (i.e., improved clinical, reduced cost) and four indicators (i.e., improved knowledge and understanding, self-management, self-determination, psychosocial adjustment) were adopted from the Eigenmann and Colagiuri national consensus position statement for diabetes education. This allowed for the identification of objectives (i.e., improved empowerment, reduced distress, autonomy supportive program delivery, consumer satisfaction) and related measurement instruments. Programs were categorized as comprehensive, topic-specific, or basic education, with comprehensive programs allocated to receive the highest-level of evaluation. Eight quality standards were developed, with existing programs tested against those standards. Based on the results of testing, two comprehensive (OzDAFNE for people with type 1 diabetes, DESMOND for people with type 2 diabetes), and eight topic-specific (CarbSmart, ShopSmart, MonitorSmart, FootSmart, MedSmart, Living with Insulin, Insulin Pump Workshop, Ready Set Go – Let’s Move) structured diabetes self-management education and support programs were nominated for national delivery. Conclusions The National Evaluation Framework has facilitated consistency of program quality, delivery, and evaluation of programs delivered by multiple service providers across diverse contexts. The Framework could be applied by other service providers who facilitate multiple diabetes education and support programs and could be adapted for use in other chronic disease populations where education and support are indicated. |
| first_indexed | 2024-04-11T18:32:54Z |
| format | Article |
| id | doaj.art-33331de0663847628dea112fa0d15859 |
| institution | Directory Open Access Journal |
| issn | 1472-6963 |
| language | English |
| last_indexed | 2024-04-11T18:32:54Z |
| publishDate | 2022-01-01 |
| publisher | BMC |
| record_format | Article |
| series | BMC Health Services Research |
| spelling | doaj.art-33331de0663847628dea112fa0d158592022-12-22T04:09:23ZengBMCBMC Health Services Research1472-69632022-01-0122111110.1186/s12913-021-07374-4The design of an evaluation framework for diabetes self-management education and support programs delivered nationallyJenny Louise Olson0Becky White1Helen Mitchell2Jennifer Halliday3Timothy Skinner4Deborah Schofield5Jennifer Sweeting6Natasha Watson7Diabetes WADiabetes WADiabetes WASchool of Psychology, Deakin UniversityThe Australian Centre for Behavioural Research in Diabetes, Diabetes VictoriaDiabetes WADiabetes WADiabetes WAAbstract Background The aim of this work was to develop a National Evaluation Framework to facilitate the standardization of delivery, quality, reporting, and evaluation of diabetes education and support programs delivered throughout Australia through the National Diabetes Services Scheme (NDSS). The NDSS is funded by the Australian Government, and provides access to diabetes information, education, support, and subsidized product across diverse settings in each state and territory of Australia through seven independent service-providers. This article reports the approach undertaken to develop the Framework. Methods A participatory approach was undertaken, focused on adopting nationally consistent outcomes and indicators, nominating objectives and measurement tools, specifying evaluation processes, and developing quality standards. Existing programs were classified based on related, overarching indicators enabling the adoption of a tiered system of evaluation. Results Two outcomes (i.e., improved clinical, reduced cost) and four indicators (i.e., improved knowledge and understanding, self-management, self-determination, psychosocial adjustment) were adopted from the Eigenmann and Colagiuri national consensus position statement for diabetes education. This allowed for the identification of objectives (i.e., improved empowerment, reduced distress, autonomy supportive program delivery, consumer satisfaction) and related measurement instruments. Programs were categorized as comprehensive, topic-specific, or basic education, with comprehensive programs allocated to receive the highest-level of evaluation. Eight quality standards were developed, with existing programs tested against those standards. Based on the results of testing, two comprehensive (OzDAFNE for people with type 1 diabetes, DESMOND for people with type 2 diabetes), and eight topic-specific (CarbSmart, ShopSmart, MonitorSmart, FootSmart, MedSmart, Living with Insulin, Insulin Pump Workshop, Ready Set Go – Let’s Move) structured diabetes self-management education and support programs were nominated for national delivery. Conclusions The National Evaluation Framework has facilitated consistency of program quality, delivery, and evaluation of programs delivered by multiple service providers across diverse contexts. The Framework could be applied by other service providers who facilitate multiple diabetes education and support programs and could be adapted for use in other chronic disease populations where education and support are indicated.https://doi.org/10.1186/s12913-021-07374-4Implementation scienceProgram evaluationDiabetes self-management education and supportHealth services researchSelf-managementChronic disease |
| spellingShingle | Jenny Louise Olson Becky White Helen Mitchell Jennifer Halliday Timothy Skinner Deborah Schofield Jennifer Sweeting Natasha Watson The design of an evaluation framework for diabetes self-management education and support programs delivered nationally BMC Health Services Research Implementation science Program evaluation Diabetes self-management education and support Health services research Self-management Chronic disease |
| title | The design of an evaluation framework for diabetes self-management education and support programs delivered nationally |
| title_full | The design of an evaluation framework for diabetes self-management education and support programs delivered nationally |
| title_fullStr | The design of an evaluation framework for diabetes self-management education and support programs delivered nationally |
| title_full_unstemmed | The design of an evaluation framework for diabetes self-management education and support programs delivered nationally |
| title_short | The design of an evaluation framework for diabetes self-management education and support programs delivered nationally |
| title_sort | design of an evaluation framework for diabetes self management education and support programs delivered nationally |
| topic | Implementation science Program evaluation Diabetes self-management education and support Health services research Self-management Chronic disease |
| url | https://doi.org/10.1186/s12913-021-07374-4 |
| work_keys_str_mv | AT jennylouiseolson thedesignofanevaluationframeworkfordiabetesselfmanagementeducationandsupportprogramsdeliverednationally AT beckywhite thedesignofanevaluationframeworkfordiabetesselfmanagementeducationandsupportprogramsdeliverednationally AT helenmitchell thedesignofanevaluationframeworkfordiabetesselfmanagementeducationandsupportprogramsdeliverednationally AT jenniferhalliday thedesignofanevaluationframeworkfordiabetesselfmanagementeducationandsupportprogramsdeliverednationally AT timothyskinner thedesignofanevaluationframeworkfordiabetesselfmanagementeducationandsupportprogramsdeliverednationally AT deborahschofield thedesignofanevaluationframeworkfordiabetesselfmanagementeducationandsupportprogramsdeliverednationally AT jennifersweeting thedesignofanevaluationframeworkfordiabetesselfmanagementeducationandsupportprogramsdeliverednationally AT natashawatson thedesignofanevaluationframeworkfordiabetesselfmanagementeducationandsupportprogramsdeliverednationally AT jennylouiseolson designofanevaluationframeworkfordiabetesselfmanagementeducationandsupportprogramsdeliverednationally AT beckywhite designofanevaluationframeworkfordiabetesselfmanagementeducationandsupportprogramsdeliverednationally AT helenmitchell designofanevaluationframeworkfordiabetesselfmanagementeducationandsupportprogramsdeliverednationally AT jenniferhalliday designofanevaluationframeworkfordiabetesselfmanagementeducationandsupportprogramsdeliverednationally AT timothyskinner designofanevaluationframeworkfordiabetesselfmanagementeducationandsupportprogramsdeliverednationally AT deborahschofield designofanevaluationframeworkfordiabetesselfmanagementeducationandsupportprogramsdeliverednationally AT jennifersweeting designofanevaluationframeworkfordiabetesselfmanagementeducationandsupportprogramsdeliverednationally AT natashawatson designofanevaluationframeworkfordiabetesselfmanagementeducationandsupportprogramsdeliverednationally |