Exploring the impact of evaluation on learning and health innovation sustainability: protocol for a realist synthesis
Abstract Background Within the Learning Health System (LHS) model, learning routines, including evaluation, allow for continuous incremental change to take place. Within these learning routines, evaluation assists in problem identification, data collection, and data transformation into contextualize...
| Main Authors: | , , , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
BMC
2023-10-01
|
| Series: | Systematic Reviews |
| Subjects: | |
| Online Access: | https://doi.org/10.1186/s13643-023-02348-5 |
| _version_ | 1797453727980847104 |
|---|---|
| author | Marissa Bird Élizabeth Côté-Boileau Walter P. Wodchis Lianne Jeffs Maura MacPhee James Shaw Tujuanna Austin Frances Bruno Megan Bhalla Carolyn Steele Gray |
| author_facet | Marissa Bird Élizabeth Côté-Boileau Walter P. Wodchis Lianne Jeffs Maura MacPhee James Shaw Tujuanna Austin Frances Bruno Megan Bhalla Carolyn Steele Gray |
| author_sort | Marissa Bird |
| collection | DOAJ |
| description | Abstract Background Within the Learning Health System (LHS) model, learning routines, including evaluation, allow for continuous incremental change to take place. Within these learning routines, evaluation assists in problem identification, data collection, and data transformation into contextualized information, which is then re-applied to the LHS environment. Evaluation that catalyzes learning and improvement may also contribute to health innovation sustainability. However, there is little consensus as to why certain evaluations seem to support learning and sustainability, while others impede it. This realist synthesis seeks to understand the contextual factors and underlying mechanisms or drivers that best support health systems learning and sustainable innovation. Methods This synthesis will be guided by Pawson and colleagues’ 2005 and Emmel and colleagues’ 2018 guidelines for conducting realist syntheses. The review process will encompass five steps: (1) scoping the review, (2) building theories, (3) identifying the evidence, (4) evidence selection and appraisal, and (5) data extraction and synthesis. An Expert Committee comprised of leaders in evaluation, innovation, sustainability, and realist methodology will guide this synthesis. Review findings will be reported using the RAMESES guidelines. Discussion The use of a realist review will allow for exploration and theorizing about the contextual factors and underlying mechanisms that make evaluations ‘work’ (or ‘not work’) to support learning and sustainability. Depending on results, we will attempt to synthesize findings into a series of recommendations for evaluations with the intention to support health systems learning and sustainability. Finalized results will be presented at national and international conferences, as well as disseminated via a peer-reviewed publication. Systematic review registration This realist synthesis protocol has been registered with PROSPERO ( https://www.crd.york.ac.uk/prospero/ ID 382690). |
| first_indexed | 2024-03-09T15:27:02Z |
| format | Article |
| id | doaj.art-2cc47366ff6745b1a86f5557745bb31f |
| institution | Directory Open Access Journal |
| issn | 2046-4053 |
| language | English |
| last_indexed | 2024-03-09T15:27:02Z |
| publishDate | 2023-10-01 |
| publisher | BMC |
| record_format | Article |
| series | Systematic Reviews |
| spelling | doaj.art-2cc47366ff6745b1a86f5557745bb31f2023-11-26T12:28:46ZengBMCSystematic Reviews2046-40532023-10-011211810.1186/s13643-023-02348-5Exploring the impact of evaluation on learning and health innovation sustainability: protocol for a realist synthesisMarissa Bird0Élizabeth Côté-Boileau1Walter P. Wodchis2Lianne Jeffs3Maura MacPhee4James Shaw5Tujuanna Austin6Frances Bruno7Megan Bhalla8Carolyn Steele Gray9Institute for Better HealthDepartment of Health Management, Evaluation and Policy, School of Public Health, University of MontrealInstitute for Better HealthScience of Care Institute, Sinai HealthNursing-Applied Sciences, University of British ColumbiaDepartment of Physical Therapy, Temerty Faculty of Medicine, University of TorontoInstitute of Health Policy Management and Evaluation (IHPME), Dalla Lana School of Public Health, University of TorontoInstitute of Health Policy Management and Evaluation (IHPME), Dalla Lana School of Public Health, University of TorontoOPTI-Hex Lab, Leslie Dan Faculty of Pharmacy, University of TorontoInstitute of Health Policy Management and Evaluation (IHPME), Dalla Lana School of Public Health, University of TorontoAbstract Background Within the Learning Health System (LHS) model, learning routines, including evaluation, allow for continuous incremental change to take place. Within these learning routines, evaluation assists in problem identification, data collection, and data transformation into contextualized information, which is then re-applied to the LHS environment. Evaluation that catalyzes learning and improvement may also contribute to health innovation sustainability. However, there is little consensus as to why certain evaluations seem to support learning and sustainability, while others impede it. This realist synthesis seeks to understand the contextual factors and underlying mechanisms or drivers that best support health systems learning and sustainable innovation. Methods This synthesis will be guided by Pawson and colleagues’ 2005 and Emmel and colleagues’ 2018 guidelines for conducting realist syntheses. The review process will encompass five steps: (1) scoping the review, (2) building theories, (3) identifying the evidence, (4) evidence selection and appraisal, and (5) data extraction and synthesis. An Expert Committee comprised of leaders in evaluation, innovation, sustainability, and realist methodology will guide this synthesis. Review findings will be reported using the RAMESES guidelines. Discussion The use of a realist review will allow for exploration and theorizing about the contextual factors and underlying mechanisms that make evaluations ‘work’ (or ‘not work’) to support learning and sustainability. Depending on results, we will attempt to synthesize findings into a series of recommendations for evaluations with the intention to support health systems learning and sustainability. Finalized results will be presented at national and international conferences, as well as disseminated via a peer-reviewed publication. Systematic review registration This realist synthesis protocol has been registered with PROSPERO ( https://www.crd.york.ac.uk/prospero/ ID 382690).https://doi.org/10.1186/s13643-023-02348-5Realist synthesisEvaluationLearningLearning health systemsInnovationSustainability |
| spellingShingle | Marissa Bird Élizabeth Côté-Boileau Walter P. Wodchis Lianne Jeffs Maura MacPhee James Shaw Tujuanna Austin Frances Bruno Megan Bhalla Carolyn Steele Gray Exploring the impact of evaluation on learning and health innovation sustainability: protocol for a realist synthesis Systematic Reviews Realist synthesis Evaluation Learning Learning health systems Innovation Sustainability |
| title | Exploring the impact of evaluation on learning and health innovation sustainability: protocol for a realist synthesis |
| title_full | Exploring the impact of evaluation on learning and health innovation sustainability: protocol for a realist synthesis |
| title_fullStr | Exploring the impact of evaluation on learning and health innovation sustainability: protocol for a realist synthesis |
| title_full_unstemmed | Exploring the impact of evaluation on learning and health innovation sustainability: protocol for a realist synthesis |
| title_short | Exploring the impact of evaluation on learning and health innovation sustainability: protocol for a realist synthesis |
| title_sort | exploring the impact of evaluation on learning and health innovation sustainability protocol for a realist synthesis |
| topic | Realist synthesis Evaluation Learning Learning health systems Innovation Sustainability |
| url | https://doi.org/10.1186/s13643-023-02348-5 |
| work_keys_str_mv | AT marissabird exploringtheimpactofevaluationonlearningandhealthinnovationsustainabilityprotocolforarealistsynthesis AT elizabethcoteboileau exploringtheimpactofevaluationonlearningandhealthinnovationsustainabilityprotocolforarealistsynthesis AT walterpwodchis exploringtheimpactofevaluationonlearningandhealthinnovationsustainabilityprotocolforarealistsynthesis AT liannejeffs exploringtheimpactofevaluationonlearningandhealthinnovationsustainabilityprotocolforarealistsynthesis AT mauramacphee exploringtheimpactofevaluationonlearningandhealthinnovationsustainabilityprotocolforarealistsynthesis AT jamesshaw exploringtheimpactofevaluationonlearningandhealthinnovationsustainabilityprotocolforarealistsynthesis AT tujuannaaustin exploringtheimpactofevaluationonlearningandhealthinnovationsustainabilityprotocolforarealistsynthesis AT francesbruno exploringtheimpactofevaluationonlearningandhealthinnovationsustainabilityprotocolforarealistsynthesis AT meganbhalla exploringtheimpactofevaluationonlearningandhealthinnovationsustainabilityprotocolforarealistsynthesis AT carolynsteelegray exploringtheimpactofevaluationonlearningandhealthinnovationsustainabilityprotocolforarealistsynthesis |