Evaluating malaria programmes in moderate- and low-transmission settings: practical ways to generate robust evidence
Abstract Background Many countries have made substantial progress in scaling-up and sustaining malaria intervention coverage, leading to more focalized and heterogeneous transmission in many settings. Evaluation provides valuable information for programmes to understand if interventions have been im...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
BMC
2020-02-01
|
| Series: | Malaria Journal |
| Subjects: | |
| Online Access: | http://link.springer.com/article/10.1186/s12936-020-03158-z |
| _version_ | 1818941712601448448 |
|---|---|
| author | Ruth A. Ashton Debra Prosnitz Andrew Andrada Samantha Herrera Yazoumé Yé |
| author_facet | Ruth A. Ashton Debra Prosnitz Andrew Andrada Samantha Herrera Yazoumé Yé |
| author_sort | Ruth A. Ashton |
| collection | DOAJ |
| description | Abstract Background Many countries have made substantial progress in scaling-up and sustaining malaria intervention coverage, leading to more focalized and heterogeneous transmission in many settings. Evaluation provides valuable information for programmes to understand if interventions have been implemented as planned and with quality, if the programme had the intended impact on malaria burden, and to guide programmatic decision-making. Low-, moderate-, and heterogeneous-transmission settings present unique evaluation challenges because of dynamic and targeted intervention strategies. This paper provides illustration of evaluation approaches and methodologies for these transmission settings, and suggests how to answer evaluation questions specific to the local context. Methods The Roll Back Malaria Monitoring and Evaluation Reference Group formed a task force in October 2017 to lead development of this framework. The task force includes representatives from National Malaria Programmes, funding agencies, and malaria research and implementing partners. The framework builds on existing guidance for process and outcome evaluations and impact evaluations specifically in high transmission settings. Results The theory of change describes how evaluation questions asked by national malaria programmes in different contexts influence evaluation design. The transmission setting, existing stratification, and data quality and availability are also key considerations. The framework is intended for adaption by countries to their local context, and use for evaluation at sub-national level. Confirmed malaria incidence is recommended as the primary impact indicator due to its sensitivity to detect changes in low-transmission settings. It is expected that process evaluations provide sufficient evidence for programme monitoring and improvement, while impact evaluations are needed following adoption of new mixes of interventions, operational strategies, tools or policies, particularly in contexts of changing malaria epidemiology. Impact evaluations in low-, moderate-, or heterogeneous-transmission settings will likely use plausibility designs, and methods highlighted by the framework include interrupted time series, district-level dose–response analyses, and constructed control methods. Triangulating multiple data sources and analyses is important to strengthen the plausibility argument. Conclusions This framework provides a structure to assist national malaria programmes and partners to design evaluations in low-, moderate- or heterogeneous-transmission settings. Emphasizing a continuous cycle along the causal pathway linking process evaluation to impact evaluation and then programmatic decision-making, the framework provides practical guidance in evaluation design, analysis, and interpretation to ensure that the evaluation meets national malaria programme priority questions and guides decision-making at national and sub-national levels. |
| first_indexed | 2024-12-20T06:59:54Z |
| format | Article |
| id | doaj.art-f322f5ce508d4079adac1e25501ab4b4 |
| institution | Directory Open Access Journal |
| issn | 1475-2875 |
| language | English |
| last_indexed | 2024-12-20T06:59:54Z |
| publishDate | 2020-02-01 |
| publisher | BMC |
| record_format | Article |
| series | Malaria Journal |
| spelling | doaj.art-f322f5ce508d4079adac1e25501ab4b42022-12-21T19:49:14ZengBMCMalaria Journal1475-28752020-02-0119111410.1186/s12936-020-03158-zEvaluating malaria programmes in moderate- and low-transmission settings: practical ways to generate robust evidenceRuth A. Ashton0Debra Prosnitz1Andrew Andrada2Samantha Herrera3Yazoumé Yé4MEASURE Evaluation, Center for Applied Malaria Research and Evaluation, Tulane School of Public Health and Tropical Medicine, Tulane UniversityMEASURE Evaluation, ICFMEASURE Evaluation, ICFMEASURE Evaluation, ICFMEASURE Evaluation, ICFAbstract Background Many countries have made substantial progress in scaling-up and sustaining malaria intervention coverage, leading to more focalized and heterogeneous transmission in many settings. Evaluation provides valuable information for programmes to understand if interventions have been implemented as planned and with quality, if the programme had the intended impact on malaria burden, and to guide programmatic decision-making. Low-, moderate-, and heterogeneous-transmission settings present unique evaluation challenges because of dynamic and targeted intervention strategies. This paper provides illustration of evaluation approaches and methodologies for these transmission settings, and suggests how to answer evaluation questions specific to the local context. Methods The Roll Back Malaria Monitoring and Evaluation Reference Group formed a task force in October 2017 to lead development of this framework. The task force includes representatives from National Malaria Programmes, funding agencies, and malaria research and implementing partners. The framework builds on existing guidance for process and outcome evaluations and impact evaluations specifically in high transmission settings. Results The theory of change describes how evaluation questions asked by national malaria programmes in different contexts influence evaluation design. The transmission setting, existing stratification, and data quality and availability are also key considerations. The framework is intended for adaption by countries to their local context, and use for evaluation at sub-national level. Confirmed malaria incidence is recommended as the primary impact indicator due to its sensitivity to detect changes in low-transmission settings. It is expected that process evaluations provide sufficient evidence for programme monitoring and improvement, while impact evaluations are needed following adoption of new mixes of interventions, operational strategies, tools or policies, particularly in contexts of changing malaria epidemiology. Impact evaluations in low-, moderate-, or heterogeneous-transmission settings will likely use plausibility designs, and methods highlighted by the framework include interrupted time series, district-level dose–response analyses, and constructed control methods. Triangulating multiple data sources and analyses is important to strengthen the plausibility argument. Conclusions This framework provides a structure to assist national malaria programmes and partners to design evaluations in low-, moderate- or heterogeneous-transmission settings. Emphasizing a continuous cycle along the causal pathway linking process evaluation to impact evaluation and then programmatic decision-making, the framework provides practical guidance in evaluation design, analysis, and interpretation to ensure that the evaluation meets national malaria programme priority questions and guides decision-making at national and sub-national levels.http://link.springer.com/article/10.1186/s12936-020-03158-zProcess evaluationImpact evaluationRoutine health information systems (RHIS)SurveillanceMonitoring evaluationDecision-making |
| spellingShingle | Ruth A. Ashton Debra Prosnitz Andrew Andrada Samantha Herrera Yazoumé Yé Evaluating malaria programmes in moderate- and low-transmission settings: practical ways to generate robust evidence Malaria Journal Process evaluation Impact evaluation Routine health information systems (RHIS) Surveillance Monitoring evaluation Decision-making |
| title | Evaluating malaria programmes in moderate- and low-transmission settings: practical ways to generate robust evidence |
| title_full | Evaluating malaria programmes in moderate- and low-transmission settings: practical ways to generate robust evidence |
| title_fullStr | Evaluating malaria programmes in moderate- and low-transmission settings: practical ways to generate robust evidence |
| title_full_unstemmed | Evaluating malaria programmes in moderate- and low-transmission settings: practical ways to generate robust evidence |
| title_short | Evaluating malaria programmes in moderate- and low-transmission settings: practical ways to generate robust evidence |
| title_sort | evaluating malaria programmes in moderate and low transmission settings practical ways to generate robust evidence |
| topic | Process evaluation Impact evaluation Routine health information systems (RHIS) Surveillance Monitoring evaluation Decision-making |
| url | http://link.springer.com/article/10.1186/s12936-020-03158-z |
| work_keys_str_mv | AT ruthaashton evaluatingmalariaprogrammesinmoderateandlowtransmissionsettingspracticalwaystogeneraterobustevidence AT debraprosnitz evaluatingmalariaprogrammesinmoderateandlowtransmissionsettingspracticalwaystogeneraterobustevidence AT andrewandrada evaluatingmalariaprogrammesinmoderateandlowtransmissionsettingspracticalwaystogeneraterobustevidence AT samanthaherrera evaluatingmalariaprogrammesinmoderateandlowtransmissionsettingspracticalwaystogeneraterobustevidence AT yazoumeye evaluatingmalariaprogrammesinmoderateandlowtransmissionsettingspracticalwaystogeneraterobustevidence |