Monitoring and Evaluation of National Vaccination Implementation: A Scoping Review of How Frameworks and Indicators Are Used in the Public Health Literature
An effective Monitoring and Evaluation (M&E) framework helps vaccination programme managers determine progress and effectiveness for agreed indicators against clear benchmarks and targets. We aimed to identify the literature on M&E frameworks and indicators used in national vaccination progr...
| Main Authors: | , , , , , , , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2022-04-01
|
| Series: | Vaccines |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2076-393X/10/4/567 |
| _version_ | 1797409023306235904 |
|---|---|
| author | Manar Marzouk Maryam Omar Kanchanok Sirison Aparna Ananthakrishnan Anna Durrance-Bagale Chatkamol Pheerapanyawaranun Charatpol Porncharoen Nopphadol Pimsarn Sze Tung Lam Mengieng Ung Zeenathnisa Mougammadou Aribou Saudamini V. Dabak Wanrudee Isaranuwatchai Natasha Howard |
| author_facet | Manar Marzouk Maryam Omar Kanchanok Sirison Aparna Ananthakrishnan Anna Durrance-Bagale Chatkamol Pheerapanyawaranun Charatpol Porncharoen Nopphadol Pimsarn Sze Tung Lam Mengieng Ung Zeenathnisa Mougammadou Aribou Saudamini V. Dabak Wanrudee Isaranuwatchai Natasha Howard |
| author_sort | Manar Marzouk |
| collection | DOAJ |
| description | An effective Monitoring and Evaluation (M&E) framework helps vaccination programme managers determine progress and effectiveness for agreed indicators against clear benchmarks and targets. We aimed to identify the literature on M&E frameworks and indicators used in national vaccination programmes and synthesise approaches and lessons to inform development of future frameworks. We conducted a scoping review using Arksey and O’Malley’s six-stage framework to identify and synthesise sources on monitoring or evaluation of national vaccination implementation that described a framework or indicators. The findings were summarised thematically. We included 43 eligible sources of 4291 screened. Most (95%) were in English and discussed high-income (51%) or middle-income (30%) settings, with 13 in Europe (30%), 10 in Asia-Pacific (23%), nine in Africa (21%), and eight in the Americas (19%), respectively, while three crossed regions. Only five (12%) specified the use of an M&E framework. Most (32/43; 74%) explicitly or implicitly included vaccine coverage indicators, followed by 12 including operational (28%), five including clinical (12%), and two including cost indicators (5%). The use of M&E frameworks was seldom explicit or clearly defined in our sources, with indicators rarely fully defined or benchmarked against targets. Sources focused on ways to improve vaccination programmes without explicitly considering ways to improve assessment. Literature on M&E framework and indicator use in national vaccination programmes is limited and focused on routine childhood vaccination. Therefore, documentation of more experiences and lessons is needed to better inform vaccination M&E beyond childhood. |
| first_indexed | 2024-03-09T04:07:20Z |
| format | Article |
| id | doaj.art-02443e86eea340afb755d2ba0ede97b4 |
| institution | Directory Open Access Journal |
| issn | 2076-393X |
| language | English |
| last_indexed | 2024-03-09T04:07:20Z |
| publishDate | 2022-04-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Vaccines |
| spelling | doaj.art-02443e86eea340afb755d2ba0ede97b42023-12-03T14:03:37ZengMDPI AGVaccines2076-393X2022-04-0110456710.3390/vaccines10040567Monitoring and Evaluation of National Vaccination Implementation: A Scoping Review of How Frameworks and Indicators Are Used in the Public Health LiteratureManar Marzouk0Maryam Omar1Kanchanok Sirison2Aparna Ananthakrishnan3Anna Durrance-Bagale4Chatkamol Pheerapanyawaranun5Charatpol Porncharoen6Nopphadol Pimsarn7Sze Tung Lam8Mengieng Ung9Zeenathnisa Mougammadou Aribou10Saudamini V. Dabak11Wanrudee Isaranuwatchai12Natasha Howard13Saw Swee Hock School of Public Health, National University of Singapore, National University Health System, 12 Science Drive 2, Singapore 117549, SingaporeBarts Health NHS Trust, Newham University Hospital, London E13 8SL, UKHealth Intervention and Technology Assessment Program, Ministry of Public Health, Nonthaburi 11000, ThailandHealth Intervention and Technology Assessment Program, Ministry of Public Health, Nonthaburi 11000, ThailandSaw Swee Hock School of Public Health, National University of Singapore, National University Health System, 12 Science Drive 2, Singapore 117549, SingaporeHealth Intervention and Technology Assessment Program, Ministry of Public Health, Nonthaburi 11000, ThailandHealth Intervention and Technology Assessment Program, Ministry of Public Health, Nonthaburi 11000, ThailandHealth Intervention and Technology Assessment Program, Ministry of Public Health, Nonthaburi 11000, ThailandSaw Swee Hock School of Public Health, National University of Singapore, National University Health System, 12 Science Drive 2, Singapore 117549, SingaporeSaw Swee Hock School of Public Health, National University of Singapore, National University Health System, 12 Science Drive 2, Singapore 117549, SingaporeSaw Swee Hock School of Public Health, National University of Singapore, National University Health System, 12 Science Drive 2, Singapore 117549, SingaporeHealth Intervention and Technology Assessment Program, Ministry of Public Health, Nonthaburi 11000, ThailandHealth Intervention and Technology Assessment Program, Ministry of Public Health, Nonthaburi 11000, ThailandSaw Swee Hock School of Public Health, National University of Singapore, National University Health System, 12 Science Drive 2, Singapore 117549, SingaporeAn effective Monitoring and Evaluation (M&E) framework helps vaccination programme managers determine progress and effectiveness for agreed indicators against clear benchmarks and targets. We aimed to identify the literature on M&E frameworks and indicators used in national vaccination programmes and synthesise approaches and lessons to inform development of future frameworks. We conducted a scoping review using Arksey and O’Malley’s six-stage framework to identify and synthesise sources on monitoring or evaluation of national vaccination implementation that described a framework or indicators. The findings were summarised thematically. We included 43 eligible sources of 4291 screened. Most (95%) were in English and discussed high-income (51%) or middle-income (30%) settings, with 13 in Europe (30%), 10 in Asia-Pacific (23%), nine in Africa (21%), and eight in the Americas (19%), respectively, while three crossed regions. Only five (12%) specified the use of an M&E framework. Most (32/43; 74%) explicitly or implicitly included vaccine coverage indicators, followed by 12 including operational (28%), five including clinical (12%), and two including cost indicators (5%). The use of M&E frameworks was seldom explicit or clearly defined in our sources, with indicators rarely fully defined or benchmarked against targets. Sources focused on ways to improve vaccination programmes without explicitly considering ways to improve assessment. Literature on M&E framework and indicator use in national vaccination programmes is limited and focused on routine childhood vaccination. Therefore, documentation of more experiences and lessons is needed to better inform vaccination M&E beyond childhood.https://www.mdpi.com/2076-393X/10/4/567vaccinationmonitoringevaluationindicatorsglobal health |
| spellingShingle | Manar Marzouk Maryam Omar Kanchanok Sirison Aparna Ananthakrishnan Anna Durrance-Bagale Chatkamol Pheerapanyawaranun Charatpol Porncharoen Nopphadol Pimsarn Sze Tung Lam Mengieng Ung Zeenathnisa Mougammadou Aribou Saudamini V. Dabak Wanrudee Isaranuwatchai Natasha Howard Monitoring and Evaluation of National Vaccination Implementation: A Scoping Review of How Frameworks and Indicators Are Used in the Public Health Literature Vaccines vaccination monitoring evaluation indicators global health |
| title | Monitoring and Evaluation of National Vaccination Implementation: A Scoping Review of How Frameworks and Indicators Are Used in the Public Health Literature |
| title_full | Monitoring and Evaluation of National Vaccination Implementation: A Scoping Review of How Frameworks and Indicators Are Used in the Public Health Literature |
| title_fullStr | Monitoring and Evaluation of National Vaccination Implementation: A Scoping Review of How Frameworks and Indicators Are Used in the Public Health Literature |
| title_full_unstemmed | Monitoring and Evaluation of National Vaccination Implementation: A Scoping Review of How Frameworks and Indicators Are Used in the Public Health Literature |
| title_short | Monitoring and Evaluation of National Vaccination Implementation: A Scoping Review of How Frameworks and Indicators Are Used in the Public Health Literature |
| title_sort | monitoring and evaluation of national vaccination implementation a scoping review of how frameworks and indicators are used in the public health literature |
| topic | vaccination monitoring evaluation indicators global health |
| url | https://www.mdpi.com/2076-393X/10/4/567 |
| work_keys_str_mv | AT manarmarzouk monitoringandevaluationofnationalvaccinationimplementationascopingreviewofhowframeworksandindicatorsareusedinthepublichealthliterature AT maryamomar monitoringandevaluationofnationalvaccinationimplementationascopingreviewofhowframeworksandindicatorsareusedinthepublichealthliterature AT kanchanoksirison monitoringandevaluationofnationalvaccinationimplementationascopingreviewofhowframeworksandindicatorsareusedinthepublichealthliterature AT aparnaananthakrishnan monitoringandevaluationofnationalvaccinationimplementationascopingreviewofhowframeworksandindicatorsareusedinthepublichealthliterature AT annadurrancebagale monitoringandevaluationofnationalvaccinationimplementationascopingreviewofhowframeworksandindicatorsareusedinthepublichealthliterature AT chatkamolpheerapanyawaranun monitoringandevaluationofnationalvaccinationimplementationascopingreviewofhowframeworksandindicatorsareusedinthepublichealthliterature AT charatpolporncharoen monitoringandevaluationofnationalvaccinationimplementationascopingreviewofhowframeworksandindicatorsareusedinthepublichealthliterature AT nopphadolpimsarn monitoringandevaluationofnationalvaccinationimplementationascopingreviewofhowframeworksandindicatorsareusedinthepublichealthliterature AT szetunglam monitoringandevaluationofnationalvaccinationimplementationascopingreviewofhowframeworksandindicatorsareusedinthepublichealthliterature AT mengiengung monitoringandevaluationofnationalvaccinationimplementationascopingreviewofhowframeworksandindicatorsareusedinthepublichealthliterature AT zeenathnisamougammadouaribou monitoringandevaluationofnationalvaccinationimplementationascopingreviewofhowframeworksandindicatorsareusedinthepublichealthliterature AT saudaminivdabak monitoringandevaluationofnationalvaccinationimplementationascopingreviewofhowframeworksandindicatorsareusedinthepublichealthliterature AT wanrudeeisaranuwatchai monitoringandevaluationofnationalvaccinationimplementationascopingreviewofhowframeworksandindicatorsareusedinthepublichealthliterature AT natashahoward monitoringandevaluationofnationalvaccinationimplementationascopingreviewofhowframeworksandindicatorsareusedinthepublichealthliterature |