Evaluating the vaccination coverage: validity of household-hold vaccination booklet and caregiver’s recall

Background We compared results from household data sources to medical record sources by using data from a vaccination coverage survey. Methods Vaccination coverage (VC) was calculated based on parental recall, household vaccination booklet, and Zhejiang provincial immunization information system (ZJ...

Full description

Bibliographic Details
Main Authors: Yu Hu, Hu Liang, Fuxing Chen, Linzhi Shen, Xuejiao Pan, Ying Wang, Yaping Chen, Huakun Lv
Format: Article
Language:English
Published: Taylor & Francis Group 2021-09-01
Series:Human Vaccines & Immunotherapeutics
Subjects:
Online Access:http://dx.doi.org/10.1080/21645515.2021.1906151
_version_ 1827807691521654784
author Yu Hu
Hu Liang
Fuxing Chen
Linzhi Shen
Xuejiao Pan
Ying Wang
Yaping Chen
Huakun Lv
author_facet Yu Hu
Hu Liang
Fuxing Chen
Linzhi Shen
Xuejiao Pan
Ying Wang
Yaping Chen
Huakun Lv
author_sort Yu Hu
collection DOAJ
description Background We compared results from household data sources to medical record sources by using data from a vaccination coverage survey. Methods Vaccination coverage (VC) was calculated based on parental recall, household vaccination booklet, and Zhejiang provincial immunization information system (ZJIIS). We evaluated the accuracy of VC based on household sources (vaccination booklet and recall) assuming the medical record was accurate. Concordance, sensitivity, specificity, positive predictive value, and negative predictive value were estimated as well as the Kappa statistic was also used to evaluate the agreement between data sources. Results Among the 1,800 children identified in the household survey, all were registered in ZJIIS. VC estimated using the vaccination booklet alone was substantially lower than that based on medical records (net bias 3.4–16.7% in different age groups). VC based on parental recall ranged from 2.5% below (among children aged 1 year) to 16.7% points above (among children aged 6 years) than those based on medical records. Concordance was lowest for card estimates (32.5–45.5%). Sensitivity was <60% for all household sources, except for recall source. Specificity was lowest for recall estimates (14.5–42.6%). Positive predictive value was >75%, while negative predictive value was <50%, for all household sources. Kappa statistics generally indicated poor agreement between household and medical record sources. Conclusions Household-retained vaccination booklets and parental recall were insufficient sources for evaluating the VC. Our findings emphasized the importance of taking interventions to make the vaccination booklet more consistent with the records from medical resource.
first_indexed 2024-03-11T22:01:01Z
format Article
id doaj.art-c36b642fce0146e3a92bafe6186c3c1e
institution Directory Open Access Journal
issn 2164-5515
2164-554X
language English
last_indexed 2024-03-11T22:01:01Z
publishDate 2021-09-01
publisher Taylor & Francis Group
record_format Article
series Human Vaccines & Immunotherapeutics
spelling doaj.art-c36b642fce0146e3a92bafe6186c3c1e2023-09-25T11:17:06ZengTaylor & Francis GroupHuman Vaccines & Immunotherapeutics2164-55152164-554X2021-09-011793034304110.1080/21645515.2021.19061511906151Evaluating the vaccination coverage: validity of household-hold vaccination booklet and caregiver’s recallYu Hu0Hu Liang1Fuxing Chen2Linzhi Shen3Xuejiao Pan4Ying Wang5Yaping Chen6Huakun Lv7Zhejiang Center for Disease Control and PreventionZhejiang Center for Disease Control and PreventionZhejiang Center for Disease Control and PreventionZhejiang Center for Disease Control and PreventionZhejiang Center for Disease Control and PreventionZhejiang Center for Disease Control and PreventionZhejiang Center for Disease Control and PreventionZhejiang Center for Disease Control and PreventionBackground We compared results from household data sources to medical record sources by using data from a vaccination coverage survey. Methods Vaccination coverage (VC) was calculated based on parental recall, household vaccination booklet, and Zhejiang provincial immunization information system (ZJIIS). We evaluated the accuracy of VC based on household sources (vaccination booklet and recall) assuming the medical record was accurate. Concordance, sensitivity, specificity, positive predictive value, and negative predictive value were estimated as well as the Kappa statistic was also used to evaluate the agreement between data sources. Results Among the 1,800 children identified in the household survey, all were registered in ZJIIS. VC estimated using the vaccination booklet alone was substantially lower than that based on medical records (net bias 3.4–16.7% in different age groups). VC based on parental recall ranged from 2.5% below (among children aged 1 year) to 16.7% points above (among children aged 6 years) than those based on medical records. Concordance was lowest for card estimates (32.5–45.5%). Sensitivity was <60% for all household sources, except for recall source. Specificity was lowest for recall estimates (14.5–42.6%). Positive predictive value was >75%, while negative predictive value was <50%, for all household sources. Kappa statistics generally indicated poor agreement between household and medical record sources. Conclusions Household-retained vaccination booklets and parental recall were insufficient sources for evaluating the VC. Our findings emphasized the importance of taking interventions to make the vaccination booklet more consistent with the records from medical resource.http://dx.doi.org/10.1080/21645515.2021.1906151immunizationvaccination coveragesurvey biasvalidityrecall
spellingShingle Yu Hu
Hu Liang
Fuxing Chen
Linzhi Shen
Xuejiao Pan
Ying Wang
Yaping Chen
Huakun Lv
Evaluating the vaccination coverage: validity of household-hold vaccination booklet and caregiver’s recall
Human Vaccines & Immunotherapeutics
immunization
vaccination coverage
survey bias
validity
recall
title Evaluating the vaccination coverage: validity of household-hold vaccination booklet and caregiver’s recall
title_full Evaluating the vaccination coverage: validity of household-hold vaccination booklet and caregiver’s recall
title_fullStr Evaluating the vaccination coverage: validity of household-hold vaccination booklet and caregiver’s recall
title_full_unstemmed Evaluating the vaccination coverage: validity of household-hold vaccination booklet and caregiver’s recall
title_short Evaluating the vaccination coverage: validity of household-hold vaccination booklet and caregiver’s recall
title_sort evaluating the vaccination coverage validity of household hold vaccination booklet and caregiver s recall
topic immunization
vaccination coverage
survey bias
validity
recall
url http://dx.doi.org/10.1080/21645515.2021.1906151
work_keys_str_mv AT yuhu evaluatingthevaccinationcoveragevalidityofhouseholdholdvaccinationbookletandcaregiversrecall
AT huliang evaluatingthevaccinationcoveragevalidityofhouseholdholdvaccinationbookletandcaregiversrecall
AT fuxingchen evaluatingthevaccinationcoveragevalidityofhouseholdholdvaccinationbookletandcaregiversrecall
AT linzhishen evaluatingthevaccinationcoveragevalidityofhouseholdholdvaccinationbookletandcaregiversrecall
AT xuejiaopan evaluatingthevaccinationcoveragevalidityofhouseholdholdvaccinationbookletandcaregiversrecall
AT yingwang evaluatingthevaccinationcoveragevalidityofhouseholdholdvaccinationbookletandcaregiversrecall
AT yapingchen evaluatingthevaccinationcoveragevalidityofhouseholdholdvaccinationbookletandcaregiversrecall
AT huakunlv evaluatingthevaccinationcoveragevalidityofhouseholdholdvaccinationbookletandcaregiversrecall