Novel approaches to measuring knowledge among frontline health workers in India: Are phone surveys a reliable option?
<h4>Background</h4>In 2017, India was home to nearly 20% of maternal and child deaths occurring globally. Accredited social health activists (ASHAs) act as the frontline for health services delivery in India, providing a range of reproductive, maternal, newborn, child health, and nutriti...
| Main Authors: | , , , , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Public Library of Science (PLoS)
2020-01-01
|
| Series: | PLoS ONE |
| Online Access: | https://doi.org/10.1371/journal.pone.0234241 |
| _version_ | 1828955150748745728 |
|---|---|
| author | Neha Shah Diwakar Mohan Smisha Agarwal Kerry Scott Sara Chamberlain Aarushi Bhatnagar Alain Labrique Meenal Indurkar Rajani Ved Amnesty LeFevre Kilkari Impact Evaluation team |
| author_facet | Neha Shah Diwakar Mohan Smisha Agarwal Kerry Scott Sara Chamberlain Aarushi Bhatnagar Alain Labrique Meenal Indurkar Rajani Ved Amnesty LeFevre Kilkari Impact Evaluation team |
| author_sort | Neha Shah |
| collection | DOAJ |
| description | <h4>Background</h4>In 2017, India was home to nearly 20% of maternal and child deaths occurring globally. Accredited social health activists (ASHAs) act as the frontline for health services delivery in India, providing a range of reproductive, maternal, newborn, child health, and nutrition (RMNCH&N) services. Empirical evidence on ASHAs' knowledge is limited, yet is a critical determinant of the quality of health services provided. We assessed the determinants of RMNCH&N knowledge among ASHAs and examined the reliability of alternative modalities of survey delivery, including face-to-face and caller attended telephone interviews (phone surveys) in 4 districts of Madhya Pradesh, India.<h4>Methods</h4>We carried out face-to-face surveys among a random cross-sectional sample of ASHAs (n = 1,552), and administered a follow-up test-retest survey within 2 weeks of the initial survey to a subsample of ASHAs (n = 173). We interviewed a separate sub-sample of ASHAs 2 weeks of the face-to-face interview over the phone (n = 155). Analyses included bivariate analyses, multivariable linear regression, and prevalence and bias adjusted kappa analyses.<h4>Findings</h4>The average ASHA knowledge score was 64% and ranged across sub-domains from 71% for essential newborn care, 71% for WASH/ diarrhea, 64% for infant feeding, 61% for family planning, and 60% for maternal health. Leading determinants of knowledge included geographic location, age <30 years of age, education, experience as an ASHA, completion of seven or more client visits weekly, phone ownership and use as a communication tool for work, as well as the ability to navigate interactive voice response prompts (a measure of digital literacy). Efforts to develop a phone survey tool for measuring knowledge suggest that findings on inter-rater and inter-modal reliability were similar. Reliability was higher for shorter, widely known questions, including those about timing of exclusive breastfeeding or number of tetanus shots during pregnancy. Questions with lower reliability included those on sensitive topics such as family planning; questions with multiple response options; or which were difficult for the enumerator to convey.<h4>Conclusions</h4>Overall results highlight important gaps in the knowledge of ASHAs. Findings on the reliability of phone surveys led to the development of a tool, which can be widely used for the routine, low cost measurement of ASHA RMNCH&N knowledge in India. |
| first_indexed | 2024-12-14T07:44:59Z |
| format | Article |
| id | doaj.art-11b2c6a8e2c64f3e94a5ae415bd42f00 |
| institution | Directory Open Access Journal |
| issn | 1932-6203 |
| language | English |
| last_indexed | 2024-12-14T07:44:59Z |
| publishDate | 2020-01-01 |
| publisher | Public Library of Science (PLoS) |
| record_format | Article |
| series | PLoS ONE |
| spelling | doaj.art-11b2c6a8e2c64f3e94a5ae415bd42f002022-12-21T23:10:55ZengPublic Library of Science (PLoS)PLoS ONE1932-62032020-01-01156e023424110.1371/journal.pone.0234241Novel approaches to measuring knowledge among frontline health workers in India: Are phone surveys a reliable option?Neha ShahDiwakar MohanSmisha AgarwalKerry ScottSara ChamberlainAarushi BhatnagarAlain LabriqueMeenal IndurkarRajani VedAmnesty LeFevreKilkari Impact Evaluation team<h4>Background</h4>In 2017, India was home to nearly 20% of maternal and child deaths occurring globally. Accredited social health activists (ASHAs) act as the frontline for health services delivery in India, providing a range of reproductive, maternal, newborn, child health, and nutrition (RMNCH&N) services. Empirical evidence on ASHAs' knowledge is limited, yet is a critical determinant of the quality of health services provided. We assessed the determinants of RMNCH&N knowledge among ASHAs and examined the reliability of alternative modalities of survey delivery, including face-to-face and caller attended telephone interviews (phone surveys) in 4 districts of Madhya Pradesh, India.<h4>Methods</h4>We carried out face-to-face surveys among a random cross-sectional sample of ASHAs (n = 1,552), and administered a follow-up test-retest survey within 2 weeks of the initial survey to a subsample of ASHAs (n = 173). We interviewed a separate sub-sample of ASHAs 2 weeks of the face-to-face interview over the phone (n = 155). Analyses included bivariate analyses, multivariable linear regression, and prevalence and bias adjusted kappa analyses.<h4>Findings</h4>The average ASHA knowledge score was 64% and ranged across sub-domains from 71% for essential newborn care, 71% for WASH/ diarrhea, 64% for infant feeding, 61% for family planning, and 60% for maternal health. Leading determinants of knowledge included geographic location, age <30 years of age, education, experience as an ASHA, completion of seven or more client visits weekly, phone ownership and use as a communication tool for work, as well as the ability to navigate interactive voice response prompts (a measure of digital literacy). Efforts to develop a phone survey tool for measuring knowledge suggest that findings on inter-rater and inter-modal reliability were similar. Reliability was higher for shorter, widely known questions, including those about timing of exclusive breastfeeding or number of tetanus shots during pregnancy. Questions with lower reliability included those on sensitive topics such as family planning; questions with multiple response options; or which were difficult for the enumerator to convey.<h4>Conclusions</h4>Overall results highlight important gaps in the knowledge of ASHAs. Findings on the reliability of phone surveys led to the development of a tool, which can be widely used for the routine, low cost measurement of ASHA RMNCH&N knowledge in India.https://doi.org/10.1371/journal.pone.0234241 |
| spellingShingle | Neha Shah Diwakar Mohan Smisha Agarwal Kerry Scott Sara Chamberlain Aarushi Bhatnagar Alain Labrique Meenal Indurkar Rajani Ved Amnesty LeFevre Kilkari Impact Evaluation team Novel approaches to measuring knowledge among frontline health workers in India: Are phone surveys a reliable option? PLoS ONE |
| title | Novel approaches to measuring knowledge among frontline health workers in India: Are phone surveys a reliable option? |
| title_full | Novel approaches to measuring knowledge among frontline health workers in India: Are phone surveys a reliable option? |
| title_fullStr | Novel approaches to measuring knowledge among frontline health workers in India: Are phone surveys a reliable option? |
| title_full_unstemmed | Novel approaches to measuring knowledge among frontline health workers in India: Are phone surveys a reliable option? |
| title_short | Novel approaches to measuring knowledge among frontline health workers in India: Are phone surveys a reliable option? |
| title_sort | novel approaches to measuring knowledge among frontline health workers in india are phone surveys a reliable option |
| url | https://doi.org/10.1371/journal.pone.0234241 |
| work_keys_str_mv | AT nehashah novelapproachestomeasuringknowledgeamongfrontlinehealthworkersinindiaarephonesurveysareliableoption AT diwakarmohan novelapproachestomeasuringknowledgeamongfrontlinehealthworkersinindiaarephonesurveysareliableoption AT smishaagarwal novelapproachestomeasuringknowledgeamongfrontlinehealthworkersinindiaarephonesurveysareliableoption AT kerryscott novelapproachestomeasuringknowledgeamongfrontlinehealthworkersinindiaarephonesurveysareliableoption AT sarachamberlain novelapproachestomeasuringknowledgeamongfrontlinehealthworkersinindiaarephonesurveysareliableoption AT aarushibhatnagar novelapproachestomeasuringknowledgeamongfrontlinehealthworkersinindiaarephonesurveysareliableoption AT alainlabrique novelapproachestomeasuringknowledgeamongfrontlinehealthworkersinindiaarephonesurveysareliableoption AT meenalindurkar novelapproachestomeasuringknowledgeamongfrontlinehealthworkersinindiaarephonesurveysareliableoption AT rajanived novelapproachestomeasuringknowledgeamongfrontlinehealthworkersinindiaarephonesurveysareliableoption AT amnestylefevre novelapproachestomeasuringknowledgeamongfrontlinehealthworkersinindiaarephonesurveysareliableoption AT kilkariimpactevaluationteam novelapproachestomeasuringknowledgeamongfrontlinehealthworkersinindiaarephonesurveysareliableoption |