Improving the accuracy of Interactive Voice Response (IVR) Technology for pediatric experience scores

The increased use of interactive voice response (IVR) in assessing patient and family experience should be paired with evidence-based practices on how to obtain the most accurate information via this survey mode. We added a brief clarification sentence of the survey scale at the start of the IVR cal...

Full description

Bibliographic Details
Main Authors: Elizabeth Spaargaren, Abigail Kozak, Cara Herbener, Barbara Lawlor Burke
Format: Article
Language:English
Published: The Beryl Institute 2022-11-01
Series:Patient Experience Journal
Subjects:
Online Access:https://pxjournal.org/journal/vol9/iss3/12
_version_ 1811330135466442752
author Elizabeth Spaargaren
Abigail Kozak
Cara Herbener
Barbara Lawlor Burke
author_facet Elizabeth Spaargaren
Abigail Kozak
Cara Herbener
Barbara Lawlor Burke
author_sort Elizabeth Spaargaren
collection DOAJ
description The increased use of interactive voice response (IVR) in assessing patient and family experience should be paired with evidence-based practices on how to obtain the most accurate information via this survey mode. We added a brief clarification sentence of the survey scale at the start of the IVR call to improve our experience data both qualitatively and quantitatively. Our setting was an urban pediatric hospital. We gathered lived experiences from our patients, families, and providers to understand and design a change to the IVR survey mode that would reduce survey inaccuracies. Outcome measures were assessed by baseline measurement and post-intervention statistical analysis. Outcome measures were the percent of family comments related to survey errors and the discrepancy in scores for the first question of the survey between the two survey modes, IVR and email. One Plan-Do-Study-Act (PDSA) cycle was used to improve the accuracy of the IVR survey mode. The family survey comments expressing errors made on the first question of the IVR survey were reduced by 92% from a 2.5% (N=3,344 comments) error rate to a 0.2% (N=3,373) error rate. The discrepancy between the first question scores for IVR vs. email reduced by an average of 76.8% change (17.4 vs. 3.8) over a 20-month study period. Our initiative exceeded our goal by statistically significantly reducing the percent of comments expressing errors and the gap in survey mode first question scores. <strong>Experience Framework</strong> This article is associated with the Innovation & Technology lens of The Beryl Institute Experience Framework (<a href="https://www.theberylinstitute.org/ExperienceFramework">https://www.theberylinstitute.org/ExperienceFramework</a>). <ul> <li><a href="https://www.theberylinstitute.org/page/PXSEARCH#resource-list-all/?view_28_page=1&view_28_filters=%5B%7B%22field%22%3A%22field_38%22%2C%22operator%22%3A%22in%22%2C%22value%22%3A%5B%22PXJ%20Article%22%5D%7D%2C%7B%22field%22%3A%22field_40%22%2C%22operator%22%3A%22in%22%2C%22value%22%3A%5B%22Innovation%20%26%20Technology%22%5D%7D%5D">Access other PXJ articles</a> related to this lens.</li> <li><a href="https://www.theberylinstitute.org/page/Ecosystem-InnovationTechnology">Access other resources</a> related to this lens</li> </ul>
first_indexed 2024-04-13T15:56:01Z
format Article
id doaj.art-233f6ff716ee49b1961806750a7d12c0
institution Directory Open Access Journal
issn 2372-0247
language English
last_indexed 2024-04-13T15:56:01Z
publishDate 2022-11-01
publisher The Beryl Institute
record_format Article
series Patient Experience Journal
spelling doaj.art-233f6ff716ee49b1961806750a7d12c02022-12-22T02:40:40ZengThe Beryl InstitutePatient Experience Journal2372-02472022-11-0193Improving the accuracy of Interactive Voice Response (IVR) Technology for pediatric experience scoresElizabeth SpaargarenAbigail KozakCara HerbenerBarbara Lawlor BurkeThe increased use of interactive voice response (IVR) in assessing patient and family experience should be paired with evidence-based practices on how to obtain the most accurate information via this survey mode. We added a brief clarification sentence of the survey scale at the start of the IVR call to improve our experience data both qualitatively and quantitatively. Our setting was an urban pediatric hospital. We gathered lived experiences from our patients, families, and providers to understand and design a change to the IVR survey mode that would reduce survey inaccuracies. Outcome measures were assessed by baseline measurement and post-intervention statistical analysis. Outcome measures were the percent of family comments related to survey errors and the discrepancy in scores for the first question of the survey between the two survey modes, IVR and email. One Plan-Do-Study-Act (PDSA) cycle was used to improve the accuracy of the IVR survey mode. The family survey comments expressing errors made on the first question of the IVR survey were reduced by 92% from a 2.5% (N=3,344 comments) error rate to a 0.2% (N=3,373) error rate. The discrepancy between the first question scores for IVR vs. email reduced by an average of 76.8% change (17.4 vs. 3.8) over a 20-month study period. Our initiative exceeded our goal by statistically significantly reducing the percent of comments expressing errors and the gap in survey mode first question scores. <strong>Experience Framework</strong> This article is associated with the Innovation & Technology lens of The Beryl Institute Experience Framework (<a href="https://www.theberylinstitute.org/ExperienceFramework">https://www.theberylinstitute.org/ExperienceFramework</a>). <ul> <li><a href="https://www.theberylinstitute.org/page/PXSEARCH#resource-list-all/?view_28_page=1&view_28_filters=%5B%7B%22field%22%3A%22field_38%22%2C%22operator%22%3A%22in%22%2C%22value%22%3A%5B%22PXJ%20Article%22%5D%7D%2C%7B%22field%22%3A%22field_40%22%2C%22operator%22%3A%22in%22%2C%22value%22%3A%5B%22Innovation%20%26%20Technology%22%5D%7D%5D">Access other PXJ articles</a> related to this lens.</li> <li><a href="https://www.theberylinstitute.org/page/Ecosystem-InnovationTechnology">Access other resources</a> related to this lens</li> </ul>https://pxjournal.org/journal/vol9/iss3/12patient experiencepatient family experiencemeasurementqualitative dataquantitative datainteractive voice responseivrsurvey modephone callpediatricsquality improvement
spellingShingle Elizabeth Spaargaren
Abigail Kozak
Cara Herbener
Barbara Lawlor Burke
Improving the accuracy of Interactive Voice Response (IVR) Technology for pediatric experience scores
Patient Experience Journal
patient experience
patient family experience
measurement
qualitative data
quantitative data
interactive voice response
ivr
survey mode
phone call
pediatrics
quality improvement
title Improving the accuracy of Interactive Voice Response (IVR) Technology for pediatric experience scores
title_full Improving the accuracy of Interactive Voice Response (IVR) Technology for pediatric experience scores
title_fullStr Improving the accuracy of Interactive Voice Response (IVR) Technology for pediatric experience scores
title_full_unstemmed Improving the accuracy of Interactive Voice Response (IVR) Technology for pediatric experience scores
title_short Improving the accuracy of Interactive Voice Response (IVR) Technology for pediatric experience scores
title_sort improving the accuracy of interactive voice response ivr technology for pediatric experience scores
topic patient experience
patient family experience
measurement
qualitative data
quantitative data
interactive voice response
ivr
survey mode
phone call
pediatrics
quality improvement
url https://pxjournal.org/journal/vol9/iss3/12
work_keys_str_mv AT elizabethspaargaren improvingtheaccuracyofinteractivevoiceresponseivrtechnologyforpediatricexperiencescores
AT abigailkozak improvingtheaccuracyofinteractivevoiceresponseivrtechnologyforpediatricexperiencescores
AT caraherbener improvingtheaccuracyofinteractivevoiceresponseivrtechnologyforpediatricexperiencescores
AT barbaralawlorburke improvingtheaccuracyofinteractivevoiceresponseivrtechnologyforpediatricexperiencescores