Evaluation of IVR data collection UIs for untrained rural users

Due to the rapid spread of mobile phones and coverage in the developing world, mobile phones are being increasingly used as a technology platform for developing-world applications including data collection. In order to reach the vast majority of mobile phone users without access to specialized softw...

Full description

Bibliographic Details
Main Authors: Lerer, Adam, Ward, Molly, Amarasinghe, Saman P.
Other Authors: Massachusetts Institute of Technology. Computer Science and Artificial Intelligence Laboratory
Format: Article
Language:en_US
Published: Association for Computing Machinery 2012
Online Access:http://hdl.handle.net/1721.1/73000
https://orcid.org/0000-0002-7231-7643
_version_ 1811092132187865088
author Lerer, Adam
Ward, Molly
Amarasinghe, Saman P.
author2 Massachusetts Institute of Technology. Computer Science and Artificial Intelligence Laboratory
author_facet Massachusetts Institute of Technology. Computer Science and Artificial Intelligence Laboratory
Lerer, Adam
Ward, Molly
Amarasinghe, Saman P.
author_sort Lerer, Adam
collection MIT
description Due to the rapid spread of mobile phones and coverage in the developing world, mobile phones are being increasingly used as a technology platform for developing-world applications including data collection. In order to reach the vast majority of mobile phone users without access to specialized software, applications must make use of interactive voice response (IVR) UIs. However, it is unclear whether rural users in the developing world can use such UIs without prior training or IVR experience; and if so, what UI design choices improve usability for these target populations. This paper presents the results of a real-world deployment of an IVR application for collecting feedback from teachers in rural Uganda. Automated IVR data collection calls were delivered to over 150 teachers over a period of several months. Modifications were made to the IVR interface throughout the study period in response to user interviews and recorded transcripts of survey calls. Significant differences in task success rate were observed for different interface designs (from 0% to over 75% success). Notably, most participants were not able to use a touchtone or touchtone-voice hybrid interface without prior training. A set of design recommendations is proposed based on the performance of several tested interface designs.
first_indexed 2024-09-23T15:13:29Z
format Article
id mit-1721.1/73000
institution Massachusetts Institute of Technology
language en_US
last_indexed 2024-09-23T15:13:29Z
publishDate 2012
publisher Association for Computing Machinery
record_format dspace
spelling mit-1721.1/730002022-10-02T01:28:03Z Evaluation of IVR data collection UIs for untrained rural users Lerer, Adam Ward, Molly Amarasinghe, Saman P. Massachusetts Institute of Technology. Computer Science and Artificial Intelligence Laboratory Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science Amarasinghe, Saman P. Amarasinghe, Saman P. Lerer, Adam Due to the rapid spread of mobile phones and coverage in the developing world, mobile phones are being increasingly used as a technology platform for developing-world applications including data collection. In order to reach the vast majority of mobile phone users without access to specialized software, applications must make use of interactive voice response (IVR) UIs. However, it is unclear whether rural users in the developing world can use such UIs without prior training or IVR experience; and if so, what UI design choices improve usability for these target populations. This paper presents the results of a real-world deployment of an IVR application for collecting feedback from teachers in rural Uganda. Automated IVR data collection calls were delivered to over 150 teachers over a period of several months. Modifications were made to the IVR interface throughout the study period in response to user interviews and recorded transcripts of survey calls. Significant differences in task success rate were observed for different interface designs (from 0% to over 75% success). Notably, most participants were not able to use a touchtone or touchtone-voice hybrid interface without prior training. A set of design recommendations is proposed based on the performance of several tested interface designs. 2012-09-17T16:05:28Z 2012-09-17T16:05:28Z 2010-12 Article http://purl.org/eprint/type/ConferencePaper 978-1-4503-0473-3 Article No. 2 http://hdl.handle.net/1721.1/73000 Lerer, Adam, Molly Ward, and Saman Amarasinghe. “Evaluation of IVR Data Collection UIs for Untrained Rural Users.” Proceedings of the First ACM Symposium on Computing for Development, ACM DEV’10, December 17–18, 2010, London, United Kingdom, ACM Press, 2010. 1. Web. https://orcid.org/0000-0002-7231-7643 en_US http://dx.doi.org/10.1145/1926180.1926183 Proceedings of the First ACM Symposium on Computing for Development, ACM DEV '10 Creative Commons Attribution-Noncommercial-Share Alike 3.0 http://creativecommons.org/licenses/by-nc-sa/3.0/ application/pdf Association for Computing Machinery Other Repository
spellingShingle Lerer, Adam
Ward, Molly
Amarasinghe, Saman P.
Evaluation of IVR data collection UIs for untrained rural users
title Evaluation of IVR data collection UIs for untrained rural users
title_full Evaluation of IVR data collection UIs for untrained rural users
title_fullStr Evaluation of IVR data collection UIs for untrained rural users
title_full_unstemmed Evaluation of IVR data collection UIs for untrained rural users
title_short Evaluation of IVR data collection UIs for untrained rural users
title_sort evaluation of ivr data collection uis for untrained rural users
url http://hdl.handle.net/1721.1/73000
https://orcid.org/0000-0002-7231-7643
work_keys_str_mv AT lereradam evaluationofivrdatacollectionuisforuntrainedruralusers
AT wardmolly evaluationofivrdatacollectionuisforuntrainedruralusers
AT amarasinghesamanp evaluationofivrdatacollectionuisforuntrainedruralusers