FingerReader: A Wearable Device to Explore Printed Text on the Go
Accessing printed text in a mobile context is a major challenge for the blind. A preliminary study with blind people reveals numerous difficulties with existing state-of-the-art technologies including problems with alignment, focus, accuracy, mobility and efficiency. In this paper, we present a fing...
| Main Authors: | , , , , |
|---|---|
| Other Authors: | |
| Format: | Article |
| Language: | en_US |
| Published: |
Association for Computing Machinery (ACM)
2015
|
| Online Access: | http://hdl.handle.net/1721.1/95971 https://orcid.org/0000-0002-7722-6038 https://orcid.org/0000-0001-9154-4254 |
| _version_ | 1826197215622725632 |
|---|---|
| author | Shilkrot, Roy Maes, Patricia Huber, Jochen Wong, Meng Ee Nanayakkara, Suranga |
| author2 | Massachusetts Institute of Technology. Media Laboratory |
| author_facet | Massachusetts Institute of Technology. Media Laboratory Shilkrot, Roy Maes, Patricia Huber, Jochen Wong, Meng Ee Nanayakkara, Suranga |
| author_sort | Shilkrot, Roy |
| collection | MIT |
| description | Accessing printed text in a mobile context is a major challenge for the blind. A preliminary study with blind people reveals numerous difficulties with existing state-of-the-art technologies including problems with alignment, focus, accuracy, mobility and efficiency. In this paper, we present a finger-worn device, FingerReader, that assists blind users with reading printed text on the go. We introduce a novel computer vision algorithm for local-sequential text scanning that enables reading single lines, blocks of text or skimming the text with complementary, multimodal feedback. This system is implemented in a small finger-worn form factor, that enables a more manageable eyes-free operation with trivial setup. We offer findings from three studies performed to determine the usability of the FingerReader. |
| first_indexed | 2024-09-23T10:44:35Z |
| format | Article |
| id | mit-1721.1/95971 |
| institution | Massachusetts Institute of Technology |
| language | en_US |
| last_indexed | 2024-09-23T10:44:35Z |
| publishDate | 2015 |
| publisher | Association for Computing Machinery (ACM) |
| record_format | dspace |
| spelling | mit-1721.1/959712022-09-30T22:39:38Z FingerReader: A Wearable Device to Explore Printed Text on the Go Shilkrot, Roy Maes, Patricia Huber, Jochen Wong, Meng Ee Nanayakkara, Suranga Massachusetts Institute of Technology. Media Laboratory Program in Media Arts and Sciences (Massachusetts Institute of Technology) Shilkrot, Roy Maes, Patricia Huber, Jochen Accessing printed text in a mobile context is a major challenge for the blind. A preliminary study with blind people reveals numerous difficulties with existing state-of-the-art technologies including problems with alignment, focus, accuracy, mobility and efficiency. In this paper, we present a finger-worn device, FingerReader, that assists blind users with reading printed text on the go. We introduce a novel computer vision algorithm for local-sequential text scanning that enables reading single lines, blocks of text or skimming the text with complementary, multimodal feedback. This system is implemented in a small finger-worn form factor, that enables a more manageable eyes-free operation with trivial setup. We offer findings from three studies performed to determine the usability of the FingerReader. SUTD-MIT International Design Centre 2015-03-12T12:33:27Z 2015-03-12T12:33:27Z 2015-04 Article http://purl.org/eprint/type/ConferencePaper 978-1-4503-3145-6 http://hdl.handle.net/1721.1/95971 Shilkrot, Roy, Jochen Huber, Meng Ee Wong, Pattie Maes. “FingerReader: A Wearable Device to Explore Printed Text on the Go.” CHI 2015 Crossings, Conference on Human Factors in Computing Systems (April 18-23, 2015), Seoul, Korea. https://orcid.org/0000-0002-7722-6038 https://orcid.org/0000-0001-9154-4254 en_US http://confer.csail.mit.edu/chi2015/paper#!pn1559 Proceedings of the CHI 2015 Crossings Creative Commons Attribution-Noncommercial-Share Alike http://creativecommons.org/licenses/by-nc-sa/4.0/ application/pdf Association for Computing Machinery (ACM) MIT web domain |
| spellingShingle | Shilkrot, Roy Maes, Patricia Huber, Jochen Wong, Meng Ee Nanayakkara, Suranga FingerReader: A Wearable Device to Explore Printed Text on the Go |
| title | FingerReader: A Wearable Device to Explore Printed Text on the Go |
| title_full | FingerReader: A Wearable Device to Explore Printed Text on the Go |
| title_fullStr | FingerReader: A Wearable Device to Explore Printed Text on the Go |
| title_full_unstemmed | FingerReader: A Wearable Device to Explore Printed Text on the Go |
| title_short | FingerReader: A Wearable Device to Explore Printed Text on the Go |
| title_sort | fingerreader a wearable device to explore printed text on the go |
| url | http://hdl.handle.net/1721.1/95971 https://orcid.org/0000-0002-7722-6038 https://orcid.org/0000-0001-9154-4254 |
| work_keys_str_mv | AT shilkrotroy fingerreaderawearabledevicetoexploreprintedtextonthego AT maespatricia fingerreaderawearabledevicetoexploreprintedtextonthego AT huberjochen fingerreaderawearabledevicetoexploreprintedtextonthego AT wongmengee fingerreaderawearabledevicetoexploreprintedtextonthego AT nanayakkarasuranga fingerreaderawearabledevicetoexploreprintedtextonthego |