Android-based object recognition application for visually impaired
Detecting objects in real-time and converting them into an audio output was a challenging task. Recent advancement in computer vision has allowed the development of various real-time object detection applications. This paper describes a simple android app that would help the visually impaired people...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
EDP Sciences
2021-01-01
|
| Series: | ITM Web of Conferences |
| Subjects: | |
| Online Access: | https://www.itm-conferences.org/articles/itmconf/pdf/2021/05/itmconf_icacc2021_03001.pdf |
| _version_ | 1818882592644005888 |
|---|---|
| author | Salunkhe Akilesh Raut Manthan Santra Shayantan Bhagwat Sumedha |
| author_facet | Salunkhe Akilesh Raut Manthan Santra Shayantan Bhagwat Sumedha |
| author_sort | Salunkhe Akilesh |
| collection | DOAJ |
| description | Detecting objects in real-time and converting them into an audio output was a challenging task. Recent advancement in computer vision has allowed the development of various real-time object detection applications. This paper describes a simple android app that would help the visually impaired people in understanding their surroundings. The information about the surrounding environment was captured through a phone’s camera where real-time object recognition through tensorflow’s object detection API was done. The detected objects were then converted into an audio output by using android’s text-to-speech library. Tensorflow lite made the offline processing of complex algorithms simple. The overall accuracy of the proposed system was found to be approximately 90%. |
| first_indexed | 2024-12-19T15:20:13Z |
| format | Article |
| id | doaj.art-2659ffeb8df34665b175b9f6428720e1 |
| institution | Directory Open Access Journal |
| issn | 2271-2097 |
| language | English |
| last_indexed | 2024-12-19T15:20:13Z |
| publishDate | 2021-01-01 |
| publisher | EDP Sciences |
| record_format | Article |
| series | ITM Web of Conferences |
| spelling | doaj.art-2659ffeb8df34665b175b9f6428720e12022-12-21T20:16:01ZengEDP SciencesITM Web of Conferences2271-20972021-01-01400300110.1051/itmconf/20214003001itmconf_icacc2021_03001Android-based object recognition application for visually impairedSalunkhe Akilesh0Raut Manthan1Santra Shayantan2Bhagwat Sumedha3Department of Information Technology, Ramrao Adik Institute of TechnologyDepartment of Information Technology, Ramrao Adik Institute of TechnologyDepartment of Information Technology, Ramrao Adik Institute of TechnologyMentor from Department of Information Technology, Ramrao Adik Institute of TechnologyDetecting objects in real-time and converting them into an audio output was a challenging task. Recent advancement in computer vision has allowed the development of various real-time object detection applications. This paper describes a simple android app that would help the visually impaired people in understanding their surroundings. The information about the surrounding environment was captured through a phone’s camera where real-time object recognition through tensorflow’s object detection API was done. The detected objects were then converted into an audio output by using android’s text-to-speech library. Tensorflow lite made the offline processing of complex algorithms simple. The overall accuracy of the proposed system was found to be approximately 90%.https://www.itm-conferences.org/articles/itmconf/pdf/2021/05/itmconf_icacc2021_03001.pdftensorflowtensorflow litemachine learningcomputer visionobject recognitionandroid |
| spellingShingle | Salunkhe Akilesh Raut Manthan Santra Shayantan Bhagwat Sumedha Android-based object recognition application for visually impaired ITM Web of Conferences tensorflow tensorflow lite machine learning computer vision object recognition android |
| title | Android-based object recognition application for visually impaired |
| title_full | Android-based object recognition application for visually impaired |
| title_fullStr | Android-based object recognition application for visually impaired |
| title_full_unstemmed | Android-based object recognition application for visually impaired |
| title_short | Android-based object recognition application for visually impaired |
| title_sort | android based object recognition application for visually impaired |
| topic | tensorflow tensorflow lite machine learning computer vision object recognition android |
| url | https://www.itm-conferences.org/articles/itmconf/pdf/2021/05/itmconf_icacc2021_03001.pdf |
| work_keys_str_mv | AT salunkheakilesh androidbasedobjectrecognitionapplicationforvisuallyimpaired AT rautmanthan androidbasedobjectrecognitionapplicationforvisuallyimpaired AT santrashayantan androidbasedobjectrecognitionapplicationforvisuallyimpaired AT bhagwatsumedha androidbasedobjectrecognitionapplicationforvisuallyimpaired |