INVys: Indoor Navigation System for Persons with Visual Impairment Using RGB-D Camera
This research presents the INVys system aiming to solve the problem of indoor navigation for persons with visual impairment by leveraging the capabilities of an RGB-D camera. The system utilizes the depth information provided by the camera for micronavigation, which involves sensing and avoiding obs...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Universitas Gadjah Mada
2023-11-01
|
| Series: | Jurnal Nasional Teknik Elektro dan Teknologi Informasi |
| Subjects: | |
| Online Access: | https://jurnal.ugm.ac.id/v3/JNTETI/article/view/6372 |
| _version_ | 1797404640370753536 |
|---|---|
| author | Widyawan Muhamad Risqi Utama Saputra Paulus Insap Santosa |
| author_facet | Widyawan Muhamad Risqi Utama Saputra Paulus Insap Santosa |
| author_sort | Widyawan |
| collection | DOAJ |
| description | This research presents the INVys system aiming to solve the problem of indoor navigation for persons with visual impairment by leveraging the capabilities of an RGB-D camera. The system utilizes the depth information provided by the camera for micronavigation, which involves sensing and avoiding obstacles in the immediate environment. The INVys system proposes a novel auto-adaptive double thresholding (AADT) method to detect obstacles, calculate their distance, and provide feedback to the user to avoid them. AADT has been evaluated and compared to baseline and auto-adaptive thresholding (AAT) methods using four criteria: accuracy, precision, robustness, and execution time. The results indicate that AADT excels in accuracy, precision, and robustness, making it a suitable method for obstacle detection and avoidance in the context of indoor navigation for persons with visual impairment. In addition to micronavigation, the INVys system utilizes the color information provided by the camera for macro-navigation, which involves recognizing and following navigational markers called optical glyphs. The system uses an automatic glyph binarization method to recognize the glyphs and evaluates them using two criteria: accuracy and execution time. The results indicate that the proposed method is accurate and efficient in recognizing the optical glyphs, making it suitable for use as a navigational marker in indoor environments. Furthermore, the study also provides a correlation between the size of the glyphs, the distance of the recognized glyphs, the tilt condition of the recognized glyphs, and the accuracy of glyph recognition. These correlations define the minimum glyph size that can be practically used for indoor navigation for persons with visual impairment. Overall, this research presents a promising solution for indoor navigation for persons with visual impairment by leveraging the capabilities of an RGB-D camera and proposing novel methods for obstacle detection and avoidance and for recognizing navigational markers. |
| first_indexed | 2024-03-09T02:57:57Z |
| format | Article |
| id | doaj.art-5b9d80de9b3346cc83b9d8b78e647475 |
| institution | Directory Open Access Journal |
| issn | 2301-4156 2460-5719 |
| language | English |
| last_indexed | 2024-03-09T02:57:57Z |
| publishDate | 2023-11-01 |
| publisher | Universitas Gadjah Mada |
| record_format | Article |
| series | Jurnal Nasional Teknik Elektro dan Teknologi Informasi |
| spelling | doaj.art-5b9d80de9b3346cc83b9d8b78e6474752023-12-05T01:29:32ZengUniversitas Gadjah MadaJurnal Nasional Teknik Elektro dan Teknologi Informasi2301-41562460-57192023-11-0112429330210.22146/jnteti.v12i4.63726372INVys: Indoor Navigation System for Persons with Visual Impairment Using RGB-D CameraWidyawan0Muhamad Risqi Utama Saputra1Paulus Insap Santosa2Universitas Gadjah MadaMonash University, IndonesiaUniversitas Gadjah MadaThis research presents the INVys system aiming to solve the problem of indoor navigation for persons with visual impairment by leveraging the capabilities of an RGB-D camera. The system utilizes the depth information provided by the camera for micronavigation, which involves sensing and avoiding obstacles in the immediate environment. The INVys system proposes a novel auto-adaptive double thresholding (AADT) method to detect obstacles, calculate their distance, and provide feedback to the user to avoid them. AADT has been evaluated and compared to baseline and auto-adaptive thresholding (AAT) methods using four criteria: accuracy, precision, robustness, and execution time. The results indicate that AADT excels in accuracy, precision, and robustness, making it a suitable method for obstacle detection and avoidance in the context of indoor navigation for persons with visual impairment. In addition to micronavigation, the INVys system utilizes the color information provided by the camera for macro-navigation, which involves recognizing and following navigational markers called optical glyphs. The system uses an automatic glyph binarization method to recognize the glyphs and evaluates them using two criteria: accuracy and execution time. The results indicate that the proposed method is accurate and efficient in recognizing the optical glyphs, making it suitable for use as a navigational marker in indoor environments. Furthermore, the study also provides a correlation between the size of the glyphs, the distance of the recognized glyphs, the tilt condition of the recognized glyphs, and the accuracy of glyph recognition. These correlations define the minimum glyph size that can be practically used for indoor navigation for persons with visual impairment. Overall, this research presents a promising solution for indoor navigation for persons with visual impairment by leveraging the capabilities of an RGB-D camera and proposing novel methods for obstacle detection and avoidance and for recognizing navigational markers.https://jurnal.ugm.ac.id/v3/JNTETI/article/view/6372assistive technologyimage recognitionobject detectionwearable computers |
| spellingShingle | Widyawan Muhamad Risqi Utama Saputra Paulus Insap Santosa INVys: Indoor Navigation System for Persons with Visual Impairment Using RGB-D Camera Jurnal Nasional Teknik Elektro dan Teknologi Informasi assistive technology image recognition object detection wearable computers |
| title | INVys: Indoor Navigation System for Persons with Visual Impairment Using RGB-D Camera |
| title_full | INVys: Indoor Navigation System for Persons with Visual Impairment Using RGB-D Camera |
| title_fullStr | INVys: Indoor Navigation System for Persons with Visual Impairment Using RGB-D Camera |
| title_full_unstemmed | INVys: Indoor Navigation System for Persons with Visual Impairment Using RGB-D Camera |
| title_short | INVys: Indoor Navigation System for Persons with Visual Impairment Using RGB-D Camera |
| title_sort | invys indoor navigation system for persons with visual impairment using rgb d camera |
| topic | assistive technology image recognition object detection wearable computers |
| url | https://jurnal.ugm.ac.id/v3/JNTETI/article/view/6372 |
| work_keys_str_mv | AT widyawan invysindoornavigationsystemforpersonswithvisualimpairmentusingrgbdcamera AT muhamadrisqiutamasaputra invysindoornavigationsystemforpersonswithvisualimpairmentusingrgbdcamera AT paulusinsapsantosa invysindoornavigationsystemforpersonswithvisualimpairmentusingrgbdcamera |