Development of Finger Braille Recognition System
Finger Braille is one of the communication media of deafblind people. In one-handed Finger Braille, a sender dots the left part of the Braille code on the distal interphalangeal (DIP) joints of the index, middle and ring fingers of a receiver, and subsequently dots the right part of the Braille code...
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
The Japan Society of Mechanical Engineers
2010-03-01
|
| Series: | Journal of Biomechanical Science and Engineering |
| Subjects: | |
| Online Access: | https://www.jstage.jst.go.jp/article/jbse/5/1/5_1_54/_pdf/-char/en |
| _version_ | 1811296804451385344 |
|---|---|
| author | Yasuhiro MATSUDA Ichiro SAKUMA Yasuhiko JIMBO Etsuko KOBAYASHI Tatsuhiko ARAFUNE Tsuneshi ISOMURA |
| author_facet | Yasuhiro MATSUDA Ichiro SAKUMA Yasuhiko JIMBO Etsuko KOBAYASHI Tatsuhiko ARAFUNE Tsuneshi ISOMURA |
| author_sort | Yasuhiro MATSUDA |
| collection | DOAJ |
| description | Finger Braille is one of the communication media of deafblind people. In one-handed Finger Braille, a sender dots the left part of the Braille code on the distal interphalangeal (DIP) joints of the index, middle and ring fingers of a receiver, and subsequently dots the right part of the Braille code on the proximal interphalangeal (PIP) joints of the same fingers. Because there is a small number of non-disabled people who are skilled in Finger Braille, deafblind people communicate in this medium only through an interpreter. In this study, we developed a Finger Braille recognition system using small piezoelectric accelerometers worn by the receiver. We first conducted a measurement experiment to derive algorithms for the recognition of the dotted fingers and positions. The results showed that the accuracy of the recognition of dotted fingers was 92.9%, and the recognition system was independent of the dotted strength, dotted position and receiver. The accuracy of the recognition of dotted positions was 81.9%, and the recognition system could recognize dotted positions if the receiver's hand formed a natural longitudinal arch on the desk. Next, an evaluation experiment was carried out. The results showed that the accuracy of the recognition of dotted fingers by dotting was 89.7%, and the accuracy of recognition of dotted positions by dotting was 92.3%. Therefore, the recognition system could recognize sentences accurately when the interpreter dotted clearly. |
| first_indexed | 2024-04-13T05:54:00Z |
| format | Article |
| id | doaj.art-564c7fe096104dfa806ea4c65eb813ef |
| institution | Directory Open Access Journal |
| issn | 1880-9863 |
| language | English |
| last_indexed | 2024-04-13T05:54:00Z |
| publishDate | 2010-03-01 |
| publisher | The Japan Society of Mechanical Engineers |
| record_format | Article |
| series | Journal of Biomechanical Science and Engineering |
| spelling | doaj.art-564c7fe096104dfa806ea4c65eb813ef2022-12-22T02:59:40ZengThe Japan Society of Mechanical EngineersJournal of Biomechanical Science and Engineering1880-98632010-03-0151546510.1299/jbse.5.54jbseDevelopment of Finger Braille Recognition SystemYasuhiro MATSUDA0Ichiro SAKUMA1Yasuhiko JIMBO2Etsuko KOBAYASHI3Tatsuhiko ARAFUNE4Tsuneshi ISOMURA5Faculty of Creative Engineering, Kanagawa Institute of TechnologyGraduate School of Engineering, The University of TokyoGraduate School of Frontier Sciences, The University of TokyoGraduate School of Engineering, The University of TokyoNational Institute of Advanced Industrial Science and TechnologyFaculty of Creative Engineering, Kanagawa Institute of TechnologyFinger Braille is one of the communication media of deafblind people. In one-handed Finger Braille, a sender dots the left part of the Braille code on the distal interphalangeal (DIP) joints of the index, middle and ring fingers of a receiver, and subsequently dots the right part of the Braille code on the proximal interphalangeal (PIP) joints of the same fingers. Because there is a small number of non-disabled people who are skilled in Finger Braille, deafblind people communicate in this medium only through an interpreter. In this study, we developed a Finger Braille recognition system using small piezoelectric accelerometers worn by the receiver. We first conducted a measurement experiment to derive algorithms for the recognition of the dotted fingers and positions. The results showed that the accuracy of the recognition of dotted fingers was 92.9%, and the recognition system was independent of the dotted strength, dotted position and receiver. The accuracy of the recognition of dotted positions was 81.9%, and the recognition system could recognize dotted positions if the receiver's hand formed a natural longitudinal arch on the desk. Next, an evaluation experiment was carried out. The results showed that the accuracy of the recognition of dotted fingers by dotting was 89.7%, and the accuracy of recognition of dotted positions by dotting was 92.3%. Therefore, the recognition system could recognize sentences accurately when the interpreter dotted clearly.https://www.jstage.jst.go.jp/article/jbse/5/1/5_1_54/_pdf/-char/enfinger brailledeafblindrecognition systemcommunication aidaccelerometershock accelerationrecognition of dotted fingersrecognition of dotted positions |
| spellingShingle | Yasuhiro MATSUDA Ichiro SAKUMA Yasuhiko JIMBO Etsuko KOBAYASHI Tatsuhiko ARAFUNE Tsuneshi ISOMURA Development of Finger Braille Recognition System Journal of Biomechanical Science and Engineering finger braille deafblind recognition system communication aid accelerometer shock acceleration recognition of dotted fingers recognition of dotted positions |
| title | Development of Finger Braille Recognition System |
| title_full | Development of Finger Braille Recognition System |
| title_fullStr | Development of Finger Braille Recognition System |
| title_full_unstemmed | Development of Finger Braille Recognition System |
| title_short | Development of Finger Braille Recognition System |
| title_sort | development of finger braille recognition system |
| topic | finger braille deafblind recognition system communication aid accelerometer shock acceleration recognition of dotted fingers recognition of dotted positions |
| url | https://www.jstage.jst.go.jp/article/jbse/5/1/5_1_54/_pdf/-char/en |
| work_keys_str_mv | AT yasuhiromatsuda developmentoffingerbraillerecognitionsystem AT ichirosakuma developmentoffingerbraillerecognitionsystem AT yasuhikojimbo developmentoffingerbraillerecognitionsystem AT etsukokobayashi developmentoffingerbraillerecognitionsystem AT tatsuhikoarafune developmentoffingerbraillerecognitionsystem AT tsuneshiisomura developmentoffingerbraillerecognitionsystem |