Exploring Gaze Movement Gesture Recognition Method for Eye-Based Interaction Using Eyewear with Infrared Distance Sensor Array
With the spread of eyewear devices, people are increasingly using information devices in various everyday situations. In these situations, it is important for eyewear devices to have eye-based interaction functions for simple hands-free input at a low cost. This paper proposes a gaze movement recogn...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2022-05-01
|
| Series: | Electronics |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2079-9292/11/10/1637 |
| _version_ | 1797500269464911872 |
|---|---|
| author | Kyosuke Futami Yuki Tabuchi Kazuya Murao Tsutomu Terada |
| author_facet | Kyosuke Futami Yuki Tabuchi Kazuya Murao Tsutomu Terada |
| author_sort | Kyosuke Futami |
| collection | DOAJ |
| description | With the spread of eyewear devices, people are increasingly using information devices in various everyday situations. In these situations, it is important for eyewear devices to have eye-based interaction functions for simple hands-free input at a low cost. This paper proposes a gaze movement recognition method for simple hands-free interaction that uses eyewear equipped with an infrared distance sensor. The proposed method measures eyelid skin movement using an infrared distance sensor inside the eyewear and applies machine learning to the time-series sensor data to recognize gaze movements (e.g., up, down, left, and right). We implemented a prototype system and conducted evaluations with gaze movements including factors such as movement directions at 45-degree intervals and the movement distance difference in the same direction. The results showed the feasibility of the proposed method. The proposed method recognized 5 to 20 types of gaze movements with an F-value of 0.96 to 1.0. In addition, the proposed method was available with a limited number of sensors, such as two or three, and robust against disturbance in some usage conditions (e.g., body vibration, facial expression change). This paper provides helpful findings for the design of gaze movement recognition methods for simple hands-free interaction using eyewear devices at a low cost. |
| first_indexed | 2024-03-10T03:59:29Z |
| format | Article |
| id | doaj.art-e57ea305624e4eb3b1ae266e3c081b4f |
| institution | Directory Open Access Journal |
| issn | 2079-9292 |
| language | English |
| last_indexed | 2024-03-10T03:59:29Z |
| publishDate | 2022-05-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Electronics |
| spelling | doaj.art-e57ea305624e4eb3b1ae266e3c081b4f2023-11-23T10:48:07ZengMDPI AGElectronics2079-92922022-05-011110163710.3390/electronics11101637Exploring Gaze Movement Gesture Recognition Method for Eye-Based Interaction Using Eyewear with Infrared Distance Sensor ArrayKyosuke Futami0Yuki Tabuchi1Kazuya Murao2Tsutomu Terada3Graduate School of Information Science and Engineering, Ritsumeikan University, 1-1-1 Nojihigashi, Kusatsu 525-8577, Shiga, JapanGraduate School of Information Science and Engineering, Ritsumeikan University, 1-1-1 Nojihigashi, Kusatsu 525-8577, Shiga, JapanGraduate School of Information Science and Engineering, Ritsumeikan University, 1-1-1 Nojihigashi, Kusatsu 525-8577, Shiga, JapanGraduate School of Engineering, Kobe University, 1-1 Rokkodaicho, Nada, Kobe 657-8501, Hyogo, JapanWith the spread of eyewear devices, people are increasingly using information devices in various everyday situations. In these situations, it is important for eyewear devices to have eye-based interaction functions for simple hands-free input at a low cost. This paper proposes a gaze movement recognition method for simple hands-free interaction that uses eyewear equipped with an infrared distance sensor. The proposed method measures eyelid skin movement using an infrared distance sensor inside the eyewear and applies machine learning to the time-series sensor data to recognize gaze movements (e.g., up, down, left, and right). We implemented a prototype system and conducted evaluations with gaze movements including factors such as movement directions at 45-degree intervals and the movement distance difference in the same direction. The results showed the feasibility of the proposed method. The proposed method recognized 5 to 20 types of gaze movements with an F-value of 0.96 to 1.0. In addition, the proposed method was available with a limited number of sensors, such as two or three, and robust against disturbance in some usage conditions (e.g., body vibration, facial expression change). This paper provides helpful findings for the design of gaze movement recognition methods for simple hands-free interaction using eyewear devices at a low cost.https://www.mdpi.com/2079-9292/11/10/1637glasseseyewearwearable deviceinfrared distance sensorphoto reflectorskin movement |
| spellingShingle | Kyosuke Futami Yuki Tabuchi Kazuya Murao Tsutomu Terada Exploring Gaze Movement Gesture Recognition Method for Eye-Based Interaction Using Eyewear with Infrared Distance Sensor Array Electronics glasses eyewear wearable device infrared distance sensor photo reflector skin movement |
| title | Exploring Gaze Movement Gesture Recognition Method for Eye-Based Interaction Using Eyewear with Infrared Distance Sensor Array |
| title_full | Exploring Gaze Movement Gesture Recognition Method for Eye-Based Interaction Using Eyewear with Infrared Distance Sensor Array |
| title_fullStr | Exploring Gaze Movement Gesture Recognition Method for Eye-Based Interaction Using Eyewear with Infrared Distance Sensor Array |
| title_full_unstemmed | Exploring Gaze Movement Gesture Recognition Method for Eye-Based Interaction Using Eyewear with Infrared Distance Sensor Array |
| title_short | Exploring Gaze Movement Gesture Recognition Method for Eye-Based Interaction Using Eyewear with Infrared Distance Sensor Array |
| title_sort | exploring gaze movement gesture recognition method for eye based interaction using eyewear with infrared distance sensor array |
| topic | glasses eyewear wearable device infrared distance sensor photo reflector skin movement |
| url | https://www.mdpi.com/2079-9292/11/10/1637 |
| work_keys_str_mv | AT kyosukefutami exploringgazemovementgesturerecognitionmethodforeyebasedinteractionusingeyewearwithinfrareddistancesensorarray AT yukitabuchi exploringgazemovementgesturerecognitionmethodforeyebasedinteractionusingeyewearwithinfrareddistancesensorarray AT kazuyamurao exploringgazemovementgesturerecognitionmethodforeyebasedinteractionusingeyewearwithinfrareddistancesensorarray AT tsutomuterada exploringgazemovementgesturerecognitionmethodforeyebasedinteractionusingeyewearwithinfrareddistancesensorarray |