Object Selection Using LSTM Networks for Spontaneous Gaze-Based Interaction
Two years on with Covid-19, touchless technology has evolved from a device that symbolizes luxury to something that is necessary. Eye tracker is one type of touchless technologies that uses user's gaze to interact with computer without touching the screen. Development of spontaneous gazebased i...
| Main Authors: | , , |
|---|---|
| Format: | Conference or Workshop Item |
| Language: | English |
| Published: |
2022
|
| Subjects: | |
| Online Access: | https://repository.ugm.ac.id/282116/1/Fikri%20et%20al%20-%202022%20-%20Object_Selection_Using_LSTM_Networks_for_Spontaneous_Gaze-Based_Interaction.pdf |
| _version_ | 1797037537152204800 |
|---|---|
| author | Fikri, Muhammad Ainul Putra, Iqbal Kurniawan Asmar Wibirama, Sunu |
| author_facet | Fikri, Muhammad Ainul Putra, Iqbal Kurniawan Asmar Wibirama, Sunu |
| author_sort | Fikri, Muhammad Ainul |
| collection | UGM |
| description | Two years on with Covid-19, touchless technology has evolved from a device that symbolizes luxury to something that is necessary. Eye tracker is one type of touchless technologies that uses user's gaze to interact with computer without touching the screen. Development of spontaneous gazebased interaction is progressing very rapidly. Researchers have developed various object selection methods without prior gazeto-screen calibration. Recently, the conventional approach of setting threshold was developed as a gaze-based object selection method. However, the use of threshold values is considered non-adaptive and requires additional data pre-processing to handle noises. To overcome this problem, deep learning is used as an object selection method for spontaneous gaze-based interaction. Deep learning does not require any data preprocessing method to achieve accurate object selection results. Out of five deep learning algorithms that were evaluated, LSTM (Long Short-Term Memory) and BiLSTM (Bidirectional Long Short-Term Memory) networks achieved comparable accuracy of 95.17 pm 0.95 and 95.15 pm 1.17, respectively. In future, our research is promising for development of real-time object selection technique for touchless public display. © 2022 IEEE. |
| first_indexed | 2024-03-14T00:04:48Z |
| format | Conference or Workshop Item |
| id | oai:generic.eprints.org:282116 |
| institution | Universiti Gadjah Mada |
| language | English |
| last_indexed | 2024-03-14T00:04:48Z |
| publishDate | 2022 |
| record_format | dspace |
| spelling | oai:generic.eprints.org:2821162023-11-30T01:58:15Z https://repository.ugm.ac.id/282116/ Object Selection Using LSTM Networks for Spontaneous Gaze-Based Interaction Fikri, Muhammad Ainul Putra, Iqbal Kurniawan Asmar Wibirama, Sunu Electrical and Electronic Engineering not elsewhere classified Two years on with Covid-19, touchless technology has evolved from a device that symbolizes luxury to something that is necessary. Eye tracker is one type of touchless technologies that uses user's gaze to interact with computer without touching the screen. Development of spontaneous gazebased interaction is progressing very rapidly. Researchers have developed various object selection methods without prior gazeto-screen calibration. Recently, the conventional approach of setting threshold was developed as a gaze-based object selection method. However, the use of threshold values is considered non-adaptive and requires additional data pre-processing to handle noises. To overcome this problem, deep learning is used as an object selection method for spontaneous gaze-based interaction. Deep learning does not require any data preprocessing method to achieve accurate object selection results. Out of five deep learning algorithms that were evaluated, LSTM (Long Short-Term Memory) and BiLSTM (Bidirectional Long Short-Term Memory) networks achieved comparable accuracy of 95.17 pm 0.95 and 95.15 pm 1.17, respectively. In future, our research is promising for development of real-time object selection technique for touchless public display. © 2022 IEEE. 2022 Conference or Workshop Item PeerReviewed application/pdf en https://repository.ugm.ac.id/282116/1/Fikri%20et%20al%20-%202022%20-%20Object_Selection_Using_LSTM_Networks_for_Spontaneous_Gaze-Based_Interaction.pdf Fikri, Muhammad Ainul and Putra, Iqbal Kurniawan Asmar and Wibirama, Sunu (2022) Object Selection Using LSTM Networks for Spontaneous Gaze-Based Interaction. In: 14th International Conference on Information Technology and Electrical Engineering (ICITEE). https://ieeexplore.ieee.org/document/9954104 |
| spellingShingle | Electrical and Electronic Engineering not elsewhere classified Fikri, Muhammad Ainul Putra, Iqbal Kurniawan Asmar Wibirama, Sunu Object Selection Using LSTM Networks for Spontaneous Gaze-Based Interaction |
| title | Object Selection Using LSTM Networks for Spontaneous Gaze-Based Interaction |
| title_full | Object Selection Using LSTM Networks for Spontaneous Gaze-Based Interaction |
| title_fullStr | Object Selection Using LSTM Networks for Spontaneous Gaze-Based Interaction |
| title_full_unstemmed | Object Selection Using LSTM Networks for Spontaneous Gaze-Based Interaction |
| title_short | Object Selection Using LSTM Networks for Spontaneous Gaze-Based Interaction |
| title_sort | object selection using lstm networks for spontaneous gaze based interaction |
| topic | Electrical and Electronic Engineering not elsewhere classified |
| url | https://repository.ugm.ac.id/282116/1/Fikri%20et%20al%20-%202022%20-%20Object_Selection_Using_LSTM_Networks_for_Spontaneous_Gaze-Based_Interaction.pdf |
| work_keys_str_mv | AT fikrimuhammadainul objectselectionusinglstmnetworksforspontaneousgazebasedinteraction AT putraiqbalkurniawanasmar objectselectionusinglstmnetworksforspontaneousgazebasedinteraction AT wibiramasunu objectselectionusinglstmnetworksforspontaneousgazebasedinteraction |