Smatable: A Vibration-Based Sensing Method for Making Ordinary Tables Touch-Interfaces
In recent years, the equipment that makes up smart homes is required not only to be functional, but also to be integrated with the design and aesthetics of the living space. Among them, interfaces that directly touch the human eye and hands are the key to maintaining design, but there were many issu...
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2023-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/10360828/ |
| _version_ | 1797376370920128512 |
|---|---|
| author | Makoto Yoshida Tomokazu Matsui Tokimune Ishiyama Manato Fujimoto Hirohiko Suwa Keiichi Yasumoto |
| author_facet | Makoto Yoshida Tomokazu Matsui Tokimune Ishiyama Manato Fujimoto Hirohiko Suwa Keiichi Yasumoto |
| author_sort | Makoto Yoshida |
| collection | DOAJ |
| description | In recent years, the equipment that makes up smart homes is required not only to be functional, but also to be integrated with the design and aesthetics of the living space. Among them, interfaces that directly touch the human eye and hands are the key to maintaining design, but there were many issues in terms of integration with design and aesthetics of living spaces. In this paper, we propose an interface system that operates existing furniture by touching it as a new interface that integrates beautifully into the living space. The proposed system detects user operations with four small vibration sensors attached to hidden locations of existing furniture and uses deep learning to learn the vibrations when a person touches the furniture. Using this method, thick materials difficult to achieve with normal capacitive touch sensors can be utilized. In the experiment, a dining table was used as a representative piece of furniture, and the accuracy of detecting the direction in which three participants swiped in four directions on the table was verified. As a result of the experiment, the accuracy was confirmed by Leave-One-Person-Out-Cross-Validation using 3 sessions of swipe data for each individual for 3 participants, and the accuracy was 0.67. Furthermore, we verified the accuracy of a trained model created by adding only one session of evaluation target data to each learning dataset used in the Leave-One-Person-Out-Cross-Validation. As a result, the accuracy reached 0.90, achieving practical precision. |
| first_indexed | 2024-03-08T19:37:34Z |
| format | Article |
| id | doaj.art-b2caf94f8b784029bf5c99e807631990 |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-03-08T19:37:34Z |
| publishDate | 2023-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-b2caf94f8b784029bf5c99e8076319902023-12-26T00:07:41ZengIEEEIEEE Access2169-35362023-01-011114261114262710.1109/ACCESS.2023.334350010360828Smatable: A Vibration-Based Sensing Method for Making Ordinary Tables Touch-InterfacesMakoto Yoshida0https://orcid.org/0000-0002-3332-7080Tomokazu Matsui1Tokimune Ishiyama2Manato Fujimoto3https://orcid.org/0000-0002-6171-5697Hirohiko Suwa4https://orcid.org/0000-0002-8519-3352Keiichi Yasumoto5https://orcid.org/0000-0003-1579-3237Graduate School of Science and Technology, Nara Institute of Science and Technology, Nara, JapanGraduate School of Science and Technology, Nara Institute of Science and Technology, Nara, JapanGraduate School of Science and Technology, Nara Institute of Science and Technology, Nara, JapanGraduate School of Informatics, Osaka Metropolitan University, Osaka, JapanGraduate School of Informatics, Osaka Metropolitan University, Osaka, JapanGraduate School of Science and Technology, Nara Institute of Science and Technology, Nara, JapanIn recent years, the equipment that makes up smart homes is required not only to be functional, but also to be integrated with the design and aesthetics of the living space. Among them, interfaces that directly touch the human eye and hands are the key to maintaining design, but there were many issues in terms of integration with design and aesthetics of living spaces. In this paper, we propose an interface system that operates existing furniture by touching it as a new interface that integrates beautifully into the living space. The proposed system detects user operations with four small vibration sensors attached to hidden locations of existing furniture and uses deep learning to learn the vibrations when a person touches the furniture. Using this method, thick materials difficult to achieve with normal capacitive touch sensors can be utilized. In the experiment, a dining table was used as a representative piece of furniture, and the accuracy of detecting the direction in which three participants swiped in four directions on the table was verified. As a result of the experiment, the accuracy was confirmed by Leave-One-Person-Out-Cross-Validation using 3 sessions of swipe data for each individual for 3 participants, and the accuracy was 0.67. Furthermore, we verified the accuracy of a trained model created by adding only one session of evaluation target data to each learning dataset used in the Leave-One-Person-Out-Cross-Validation. As a result, the accuracy reached 0.90, achieving practical precision.https://ieeexplore.ieee.org/document/10360828/Touch interfaceoperation recognitionvibration sensordeep learning |
| spellingShingle | Makoto Yoshida Tomokazu Matsui Tokimune Ishiyama Manato Fujimoto Hirohiko Suwa Keiichi Yasumoto Smatable: A Vibration-Based Sensing Method for Making Ordinary Tables Touch-Interfaces IEEE Access Touch interface operation recognition vibration sensor deep learning |
| title | Smatable: A Vibration-Based Sensing Method for Making Ordinary Tables Touch-Interfaces |
| title_full | Smatable: A Vibration-Based Sensing Method for Making Ordinary Tables Touch-Interfaces |
| title_fullStr | Smatable: A Vibration-Based Sensing Method for Making Ordinary Tables Touch-Interfaces |
| title_full_unstemmed | Smatable: A Vibration-Based Sensing Method for Making Ordinary Tables Touch-Interfaces |
| title_short | Smatable: A Vibration-Based Sensing Method for Making Ordinary Tables Touch-Interfaces |
| title_sort | smatable a vibration based sensing method for making ordinary tables touch interfaces |
| topic | Touch interface operation recognition vibration sensor deep learning |
| url | https://ieeexplore.ieee.org/document/10360828/ |
| work_keys_str_mv | AT makotoyoshida smatableavibrationbasedsensingmethodformakingordinarytablestouchinterfaces AT tomokazumatsui smatableavibrationbasedsensingmethodformakingordinarytablestouchinterfaces AT tokimuneishiyama smatableavibrationbasedsensingmethodformakingordinarytablestouchinterfaces AT manatofujimoto smatableavibrationbasedsensingmethodformakingordinarytablestouchinterfaces AT hirohikosuwa smatableavibrationbasedsensingmethodformakingordinarytablestouchinterfaces AT keiichiyasumoto smatableavibrationbasedsensingmethodformakingordinarytablestouchinterfaces |