Touch Sensing for a Projected Screen Using Slope Disparity Gating
This paper introduces a novel touch sensing system for a projected screen with a single camera. To achieve touch sensing with camera image, there are two challenges to overcome. One is to establish robustness against image processing being misled by projected contents. The other is to realize both t...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2021-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/9495800/ |
| _version_ | 1818571750936412160 |
|---|---|
| author | Mayuka Tsuji Hiroyuki Kubo Suren Jayasuriya Takuya Funatomi Yasuhiro Mukaigawa |
| author_facet | Mayuka Tsuji Hiroyuki Kubo Suren Jayasuriya Takuya Funatomi Yasuhiro Mukaigawa |
| author_sort | Mayuka Tsuji |
| collection | DOAJ |
| description | This paper introduces a novel touch sensing system for a projected screen with a single camera. To achieve touch sensing with camera image, there are two challenges to overcome. One is to establish robustness against image processing being misled by projected contents. The other is to realize both touch detection and fingertips localization with a single-camera image. In this work, we use Slope Disparity Gating and capture only the region slightly above the projected screen. This selected region is set geometrically so that a part of the finger is captured when touching, and no finger is captured when not touching. A key feature of this study is that the projector can enable this selective imaging capability in the camera while still displaying a normal projected image to the user’s eyes. The projector is both a programmable light source for capturing system and an interface display device for the users. We built a prototype system and touch sensing algorithm, evaluated the touch accuracy, demonstrated robustness to a projected content. |
| first_indexed | 2024-12-14T18:48:29Z |
| format | Article |
| id | doaj.art-ad7a8039eca34fe299784d78f49ede8d |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-12-14T18:48:29Z |
| publishDate | 2021-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-ad7a8039eca34fe299784d78f49ede8d2022-12-21T22:51:20ZengIEEEIEEE Access2169-35362021-01-01910600510601310.1109/ACCESS.2021.30999019495800Touch Sensing for a Projected Screen Using Slope Disparity GatingMayuka Tsuji0https://orcid.org/0000-0003-4157-3916Hiroyuki Kubo1https://orcid.org/0000-0002-7061-7941Suren Jayasuriya2https://orcid.org/0000-0001-7143-4429Takuya Funatomi3https://orcid.org/0000-0001-5588-5932Yasuhiro Mukaigawa4https://orcid.org/0000-0001-8689-3724Graduate School of Science and Technology, Nara Institute of Science and Technology (NAIST), Nara, Ikoma, JapanSchool of Information and Telecommunication Engineering, Tokai University, Minato City, Tokyo, JapanSchool of Arts Media and Engineering, Arizona State University, Tempe, AZ, USAGraduate School of Science and Technology, Nara Institute of Science and Technology (NAIST), Nara, Ikoma, JapanGraduate School of Science and Technology, Nara Institute of Science and Technology (NAIST), Nara, Ikoma, JapanThis paper introduces a novel touch sensing system for a projected screen with a single camera. To achieve touch sensing with camera image, there are two challenges to overcome. One is to establish robustness against image processing being misled by projected contents. The other is to realize both touch detection and fingertips localization with a single-camera image. In this work, we use Slope Disparity Gating and capture only the region slightly above the projected screen. This selected region is set geometrically so that a part of the finger is captured when touching, and no finger is captured when not touching. A key feature of this study is that the projector can enable this selective imaging capability in the camera while still displaying a normal projected image to the user’s eyes. The projector is both a programmable light source for capturing system and an interface display device for the users. We built a prototype system and touch sensing algorithm, evaluated the touch accuracy, demonstrated robustness to a projected content.https://ieeexplore.ieee.org/document/9495800/Touch sensinghuman-computer interfaceimage sensing systemprojectorprojector-camera system |
| spellingShingle | Mayuka Tsuji Hiroyuki Kubo Suren Jayasuriya Takuya Funatomi Yasuhiro Mukaigawa Touch Sensing for a Projected Screen Using Slope Disparity Gating IEEE Access Touch sensing human-computer interface image sensing system projector projector-camera system |
| title | Touch Sensing for a Projected Screen Using Slope Disparity Gating |
| title_full | Touch Sensing for a Projected Screen Using Slope Disparity Gating |
| title_fullStr | Touch Sensing for a Projected Screen Using Slope Disparity Gating |
| title_full_unstemmed | Touch Sensing for a Projected Screen Using Slope Disparity Gating |
| title_short | Touch Sensing for a Projected Screen Using Slope Disparity Gating |
| title_sort | touch sensing for a projected screen using slope disparity gating |
| topic | Touch sensing human-computer interface image sensing system projector projector-camera system |
| url | https://ieeexplore.ieee.org/document/9495800/ |
| work_keys_str_mv | AT mayukatsuji touchsensingforaprojectedscreenusingslopedisparitygating AT hiroyukikubo touchsensingforaprojectedscreenusingslopedisparitygating AT surenjayasuriya touchsensingforaprojectedscreenusingslopedisparitygating AT takuyafunatomi touchsensingforaprojectedscreenusingslopedisparitygating AT yasuhiromukaigawa touchsensingforaprojectedscreenusingslopedisparitygating |