Designing Hand Pose Aware Virtual Keyboard With Hand Drift Tolerance

An unintentional hand drift adversely affects the typing performance of conventional virtual keyboards. To overcome this, we proposed to utilize the typing patterns of skilled typists. First, as most typists enter the keys in the same column with a predetermined finger only, we restricted these keys...

Full description

Bibliographic Details
Main Authors: Daewoong Choi, Hyeonjoong Cho, Kyeongeun Seo, Sangyub Lee, Jaekyu Lee, Jaejin Ko
Format: Article
Language:English
Published: IEEE 2019-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/8764534/
_version_ 1828406446018002944
author Daewoong Choi
Hyeonjoong Cho
Kyeongeun Seo
Sangyub Lee
Jaekyu Lee
Jaejin Ko
author_facet Daewoong Choi
Hyeonjoong Cho
Kyeongeun Seo
Sangyub Lee
Jaekyu Lee
Jaejin Ko
author_sort Daewoong Choi
collection DOAJ
description An unintentional hand drift adversely affects the typing performance of conventional virtual keyboards. To overcome this, we proposed to utilize the typing patterns of skilled typists. First, as most typists enter the keys in the same column with a predetermined finger only, we restricted these keys to be typed by their corresponding fingers. Second, our investigation of skilled typists demonstrated that hand poses vary when the typists touch different keys. Thus, rather than locating the touch point as in the case of existing virtual keyboards, we attempted to use unique hand poses to infer the target key. Based on these two techniques, we implemented a novel hand poses aware virtual keyboard that is tolerant of hand drift. Our experimental studies yielded the following results: 1) most of the QWERTY-familiar typists who have varying typing habits were easily adaptable to the proposed keyboard design and 2) the proposed keyboard outperformed existing virtual keyboards in terms of typing speed and several error rates, and eventually achieved a typing speed of approximately 56 WPM.
first_indexed 2024-12-10T11:11:53Z
format Article
id doaj.art-1f12d3d04ed3473480c7884f90fbf9cc
institution Directory Open Access Journal
issn 2169-3536
language English
last_indexed 2024-12-10T11:11:53Z
publishDate 2019-01-01
publisher IEEE
record_format Article
series IEEE Access
spelling doaj.art-1f12d3d04ed3473480c7884f90fbf9cc2022-12-22T01:51:23ZengIEEEIEEE Access2169-35362019-01-017960359604710.1109/ACCESS.2019.29293108764534Designing Hand Pose Aware Virtual Keyboard With Hand Drift ToleranceDaewoong Choi0https://orcid.org/0000-0003-3554-9848Hyeonjoong Cho1Kyeongeun Seo2Sangyub Lee3Jaekyu Lee4Jaejin Ko5Department of Computer Convergence Software, Korea University, Sejong-si, South KoreaDepartment of Computer Convergence Software, Korea University, Sejong-si, South KoreaDepartment of Computer Convergence Software, Korea University, Sejong-si, South KoreaKorea Electronics Technology Institute, Seongnam-si, South KoreaKorea Electronics Technology Institute, Seongnam-si, South KoreaKorea Electronics Technology Institute, Seongnam-si, South KoreaAn unintentional hand drift adversely affects the typing performance of conventional virtual keyboards. To overcome this, we proposed to utilize the typing patterns of skilled typists. First, as most typists enter the keys in the same column with a predetermined finger only, we restricted these keys to be typed by their corresponding fingers. Second, our investigation of skilled typists demonstrated that hand poses vary when the typists touch different keys. Thus, rather than locating the touch point as in the case of existing virtual keyboards, we attempted to use unique hand poses to infer the target key. Based on these two techniques, we implemented a novel hand poses aware virtual keyboard that is tolerant of hand drift. Our experimental studies yielded the following results: 1) most of the QWERTY-familiar typists who have varying typing habits were easily adaptable to the proposed keyboard design and 2) the proposed keyboard outperformed existing virtual keyboards in terms of typing speed and several error rates, and eventually achieved a typing speed of approximately 56 WPM.https://ieeexplore.ieee.org/document/8764534/Eyes-freehand drifthandstext entrytouch typingvirtual keyboard
spellingShingle Daewoong Choi
Hyeonjoong Cho
Kyeongeun Seo
Sangyub Lee
Jaekyu Lee
Jaejin Ko
Designing Hand Pose Aware Virtual Keyboard With Hand Drift Tolerance
IEEE Access
Eyes-free
hand drift
hands
text entry
touch typing
virtual keyboard
title Designing Hand Pose Aware Virtual Keyboard With Hand Drift Tolerance
title_full Designing Hand Pose Aware Virtual Keyboard With Hand Drift Tolerance
title_fullStr Designing Hand Pose Aware Virtual Keyboard With Hand Drift Tolerance
title_full_unstemmed Designing Hand Pose Aware Virtual Keyboard With Hand Drift Tolerance
title_short Designing Hand Pose Aware Virtual Keyboard With Hand Drift Tolerance
title_sort designing hand pose aware virtual keyboard with hand drift tolerance
topic Eyes-free
hand drift
hands
text entry
touch typing
virtual keyboard
url https://ieeexplore.ieee.org/document/8764534/
work_keys_str_mv AT daewoongchoi designinghandposeawarevirtualkeyboardwithhanddrifttolerance
AT hyeonjoongcho designinghandposeawarevirtualkeyboardwithhanddrifttolerance
AT kyeongeunseo designinghandposeawarevirtualkeyboardwithhanddrifttolerance
AT sangyublee designinghandposeawarevirtualkeyboardwithhanddrifttolerance
AT jaekyulee designinghandposeawarevirtualkeyboardwithhanddrifttolerance
AT jaejinko designinghandposeawarevirtualkeyboardwithhanddrifttolerance