Software system for contactless text input based on computer vision

Abstract. The article is devoted to the problem of contactless human-computer interaction. The task of entering text from an optimized on-screen keyboard using cursor control based on data received from a video camera is considered, including if the user has motor impairments. A software system cons...

Full description

Bibliographic Details
Main Authors: Peresunko Pavel, Alexander Bochkarev, Larionov Egor, Peresunko Evgenia, Kosheleva Victoria, Kovalev Igor
Format: Article
Language:English
Published: EDP Sciences 2024-01-01
Series:ITM Web of Conferences
Online Access:https://www.itm-conferences.org/articles/itmconf/pdf/2024/02/itmconf_hmmocs2023_03013.pdf
Description
Summary:Abstract. The article is devoted to the problem of contactless human-computer interaction. The task of entering text from an optimized on-screen keyboard using cursor control based on data received from a video camera is considered, including if the user has motor impairments. A software system consisting of two applications is proposed for cursor control and text input based on computer vision algorithms. A diagram of the system operation and interaction of components and basic user settings are presented. As a result, testing was carried out using a focus group, in which participants had to enter free text using the proposed software system. Experiments have shown the functionality of the system.
ISSN:2271-2097