CameraKeyboard: A Novel Interaction Technique for Text Entry Through Smartphone Cameras
We present CameraKeyboard, a text entry technique that uses smartphone cameras to extract and digitalise text from physical sources such as business cards and identification documents. After taking a picture of the text of interest, the smartphone recognises the text through OCR technologies (specif...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2019-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/8903187/ |
| _version_ | 1818330164482801664 |
|---|---|
| author | Alessio Bellino Valeria Herskovic |
| author_facet | Alessio Bellino Valeria Herskovic |
| author_sort | Alessio Bellino |
| collection | DOAJ |
| description | We present CameraKeyboard, a text entry technique that uses smartphone cameras to extract and digitalise text from physical sources such as business cards and identification documents. After taking a picture of the text of interest, the smartphone recognises the text through OCR technologies (specifically, Google Cloud Vision API) and organises it in the same way in which it is displayed in the original source. Next, users can select the required text - which is split into lines, and further split into words - by tapping on it. CameraKeyboard is designed to easily complement the standard keyboard when users need to digitalise text. In fact, the camera is integrated directly in the standard mobile QWERTY keyboard and can be accessed by tapping a button. CameraKeyboard is general-purpose like any other smartphone keyboard: it works with any application (e.g., Gmail, Whatsapp) and is able to extract text from any kind of source. We evaluated CameraKeyboard through a user study with 18 participants who carried out four different text entry tasks, and compared it to a standard smartphone keyboard (Google Keyboard) and a standard (physical) desktop keyboard. Results show that CameraKeyboard is the faster one in most cases. |
| first_indexed | 2024-12-13T12:59:36Z |
| format | Article |
| id | doaj.art-a83c875e026843618dc1533599f7bff5 |
| institution | Directory Open Access Journal |
| issn | 2169-3536 |
| language | English |
| last_indexed | 2024-12-13T12:59:36Z |
| publishDate | 2019-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj.art-a83c875e026843618dc1533599f7bff52022-12-21T23:45:04ZengIEEEIEEE Access2169-35362019-01-01716798216799610.1109/ACCESS.2019.29541018903187CameraKeyboard: A Novel Interaction Technique for Text Entry Through Smartphone CamerasAlessio Bellino0https://orcid.org/0000-0003-0285-1549Valeria Herskovic1Escuela de Informática y Telecomunicaciones, Facultad de Ingeniería y Ciencias, Universidad Diego Portales, Santiago, ChileDepartamento de Ciencia de la Computación, Pontificia Universidad Católica de Chile, Santiago, ChileWe present CameraKeyboard, a text entry technique that uses smartphone cameras to extract and digitalise text from physical sources such as business cards and identification documents. After taking a picture of the text of interest, the smartphone recognises the text through OCR technologies (specifically, Google Cloud Vision API) and organises it in the same way in which it is displayed in the original source. Next, users can select the required text - which is split into lines, and further split into words - by tapping on it. CameraKeyboard is designed to easily complement the standard keyboard when users need to digitalise text. In fact, the camera is integrated directly in the standard mobile QWERTY keyboard and can be accessed by tapping a button. CameraKeyboard is general-purpose like any other smartphone keyboard: it works with any application (e.g., Gmail, Whatsapp) and is able to extract text from any kind of source. We evaluated CameraKeyboard through a user study with 18 participants who carried out four different text entry tasks, and compared it to a standard smartphone keyboard (Google Keyboard) and a standard (physical) desktop keyboard. Results show that CameraKeyboard is the faster one in most cases.https://ieeexplore.ieee.org/document/8903187/Text-entrysmartphone interactioncamera interactionOCRinterface design |
| spellingShingle | Alessio Bellino Valeria Herskovic CameraKeyboard: A Novel Interaction Technique for Text Entry Through Smartphone Cameras IEEE Access Text-entry smartphone interaction camera interaction OCR interface design |
| title | CameraKeyboard: A Novel Interaction Technique for Text Entry Through Smartphone Cameras |
| title_full | CameraKeyboard: A Novel Interaction Technique for Text Entry Through Smartphone Cameras |
| title_fullStr | CameraKeyboard: A Novel Interaction Technique for Text Entry Through Smartphone Cameras |
| title_full_unstemmed | CameraKeyboard: A Novel Interaction Technique for Text Entry Through Smartphone Cameras |
| title_short | CameraKeyboard: A Novel Interaction Technique for Text Entry Through Smartphone Cameras |
| title_sort | camerakeyboard a novel interaction technique for text entry through smartphone cameras |
| topic | Text-entry smartphone interaction camera interaction OCR interface design |
| url | https://ieeexplore.ieee.org/document/8903187/ |
| work_keys_str_mv | AT alessiobellino camerakeyboardanovelinteractiontechniquefortextentrythroughsmartphonecameras AT valeriaherskovic camerakeyboardanovelinteractiontechniquefortextentrythroughsmartphonecameras |