Frame-Based Elicitation of Mid-Air Gestures for a Smart Home Device Ecosystem
If mid-air interaction is to be implemented in smart home environments, then the user would have to exercise in-air gestures to address and manipulate multiple devices. This paper investigates a user-defined gesture vocabulary for basic control of a smart home device ecosystem, consisting of 7 devic...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2019-06-01
|
| Series: | Informatics |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2227-9709/6/2/23 |
| _version_ | 1819112015060271104 |
|---|---|
| author | Panagiotis Vogiatzidakis Panayiotis Koutsabasis |
| author_facet | Panagiotis Vogiatzidakis Panayiotis Koutsabasis |
| author_sort | Panagiotis Vogiatzidakis |
| collection | DOAJ |
| description | If mid-air interaction is to be implemented in smart home environments, then the user would have to exercise in-air gestures to address and manipulate multiple devices. This paper investigates a user-defined gesture vocabulary for basic control of a smart home device ecosystem, consisting of 7 devices and a total of 55 referents (commands for device) that can be grouped to 14 commands (that refer to more than one device). The elicitation study was conducted in a frame (general scenario) of use of all devices to support contextual relevance; also, the referents were presented with minimal affordances to minimize widget-specific proposals. In addition to computing agreement rates for all referents, we also computed the internal consistency of user proposals (single-user agreement for multiple commands). In all, 1047 gestures from 18 participants were recorded, analyzed, and paired with think-aloud data. The study reached to a mid-air gesture vocabulary for a smart-device ecosystem, which includes several gestures with very high, high and medium agreement rates. Furthermore, there was high consistency within most of the single-user gesture proposals, which reveals that each user developed and applied her/his own mental model about the whole set of interactions with the device ecosystem. Thus, we suggest that mid-air interaction support for smart homes should not only offer a built-in gesture set but also provide for functions of identification and definition of personalized gesture assignments to basic user commands. |
| first_indexed | 2024-12-22T04:06:47Z |
| format | Article |
| id | doaj.art-233328575bf94687a77d7529ec6f327a |
| institution | Directory Open Access Journal |
| issn | 2227-9709 |
| language | English |
| last_indexed | 2024-12-22T04:06:47Z |
| publishDate | 2019-06-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Informatics |
| spelling | doaj.art-233328575bf94687a77d7529ec6f327a2022-12-21T18:39:36ZengMDPI AGInformatics2227-97092019-06-01622310.3390/informatics6020023informatics6020023Frame-Based Elicitation of Mid-Air Gestures for a Smart Home Device EcosystemPanagiotis Vogiatzidakis0Panayiotis Koutsabasis1Department of Product and Systems Design Engineering, University of the Aegean, 84100 Mytilene, GreeceDepartment of Product and Systems Design Engineering, University of the Aegean, 84100 Mytilene, GreeceIf mid-air interaction is to be implemented in smart home environments, then the user would have to exercise in-air gestures to address and manipulate multiple devices. This paper investigates a user-defined gesture vocabulary for basic control of a smart home device ecosystem, consisting of 7 devices and a total of 55 referents (commands for device) that can be grouped to 14 commands (that refer to more than one device). The elicitation study was conducted in a frame (general scenario) of use of all devices to support contextual relevance; also, the referents were presented with minimal affordances to minimize widget-specific proposals. In addition to computing agreement rates for all referents, we also computed the internal consistency of user proposals (single-user agreement for multiple commands). In all, 1047 gestures from 18 participants were recorded, analyzed, and paired with think-aloud data. The study reached to a mid-air gesture vocabulary for a smart-device ecosystem, which includes several gestures with very high, high and medium agreement rates. Furthermore, there was high consistency within most of the single-user gesture proposals, which reveals that each user developed and applied her/his own mental model about the whole set of interactions with the device ecosystem. Thus, we suggest that mid-air interaction support for smart homes should not only offer a built-in gesture set but also provide for functions of identification and definition of personalized gesture assignments to basic user commands.https://www.mdpi.com/2227-9709/6/2/23frame-basedelicitation studymid-air interactionsmart homegesture proposal consistencypersonalized gestures |
| spellingShingle | Panagiotis Vogiatzidakis Panayiotis Koutsabasis Frame-Based Elicitation of Mid-Air Gestures for a Smart Home Device Ecosystem Informatics frame-based elicitation study mid-air interaction smart home gesture proposal consistency personalized gestures |
| title | Frame-Based Elicitation of Mid-Air Gestures for a Smart Home Device Ecosystem |
| title_full | Frame-Based Elicitation of Mid-Air Gestures for a Smart Home Device Ecosystem |
| title_fullStr | Frame-Based Elicitation of Mid-Air Gestures for a Smart Home Device Ecosystem |
| title_full_unstemmed | Frame-Based Elicitation of Mid-Air Gestures for a Smart Home Device Ecosystem |
| title_short | Frame-Based Elicitation of Mid-Air Gestures for a Smart Home Device Ecosystem |
| title_sort | frame based elicitation of mid air gestures for a smart home device ecosystem |
| topic | frame-based elicitation study mid-air interaction smart home gesture proposal consistency personalized gestures |
| url | https://www.mdpi.com/2227-9709/6/2/23 |
| work_keys_str_mv | AT panagiotisvogiatzidakis framebasedelicitationofmidairgesturesforasmarthomedeviceecosystem AT panayiotiskoutsabasis framebasedelicitationofmidairgesturesforasmarthomedeviceecosystem |