Event-Triggered Ephemeral Group Communication and Coordination over Sound for Smart Consumer Devices

Voice-based interfaces have become one of the most popular device capabilities, recently being regarded as one flagship user experience of smart consumer devices. However, the lack of common coordination mechanisms might often degrade the user experience, especially when interacting with multiple vo...

Full description

Bibliographic Details
Main Authors: Doohwan Song, Ikjun Yeom, Honguk Woo
Format: Article
Language:English
Published: MDPI AG 2019-04-01
Series:Sensors
Subjects:
Online Access:https://www.mdpi.com/1424-8220/19/8/1883
_version_ 1798005260549095424
author Doohwan Song
Ikjun Yeom
Honguk Woo
author_facet Doohwan Song
Ikjun Yeom
Honguk Woo
author_sort Doohwan Song
collection DOAJ
description Voice-based interfaces have become one of the most popular device capabilities, recently being regarded as one flagship user experience of smart consumer devices. However, the lack of common coordination mechanisms might often degrade the user experience, especially when interacting with multiple voice-enabled devices located closely. For example, a hotword or wake-up utterance such as &#8220;hi Bixby&#8222; or &#8220;ok Google&#8222; frequently triggers redundant responses by several nearby smartphones. Motivated by the problem of uncoordinated react of voice-enabled devices especially in a multiple device environment, in this paper, we discuss the notion of an ephemeral group of consumer devices in which the member devices and the transient lifetime are implicitly determined by an external event (e.g., hotword detection) without any provisioned group structure, and specifically we concentrate on the time-constrained leader election process in such an ephemeral group. To do so: (i) We first present the sound-based multiple device communication framework, namely <i>tailtag</i>, that leverages the isomorphic capability of consumer devices for the tasks of processing hotword events and transmitting data over sound, and thus renders both the tasks confined to the same room area and enables the spontaneous leader election process in a unstructured group upon a hotword event. (ii) To improve the success rate of the leader election with a given time constraint, we then develop the adaptive messaging scheme especially tailored for sound-based data communication that inherently has low data rate. Our adaptive scheme utilizes an application-specific score that is individually calculated by a member device for each event detection, and employs score-based scheduling by which messages of a high score are scheduled first and so unnecessary message transmission can be suppressed during the election process. (iii) Through experiments, we also demonstrate that, when a hotword is detected by multiple smartphones in a room, the framework with the adaptive messaging scheme enables them to successfully achieve a coordinated response under the given latency bound, yielding an insignificant non-consensus probability, no more than 2%.
first_indexed 2024-04-11T12:36:37Z
format Article
id doaj.art-4e6f86762a9944319a4aaeae06aa5967
institution Directory Open Access Journal
issn 1424-8220
language English
last_indexed 2024-04-11T12:36:37Z
publishDate 2019-04-01
publisher MDPI AG
record_format Article
series Sensors
spelling doaj.art-4e6f86762a9944319a4aaeae06aa59672022-12-22T04:23:36ZengMDPI AGSensors1424-82202019-04-01198188310.3390/s19081883s19081883Event-Triggered Ephemeral Group Communication and Coordination over Sound for Smart Consumer DevicesDoohwan Song0Ikjun Yeom1Honguk Woo2Samsung Electronics, Suwon 16677, KoreaSungkyunkwan University, Suwon 16419, KoreaSungkyunkwan University, Suwon 16419, KoreaVoice-based interfaces have become one of the most popular device capabilities, recently being regarded as one flagship user experience of smart consumer devices. However, the lack of common coordination mechanisms might often degrade the user experience, especially when interacting with multiple voice-enabled devices located closely. For example, a hotword or wake-up utterance such as &#8220;hi Bixby&#8222; or &#8220;ok Google&#8222; frequently triggers redundant responses by several nearby smartphones. Motivated by the problem of uncoordinated react of voice-enabled devices especially in a multiple device environment, in this paper, we discuss the notion of an ephemeral group of consumer devices in which the member devices and the transient lifetime are implicitly determined by an external event (e.g., hotword detection) without any provisioned group structure, and specifically we concentrate on the time-constrained leader election process in such an ephemeral group. To do so: (i) We first present the sound-based multiple device communication framework, namely <i>tailtag</i>, that leverages the isomorphic capability of consumer devices for the tasks of processing hotword events and transmitting data over sound, and thus renders both the tasks confined to the same room area and enables the spontaneous leader election process in a unstructured group upon a hotword event. (ii) To improve the success rate of the leader election with a given time constraint, we then develop the adaptive messaging scheme especially tailored for sound-based data communication that inherently has low data rate. Our adaptive scheme utilizes an application-specific score that is individually calculated by a member device for each event detection, and employs score-based scheduling by which messages of a high score are scheduled first and so unnecessary message transmission can be suppressed during the election process. (iii) Through experiments, we also demonstrate that, when a hotword is detected by multiple smartphones in a room, the framework with the adaptive messaging scheme enables them to successfully achieve a coordinated response under the given latency bound, yielding an insignificant non-consensus probability, no more than 2%.https://www.mdpi.com/1424-8220/19/8/1883voice-based interfacehotwordcoordinated reactephemeral groupdata communication over soundsmart consumer device
spellingShingle Doohwan Song
Ikjun Yeom
Honguk Woo
Event-Triggered Ephemeral Group Communication and Coordination over Sound for Smart Consumer Devices
Sensors
voice-based interface
hotword
coordinated react
ephemeral group
data communication over sound
smart consumer device
title Event-Triggered Ephemeral Group Communication and Coordination over Sound for Smart Consumer Devices
title_full Event-Triggered Ephemeral Group Communication and Coordination over Sound for Smart Consumer Devices
title_fullStr Event-Triggered Ephemeral Group Communication and Coordination over Sound for Smart Consumer Devices
title_full_unstemmed Event-Triggered Ephemeral Group Communication and Coordination over Sound for Smart Consumer Devices
title_short Event-Triggered Ephemeral Group Communication and Coordination over Sound for Smart Consumer Devices
title_sort event triggered ephemeral group communication and coordination over sound for smart consumer devices
topic voice-based interface
hotword
coordinated react
ephemeral group
data communication over sound
smart consumer device
url https://www.mdpi.com/1424-8220/19/8/1883
work_keys_str_mv AT doohwansong eventtriggeredephemeralgroupcommunicationandcoordinationoversoundforsmartconsumerdevices
AT ikjunyeom eventtriggeredephemeralgroupcommunicationandcoordinationoversoundforsmartconsumerdevices
AT hongukwoo eventtriggeredephemeralgroupcommunicationandcoordinationoversoundforsmartconsumerdevices