State-Transition Modeling of Human–Robot Interaction for Easy Crowdsourced Robot Control

Robotic salespeople are often ignored by people due to their weak social presence, and thus have difficulty facilitating sales autonomously. However, for robots that are remotely controlled by humans, there is a need for experienced and trained operators. In this paper, we suggest crowdsourcing to a...

Full description

Bibliographic Details
Main Authors: Masaya Iwasaki, Mizuki Ikeda, Tatsuyuki Kawamura, Hideyuki Nakanishi
Format: Article
Language:English
Published: MDPI AG 2020-11-01
Series:Sensors
Subjects:
Online Access:https://www.mdpi.com/1424-8220/20/22/6529
_version_ 1797547854214987776
author Masaya Iwasaki
Mizuki Ikeda
Tatsuyuki Kawamura
Hideyuki Nakanishi
author_facet Masaya Iwasaki
Mizuki Ikeda
Tatsuyuki Kawamura
Hideyuki Nakanishi
author_sort Masaya Iwasaki
collection DOAJ
description Robotic salespeople are often ignored by people due to their weak social presence, and thus have difficulty facilitating sales autonomously. However, for robots that are remotely controlled by humans, there is a need for experienced and trained operators. In this paper, we suggest crowdsourcing to allow general users on the internet to operate a robot remotely and facilitate customers’ purchasing activities while flexibly responding to various situations through a user interface. To implement this system, we examined how our developed remote interface can improve a robot’s social presence while being controlled by a human operator, including first-time users. Therefore, we investigated the typical flow of a customer–robot interaction that was effective for sales promotion, and modeled it as a state transition with automatic functions by accessing the robot’s sensor information. Furthermore, we created a user interface based on the model and examined whether it was effective in a real environment. Finally, we conducted experiments to examine whether the user interface could be operated by an amateur user and enhance the robot’s social presence. The results revealed that our model was able to improve the robot’s social presence and facilitate customers’ purchasing activity even when the operator was a first-time user.
first_indexed 2024-03-10T14:50:09Z
format Article
id doaj.art-cd5a4f9555ac4047bfb841c3fef6f9eb
institution Directory Open Access Journal
issn 1424-8220
language English
last_indexed 2024-03-10T14:50:09Z
publishDate 2020-11-01
publisher MDPI AG
record_format Article
series Sensors
spelling doaj.art-cd5a4f9555ac4047bfb841c3fef6f9eb2023-11-20T21:02:27ZengMDPI AGSensors1424-82202020-11-012022652910.3390/s20226529State-Transition Modeling of Human–Robot Interaction for Easy Crowdsourced Robot ControlMasaya Iwasaki0Mizuki Ikeda1Tatsuyuki Kawamura2Hideyuki Nakanishi3Department of Adaptive Machine Systems, Osaka University, Suita 565-0871, JapanDepartment of Adaptive Machine Systems, Osaka University, Suita 565-0871, JapanKyoto Innovation, Inc., Kyoto 604-8151, JapanDepartment of Adaptive Machine Systems, Osaka University, Suita 565-0871, JapanRobotic salespeople are often ignored by people due to their weak social presence, and thus have difficulty facilitating sales autonomously. However, for robots that are remotely controlled by humans, there is a need for experienced and trained operators. In this paper, we suggest crowdsourcing to allow general users on the internet to operate a robot remotely and facilitate customers’ purchasing activities while flexibly responding to various situations through a user interface. To implement this system, we examined how our developed remote interface can improve a robot’s social presence while being controlled by a human operator, including first-time users. Therefore, we investigated the typical flow of a customer–robot interaction that was effective for sales promotion, and modeled it as a state transition with automatic functions by accessing the robot’s sensor information. Furthermore, we created a user interface based on the model and examined whether it was effective in a real environment. Finally, we conducted experiments to examine whether the user interface could be operated by an amateur user and enhance the robot’s social presence. The results revealed that our model was able to improve the robot’s social presence and facilitate customers’ purchasing activity even when the operator was a first-time user.https://www.mdpi.com/1424-8220/20/22/6529robotic salespersonfield trialmultimodal conversation analysissituation awareness
spellingShingle Masaya Iwasaki
Mizuki Ikeda
Tatsuyuki Kawamura
Hideyuki Nakanishi
State-Transition Modeling of Human–Robot Interaction for Easy Crowdsourced Robot Control
Sensors
robotic salesperson
field trial
multimodal conversation analysis
situation awareness
title State-Transition Modeling of Human–Robot Interaction for Easy Crowdsourced Robot Control
title_full State-Transition Modeling of Human–Robot Interaction for Easy Crowdsourced Robot Control
title_fullStr State-Transition Modeling of Human–Robot Interaction for Easy Crowdsourced Robot Control
title_full_unstemmed State-Transition Modeling of Human–Robot Interaction for Easy Crowdsourced Robot Control
title_short State-Transition Modeling of Human–Robot Interaction for Easy Crowdsourced Robot Control
title_sort state transition modeling of human robot interaction for easy crowdsourced robot control
topic robotic salesperson
field trial
multimodal conversation analysis
situation awareness
url https://www.mdpi.com/1424-8220/20/22/6529
work_keys_str_mv AT masayaiwasaki statetransitionmodelingofhumanrobotinteractionforeasycrowdsourcedrobotcontrol
AT mizukiikeda statetransitionmodelingofhumanrobotinteractionforeasycrowdsourcedrobotcontrol
AT tatsuyukikawamura statetransitionmodelingofhumanrobotinteractionforeasycrowdsourcedrobotcontrol
AT hideyukinakanishi statetransitionmodelingofhumanrobotinteractionforeasycrowdsourcedrobotcontrol