Coordinating Entrainment Phenomena: Robot Conversation Strategy for Object Recognition
This study proposes a robot conversation strategy involving speech and gestures to improve a robot’s indicated object recognition, i.e., the recognition of an object indicated by a human. Research conducted to improve the performance of indicated object recognition is divided into two main approache...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2021-03-01
|
| Series: | Applied Sciences |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2076-3417/11/5/2358 |
| _version_ | 1797412769824243712 |
|---|---|
| author | Mitsuhiko Kimoto Takamasa Iio Masahiro Shiomi Katsunori Shimohara |
| author_facet | Mitsuhiko Kimoto Takamasa Iio Masahiro Shiomi Katsunori Shimohara |
| author_sort | Mitsuhiko Kimoto |
| collection | DOAJ |
| description | This study proposes a robot conversation strategy involving speech and gestures to improve a robot’s indicated object recognition, i.e., the recognition of an object indicated by a human. Research conducted to improve the performance of indicated object recognition is divided into two main approaches: development and interactive. The development approach addresses the development of new devices or algorithms. Through human–robot interaction, the interactive approach improves the performance by decreasing the variability and the ambiguity of the references. Inspired by the findings of entrainment and entrainment inhibition, this study proposes a robot conversation strategy that utilizes the interactive approach. While entrainment is a phenomenon in which people unconsciously tend to mimic words and/or gestures of their interlocutor, entrainment inhibition is the opposite phenomenon in which people decrease the amount of information contained in their words and gestures when their interlocutor provides excess information. Based on these phenomena, we designed a robot conversation strategy that elicits clear references. We experimentally compared this strategy with the other interactive strategy in which a robot explicitly requests clarifications when a human refers to an object. We obtained the following findings: (1) The proposed strategy clarifies human references and improves indicated object recognition performance, and (2) the proposed strategy forms better impressions than the other interactive strategy that explicitly requests clarifications when people refer to objects. |
| first_indexed | 2024-03-09T05:08:04Z |
| format | Article |
| id | doaj.art-6870175ee6e94f3791b51155b95b4c16 |
| institution | Directory Open Access Journal |
| issn | 2076-3417 |
| language | English |
| last_indexed | 2024-03-09T05:08:04Z |
| publishDate | 2021-03-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Applied Sciences |
| spelling | doaj.art-6870175ee6e94f3791b51155b95b4c162023-12-03T12:52:26ZengMDPI AGApplied Sciences2076-34172021-03-01115235810.3390/app11052358Coordinating Entrainment Phenomena: Robot Conversation Strategy for Object RecognitionMitsuhiko Kimoto0Takamasa Iio1Masahiro Shiomi2Katsunori Shimohara3Faculty of Science and Technology, Keio University, Kanagawa 223-8522, JapanInteraction Science Laboratories, ATR, Kyoto 619-0288, JapanInteraction Science Laboratories, ATR, Kyoto 619-0288, JapanFaculty of Science and Engineering, Doshisha University, Kyoto 610-0321, JapanThis study proposes a robot conversation strategy involving speech and gestures to improve a robot’s indicated object recognition, i.e., the recognition of an object indicated by a human. Research conducted to improve the performance of indicated object recognition is divided into two main approaches: development and interactive. The development approach addresses the development of new devices or algorithms. Through human–robot interaction, the interactive approach improves the performance by decreasing the variability and the ambiguity of the references. Inspired by the findings of entrainment and entrainment inhibition, this study proposes a robot conversation strategy that utilizes the interactive approach. While entrainment is a phenomenon in which people unconsciously tend to mimic words and/or gestures of their interlocutor, entrainment inhibition is the opposite phenomenon in which people decrease the amount of information contained in their words and gestures when their interlocutor provides excess information. Based on these phenomena, we designed a robot conversation strategy that elicits clear references. We experimentally compared this strategy with the other interactive strategy in which a robot explicitly requests clarifications when a human refers to an object. We obtained the following findings: (1) The proposed strategy clarifies human references and improves indicated object recognition performance, and (2) the proposed strategy forms better impressions than the other interactive strategy that explicitly requests clarifications when people refer to objects.https://www.mdpi.com/2076-3417/11/5/2358human–robot interactionindicated object recognitionentrainmentalignment |
| spellingShingle | Mitsuhiko Kimoto Takamasa Iio Masahiro Shiomi Katsunori Shimohara Coordinating Entrainment Phenomena: Robot Conversation Strategy for Object Recognition Applied Sciences human–robot interaction indicated object recognition entrainment alignment |
| title | Coordinating Entrainment Phenomena: Robot Conversation Strategy for Object Recognition |
| title_full | Coordinating Entrainment Phenomena: Robot Conversation Strategy for Object Recognition |
| title_fullStr | Coordinating Entrainment Phenomena: Robot Conversation Strategy for Object Recognition |
| title_full_unstemmed | Coordinating Entrainment Phenomena: Robot Conversation Strategy for Object Recognition |
| title_short | Coordinating Entrainment Phenomena: Robot Conversation Strategy for Object Recognition |
| title_sort | coordinating entrainment phenomena robot conversation strategy for object recognition |
| topic | human–robot interaction indicated object recognition entrainment alignment |
| url | https://www.mdpi.com/2076-3417/11/5/2358 |
| work_keys_str_mv | AT mitsuhikokimoto coordinatingentrainmentphenomenarobotconversationstrategyforobjectrecognition AT takamasaiio coordinatingentrainmentphenomenarobotconversationstrategyforobjectrecognition AT masahiroshiomi coordinatingentrainmentphenomenarobotconversationstrategyforobjectrecognition AT katsunorishimohara coordinatingentrainmentphenomenarobotconversationstrategyforobjectrecognition |