Human Interaction Smart Subsystem—Extending Speech-Based Human-Robot Interaction Systems with an Implementation of External Smart Sensors
This paper presents a more detailed concept of Human-Robot Interaction systems architecture. One of the main differences between the proposed architecture and other ones is the methodology of information acquisition regarding the robot’s interlocutor. In order to obtain as much information as possib...
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2020-04-01
|
| Series: | Sensors |
| Subjects: | |
| Online Access: | https://www.mdpi.com/1424-8220/20/8/2376 |
| _version_ | 1797569913790922752 |
|---|---|
| author | Michal Podpora Arkadiusz Gardecki Ryszard Beniak Bartlomiej Klin Jose Lopez Vicario Aleksandra Kawala-Sterniuk |
| author_facet | Michal Podpora Arkadiusz Gardecki Ryszard Beniak Bartlomiej Klin Jose Lopez Vicario Aleksandra Kawala-Sterniuk |
| author_sort | Michal Podpora |
| collection | DOAJ |
| description | This paper presents a more detailed concept of Human-Robot Interaction systems architecture. One of the main differences between the proposed architecture and other ones is the methodology of information acquisition regarding the robot’s interlocutor. In order to obtain as much information as possible before the actual interaction took place, a custom Internet-of-Things-based sensor subsystems connected to Smart Infrastructure was designed and implemented, in order to support the interlocutor identification and acquisition of initial interaction parameters. The Artificial Intelligence interaction framework of the developed robotic system (including humanoid Pepper with its sensors and actuators, additional local, remote and cloud computing services) is being extended with the use of custom external subsystems for additional knowledge acquisition: device-based human identification, visual identification and audio-based interlocutor localization subsystems. These subsystems were deeply introduced and evaluated in this paper, presenting the benefits of integrating them into the robotic interaction system. In this paper a more detailed analysis of one of the external subsystems—Bluetooth Human Identification Smart Subsystem—was also included. The idea, use case, and a prototype, integration of elements of Smart Infrastructure systems and the prototype implementation were performed in a small front office of the Weegree company as a decent test-bed application area. |
| first_indexed | 2024-03-10T20:18:03Z |
| format | Article |
| id | doaj.art-1b2a6e789410420ab2d009cb0f1d77dd |
| institution | Directory Open Access Journal |
| issn | 1424-8220 |
| language | English |
| last_indexed | 2024-03-10T20:18:03Z |
| publishDate | 2020-04-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Sensors |
| spelling | doaj.art-1b2a6e789410420ab2d009cb0f1d77dd2023-11-19T22:21:01ZengMDPI AGSensors1424-82202020-04-01208237610.3390/s20082376Human Interaction Smart Subsystem—Extending Speech-Based Human-Robot Interaction Systems with an Implementation of External Smart SensorsMichal Podpora0Arkadiusz Gardecki1Ryszard Beniak2Bartlomiej Klin3Jose Lopez Vicario4Aleksandra Kawala-Sterniuk5Faculty of Electrical Engineering, Automatic Control and Informatics—Opole University of Technology, 45-758 Opole, PolandFaculty of Electrical Engineering, Automatic Control and Informatics—Opole University of Technology, 45-758 Opole, PolandFaculty of Electrical Engineering, Automatic Control and Informatics—Opole University of Technology, 45-758 Opole, PolandWeegree Sp. z o.o. S.K., 45-018 Opole, PolandWireless Information Networking Group, Escola d’Enginyeria—Universitat Autonoma de Barcelona, 08193 Bellaterra, SpainFaculty of Electrical Engineering, Automatic Control and Informatics—Opole University of Technology, 45-758 Opole, PolandThis paper presents a more detailed concept of Human-Robot Interaction systems architecture. One of the main differences between the proposed architecture and other ones is the methodology of information acquisition regarding the robot’s interlocutor. In order to obtain as much information as possible before the actual interaction took place, a custom Internet-of-Things-based sensor subsystems connected to Smart Infrastructure was designed and implemented, in order to support the interlocutor identification and acquisition of initial interaction parameters. The Artificial Intelligence interaction framework of the developed robotic system (including humanoid Pepper with its sensors and actuators, additional local, remote and cloud computing services) is being extended with the use of custom external subsystems for additional knowledge acquisition: device-based human identification, visual identification and audio-based interlocutor localization subsystems. These subsystems were deeply introduced and evaluated in this paper, presenting the benefits of integrating them into the robotic interaction system. In this paper a more detailed analysis of one of the external subsystems—Bluetooth Human Identification Smart Subsystem—was also included. The idea, use case, and a prototype, integration of elements of Smart Infrastructure systems and the prototype implementation were performed in a small front office of the Weegree company as a decent test-bed application area.https://www.mdpi.com/1424-8220/20/8/2376pepper robotsensor networkssmart infrastructurehumanoid robotscloud servicesthermal imaging |
| spellingShingle | Michal Podpora Arkadiusz Gardecki Ryszard Beniak Bartlomiej Klin Jose Lopez Vicario Aleksandra Kawala-Sterniuk Human Interaction Smart Subsystem—Extending Speech-Based Human-Robot Interaction Systems with an Implementation of External Smart Sensors Sensors pepper robot sensor networks smart infrastructure humanoid robots cloud services thermal imaging |
| title | Human Interaction Smart Subsystem—Extending Speech-Based Human-Robot Interaction Systems with an Implementation of External Smart Sensors |
| title_full | Human Interaction Smart Subsystem—Extending Speech-Based Human-Robot Interaction Systems with an Implementation of External Smart Sensors |
| title_fullStr | Human Interaction Smart Subsystem—Extending Speech-Based Human-Robot Interaction Systems with an Implementation of External Smart Sensors |
| title_full_unstemmed | Human Interaction Smart Subsystem—Extending Speech-Based Human-Robot Interaction Systems with an Implementation of External Smart Sensors |
| title_short | Human Interaction Smart Subsystem—Extending Speech-Based Human-Robot Interaction Systems with an Implementation of External Smart Sensors |
| title_sort | human interaction smart subsystem extending speech based human robot interaction systems with an implementation of external smart sensors |
| topic | pepper robot sensor networks smart infrastructure humanoid robots cloud services thermal imaging |
| url | https://www.mdpi.com/1424-8220/20/8/2376 |
| work_keys_str_mv | AT michalpodpora humaninteractionsmartsubsystemextendingspeechbasedhumanrobotinteractionsystemswithanimplementationofexternalsmartsensors AT arkadiuszgardecki humaninteractionsmartsubsystemextendingspeechbasedhumanrobotinteractionsystemswithanimplementationofexternalsmartsensors AT ryszardbeniak humaninteractionsmartsubsystemextendingspeechbasedhumanrobotinteractionsystemswithanimplementationofexternalsmartsensors AT bartlomiejklin humaninteractionsmartsubsystemextendingspeechbasedhumanrobotinteractionsystemswithanimplementationofexternalsmartsensors AT joselopezvicario humaninteractionsmartsubsystemextendingspeechbasedhumanrobotinteractionsystemswithanimplementationofexternalsmartsensors AT aleksandrakawalasterniuk humaninteractionsmartsubsystemextendingspeechbasedhumanrobotinteractionsystemswithanimplementationofexternalsmartsensors |