Augmented Robotics Dialog System for Enhancing Human–Robot Interaction
Augmented reality, augmented television and second screen are cutting edge technologies that provide end users extra and enhanced information related to certain events in real time. This enriched information helps users better understand such events, at the same time providing a more satisfactory ex...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2015-07-01
|
| Series: | Sensors |
| Subjects: | |
| Online Access: | http://www.mdpi.com/1424-8220/15/7/15799 |
| _version_ | 1828395100199190528 |
|---|---|
| author | Fernando Alonso-Martín Aĺvaro Castro-González Francisco Javier Fernandez de Gorostiza Luengo Miguel Ángel Salichs |
| author_facet | Fernando Alonso-Martín Aĺvaro Castro-González Francisco Javier Fernandez de Gorostiza Luengo Miguel Ángel Salichs |
| author_sort | Fernando Alonso-Martín |
| collection | DOAJ |
| description | Augmented reality, augmented television and second screen are cutting edge technologies that provide end users extra and enhanced information related to certain events in real time. This enriched information helps users better understand such events, at the same time providing a more satisfactory experience. In the present paper, we apply this main idea to human–robot interaction (HRI), to how users and robots interchange information. The ultimate goal of this paper is to improve the quality of HRI, developing a new dialog manager system that incorporates enriched information from the semantic web. This work presents the augmented robotic dialog system (ARDS), which uses natural language understanding mechanisms to provide two features: (i) a non-grammar multimodal input (verbal and/or written) text; and (ii) a contextualization of the information conveyed in the interaction. This contextualization is achieved by information enrichment techniques that link the extracted information from the dialog with extra information about the world available in semantic knowledge bases. This enriched or contextualized information (information enrichment, semantic enhancement or contextualized information are used interchangeably in the rest of this paper) offers many possibilities in terms of HRI. For instance, it can enhance the robot’s pro-activeness during a human–robot dialog (the enriched information can be used to propose new topics during the dialog, while ensuring a coherent interaction). Another possibility is to display additional multimedia content related to the enriched information on a visual device. This paper describes the ARDS and shows a proof of concept of its applications. |
| first_indexed | 2024-12-10T08:06:53Z |
| format | Article |
| id | doaj.art-a2c0e07a4c1c470984990434b8abd13f |
| institution | Directory Open Access Journal |
| issn | 1424-8220 |
| language | English |
| last_indexed | 2024-12-10T08:06:53Z |
| publishDate | 2015-07-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Sensors |
| spelling | doaj.art-a2c0e07a4c1c470984990434b8abd13f2022-12-22T01:56:39ZengMDPI AGSensors1424-82202015-07-01157157991582910.3390/s150715799s150715799Augmented Robotics Dialog System for Enhancing Human–Robot InteractionFernando Alonso-Martín0Aĺvaro Castro-González1Francisco Javier Fernandez de Gorostiza Luengo2Miguel Ángel Salichs3Robotics Lab, Universidad Carlos III de Madrid, Av. de la Universidad 30, Leganés, Madrid 28911, SpainRobotics Lab, Universidad Carlos III de Madrid, Av. de la Universidad 30, Leganés, Madrid 28911, SpainRobotics Lab, Universidad Carlos III de Madrid, Av. de la Universidad 30, Leganés, Madrid 28911, SpainRobotics Lab, Universidad Carlos III de Madrid, Av. de la Universidad 30, Leganés, Madrid 28911, SpainAugmented reality, augmented television and second screen are cutting edge technologies that provide end users extra and enhanced information related to certain events in real time. This enriched information helps users better understand such events, at the same time providing a more satisfactory experience. In the present paper, we apply this main idea to human–robot interaction (HRI), to how users and robots interchange information. The ultimate goal of this paper is to improve the quality of HRI, developing a new dialog manager system that incorporates enriched information from the semantic web. This work presents the augmented robotic dialog system (ARDS), which uses natural language understanding mechanisms to provide two features: (i) a non-grammar multimodal input (verbal and/or written) text; and (ii) a contextualization of the information conveyed in the interaction. This contextualization is achieved by information enrichment techniques that link the extracted information from the dialog with extra information about the world available in semantic knowledge bases. This enriched or contextualized information (information enrichment, semantic enhancement or contextualized information are used interchangeably in the rest of this paper) offers many possibilities in terms of HRI. For instance, it can enhance the robot’s pro-activeness during a human–robot dialog (the enriched information can be used to propose new topics during the dialog, while ensuring a coherent interaction). Another possibility is to display additional multimedia content related to the enriched information on a visual device. This paper describes the ARDS and shows a proof of concept of its applications.http://www.mdpi.com/1424-8220/15/7/15799augmented dialogaugmented interactioncontextualized dialogsocial robotshuman–robot interactionHRInatural language understandingnatural language processinginteraction systemdialog systemmultimodal interaction |
| spellingShingle | Fernando Alonso-Martín Aĺvaro Castro-González Francisco Javier Fernandez de Gorostiza Luengo Miguel Ángel Salichs Augmented Robotics Dialog System for Enhancing Human–Robot Interaction Sensors augmented dialog augmented interaction contextualized dialog social robots human–robot interaction HRI natural language understanding natural language processing interaction system dialog system multimodal interaction |
| title | Augmented Robotics Dialog System for Enhancing Human–Robot Interaction |
| title_full | Augmented Robotics Dialog System for Enhancing Human–Robot Interaction |
| title_fullStr | Augmented Robotics Dialog System for Enhancing Human–Robot Interaction |
| title_full_unstemmed | Augmented Robotics Dialog System for Enhancing Human–Robot Interaction |
| title_short | Augmented Robotics Dialog System for Enhancing Human–Robot Interaction |
| title_sort | augmented robotics dialog system for enhancing human robot interaction |
| topic | augmented dialog augmented interaction contextualized dialog social robots human–robot interaction HRI natural language understanding natural language processing interaction system dialog system multimodal interaction |
| url | http://www.mdpi.com/1424-8220/15/7/15799 |
| work_keys_str_mv | AT fernandoalonsomartin augmentedroboticsdialogsystemforenhancinghumanrobotinteraction AT alvarocastrogonzalez augmentedroboticsdialogsystemforenhancinghumanrobotinteraction AT franciscojavierfernandezdegorostizaluengo augmentedroboticsdialogsystemforenhancinghumanrobotinteraction AT miguelangelsalichs augmentedroboticsdialogsystemforenhancinghumanrobotinteraction |