An Interactive Virtual Home Navigation System Based on Home Ontology and Commonsense Reasoning
In recent years, researchers from the fields of computer vision, language, graphics, and robotics have tackled Embodied AI research. Embodied AI can learn through interaction with the real world and virtual environments and can perform various tasks in virtual environments using virtual robots. Howe...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2022-06-01
|
| Series: | Information |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2078-2489/13/6/287 |
| _version_ | 1797486230827433984 |
|---|---|
| author | Alan Schalkwijk Motoki Yatsu Takeshi Morita |
| author_facet | Alan Schalkwijk Motoki Yatsu Takeshi Morita |
| author_sort | Alan Schalkwijk |
| collection | DOAJ |
| description | In recent years, researchers from the fields of computer vision, language, graphics, and robotics have tackled Embodied AI research. Embodied AI can learn through interaction with the real world and virtual environments and can perform various tasks in virtual environments using virtual robots. However, many of these are one-way tasks in which the interaction is interrupted only by answering questions or requests to the user. In this research, we aim to develop a two-way interactive navigation system by introducing knowledge-based reasoning to Embodied AI research. Specifically, the system obtains guidance candidates that are difficult to identify with existing common-sense reasoning alone by reasoning with the constructed home ontology. Then, we develop a two-way interactive navigation system in which the virtual robot can guide the user to the location in the virtual home environment that the user needs while repeating multiple conversations with the user. We evaluated whether the proposed system was able to present appropriate guidance locations as candidates based on users’ speech input about their home environment. For the evaluation, we extracted the speech data from the corpus of daily conversation, the speech data created by the subject, and the correct answer data for each data and calculated the precision, recall, and F-value. As a result, the F-value was 0.47 for the evaluation data extracted from the daily conversation corpus, and the F-value was 0.49 for the evaluation data created by the subject. |
| first_indexed | 2024-03-09T23:30:16Z |
| format | Article |
| id | doaj.art-7b76c68f97074c7198aba0ce95e5613a |
| institution | Directory Open Access Journal |
| issn | 2078-2489 |
| language | English |
| last_indexed | 2024-03-09T23:30:16Z |
| publishDate | 2022-06-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Information |
| spelling | doaj.art-7b76c68f97074c7198aba0ce95e5613a2023-11-23T17:09:50ZengMDPI AGInformation2078-24892022-06-0113628710.3390/info13060287An Interactive Virtual Home Navigation System Based on Home Ontology and Commonsense ReasoningAlan Schalkwijk0Motoki Yatsu1Takeshi Morita2Graduate School of Science and Engineering, Aoyama Gakuin University, Sagamihara 252-5258, JapanCollege of Science and Engineering, Aoyama Gakuin University, Sagamihara 252-5258, JapanCollege of Science and Engineering, Aoyama Gakuin University, Sagamihara 252-5258, JapanIn recent years, researchers from the fields of computer vision, language, graphics, and robotics have tackled Embodied AI research. Embodied AI can learn through interaction with the real world and virtual environments and can perform various tasks in virtual environments using virtual robots. However, many of these are one-way tasks in which the interaction is interrupted only by answering questions or requests to the user. In this research, we aim to develop a two-way interactive navigation system by introducing knowledge-based reasoning to Embodied AI research. Specifically, the system obtains guidance candidates that are difficult to identify with existing common-sense reasoning alone by reasoning with the constructed home ontology. Then, we develop a two-way interactive navigation system in which the virtual robot can guide the user to the location in the virtual home environment that the user needs while repeating multiple conversations with the user. We evaluated whether the proposed system was able to present appropriate guidance locations as candidates based on users’ speech input about their home environment. For the evaluation, we extracted the speech data from the corpus of daily conversation, the speech data created by the subject, and the correct answer data for each data and calculated the precision, recall, and F-value. As a result, the F-value was 0.47 for the evaluation data extracted from the daily conversation corpus, and the F-value was 0.49 for the evaluation data created by the subject.https://www.mdpi.com/2078-2489/13/6/287navigation systemhome ontologydialog systemcommon-sense reasoning |
| spellingShingle | Alan Schalkwijk Motoki Yatsu Takeshi Morita An Interactive Virtual Home Navigation System Based on Home Ontology and Commonsense Reasoning Information navigation system home ontology dialog system common-sense reasoning |
| title | An Interactive Virtual Home Navigation System Based on Home Ontology and Commonsense Reasoning |
| title_full | An Interactive Virtual Home Navigation System Based on Home Ontology and Commonsense Reasoning |
| title_fullStr | An Interactive Virtual Home Navigation System Based on Home Ontology and Commonsense Reasoning |
| title_full_unstemmed | An Interactive Virtual Home Navigation System Based on Home Ontology and Commonsense Reasoning |
| title_short | An Interactive Virtual Home Navigation System Based on Home Ontology and Commonsense Reasoning |
| title_sort | interactive virtual home navigation system based on home ontology and commonsense reasoning |
| topic | navigation system home ontology dialog system common-sense reasoning |
| url | https://www.mdpi.com/2078-2489/13/6/287 |
| work_keys_str_mv | AT alanschalkwijk aninteractivevirtualhomenavigationsystembasedonhomeontologyandcommonsensereasoning AT motokiyatsu aninteractivevirtualhomenavigationsystembasedonhomeontologyandcommonsensereasoning AT takeshimorita aninteractivevirtualhomenavigationsystembasedonhomeontologyandcommonsensereasoning AT alanschalkwijk interactivevirtualhomenavigationsystembasedonhomeontologyandcommonsensereasoning AT motokiyatsu interactivevirtualhomenavigationsystembasedonhomeontologyandcommonsensereasoning AT takeshimorita interactivevirtualhomenavigationsystembasedonhomeontologyandcommonsensereasoning |