A novel multimodal communication framework using robot partner for aging population
In developed country such as Japan, aging has become a serious issue, as there is a disproportionate increasing of elderly population who are no longer able to look after themselves. In order to tackle this issue, we introduce human-friendly robot partner to support the elderly people in their daily...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Published: |
Elsevier
2015
|
| Subjects: |
| _version_ | 1825721329800708096 |
|---|---|
| author | Tang, Dalai Yusuf, Bakhtiar Botzheim, János Kubota, Naoyuki Chan, Chee Seng |
| author_facet | Tang, Dalai Yusuf, Bakhtiar Botzheim, János Kubota, Naoyuki Chan, Chee Seng |
| author_sort | Tang, Dalai |
| collection | UM |
| description | In developed country such as Japan, aging has become a serious issue, as there is a disproportionate increasing of elderly population who are no longer able to look after themselves. In order to tackle this issue, we introduce human-friendly robot partner to support the elderly people in their daily life. However, to realize this, it is essential for the robot partner to be able to have a natural communication with the human. This paper proposes a new communication framework between the human and robot partner based on relevance theory as the basis knowledge. The relevance theory is implemented to build mutual cognitive environment between the human and the robot partner, namely as the informationally structured space (ISS). Inside the ISS, robot partner employs both verbal as well as non-verbal communication to understand human. For the verbal communication, Rasmussen's behavior model is implemented as the basis for the conversational system. While for the non-verbal communication, environmental and human state data along with gesture recognition are utilized. These data are used as the perceptual input to compute the robot partner's emotion. Experimental results have shown the effectiveness of our proposed communication framework in establishing natural communication between the human and the robot partner. |
| first_indexed | 2024-03-06T05:48:45Z |
| format | Article |
| id | um.eprints-19600 |
| institution | Universiti Malaya |
| last_indexed | 2024-03-06T05:48:45Z |
| publishDate | 2015 |
| publisher | Elsevier |
| record_format | dspace |
| spelling | um.eprints-196002018-10-05T03:07:29Z http://eprints.um.edu.my/19600/ A novel multimodal communication framework using robot partner for aging population Tang, Dalai Yusuf, Bakhtiar Botzheim, János Kubota, Naoyuki Chan, Chee Seng QA75 Electronic computers. Computer science In developed country such as Japan, aging has become a serious issue, as there is a disproportionate increasing of elderly population who are no longer able to look after themselves. In order to tackle this issue, we introduce human-friendly robot partner to support the elderly people in their daily life. However, to realize this, it is essential for the robot partner to be able to have a natural communication with the human. This paper proposes a new communication framework between the human and robot partner based on relevance theory as the basis knowledge. The relevance theory is implemented to build mutual cognitive environment between the human and the robot partner, namely as the informationally structured space (ISS). Inside the ISS, robot partner employs both verbal as well as non-verbal communication to understand human. For the verbal communication, Rasmussen's behavior model is implemented as the basis for the conversational system. While for the non-verbal communication, environmental and human state data along with gesture recognition are utilized. These data are used as the perceptual input to compute the robot partner's emotion. Experimental results have shown the effectiveness of our proposed communication framework in establishing natural communication between the human and the robot partner. Elsevier 2015 Article PeerReviewed Tang, Dalai and Yusuf, Bakhtiar and Botzheim, János and Kubota, Naoyuki and Chan, Chee Seng (2015) A novel multimodal communication framework using robot partner for aging population. Expert Systems with Applications, 42 (9). pp. 4540-4555. ISSN 0957-4174, DOI https://doi.org/10.1016/j.eswa.2015.01.016 <https://doi.org/10.1016/j.eswa.2015.01.016>. http://dx.doi.org/10.1016/j.eswa.2015.01.016 doi:10.1016/j.eswa.2015.01.016 |
| spellingShingle | QA75 Electronic computers. Computer science Tang, Dalai Yusuf, Bakhtiar Botzheim, János Kubota, Naoyuki Chan, Chee Seng A novel multimodal communication framework using robot partner for aging population |
| title | A novel multimodal communication framework using robot partner for aging population |
| title_full | A novel multimodal communication framework using robot partner for aging population |
| title_fullStr | A novel multimodal communication framework using robot partner for aging population |
| title_full_unstemmed | A novel multimodal communication framework using robot partner for aging population |
| title_short | A novel multimodal communication framework using robot partner for aging population |
| title_sort | novel multimodal communication framework using robot partner for aging population |
| topic | QA75 Electronic computers. Computer science |
| work_keys_str_mv | AT tangdalai anovelmultimodalcommunicationframeworkusingrobotpartnerforagingpopulation AT yusufbakhtiar anovelmultimodalcommunicationframeworkusingrobotpartnerforagingpopulation AT botzheimjanos anovelmultimodalcommunicationframeworkusingrobotpartnerforagingpopulation AT kubotanaoyuki anovelmultimodalcommunicationframeworkusingrobotpartnerforagingpopulation AT chancheeseng anovelmultimodalcommunicationframeworkusingrobotpartnerforagingpopulation AT tangdalai novelmultimodalcommunicationframeworkusingrobotpartnerforagingpopulation AT yusufbakhtiar novelmultimodalcommunicationframeworkusingrobotpartnerforagingpopulation AT botzheimjanos novelmultimodalcommunicationframeworkusingrobotpartnerforagingpopulation AT kubotanaoyuki novelmultimodalcommunicationframeworkusingrobotpartnerforagingpopulation AT chancheeseng novelmultimodalcommunicationframeworkusingrobotpartnerforagingpopulation |