A pupil response system using hemispherical displays for enhancing affective conveyance
In human interaction and communication, not only verbal messages but also nonverbal behaviors such as facial expressions, body movements, gazes and pupil responses play an important role in expressions of talker’s affect. These expressions encourage to read the emotional cues and to cause the sharin...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
The Japan Society of Mechanical Engineers
2019-04-01
|
| Series: | Journal of Advanced Mechanical Design, Systems, and Manufacturing |
| Subjects: | |
| Online Access: | https://www.jstage.jst.go.jp/article/jamdsm/13/2/13_2019jamdsm0032/_pdf/-char/en |
| _version_ | 1811292513157251072 |
|---|---|
| author | Yoshihiro SEJIMA Shoichi EGAWA Yoichiro SATO Tomio WATANABE |
| author_facet | Yoshihiro SEJIMA Shoichi EGAWA Yoichiro SATO Tomio WATANABE |
| author_sort | Yoshihiro SEJIMA |
| collection | DOAJ |
| description | In human interaction and communication, not only verbal messages but also nonverbal behaviors such as facial expressions, body movements, gazes and pupil responses play an important role in expressions of talker’s affect. These expressions encourage to read the emotional cues and to cause the sharing of embodiment and empathy. We focused on the pupil response which is closely related to human affect, and developed an embodied communication system in which an interactive CG character generates the pupil response as well as communicative actions and movements such as nodding and body movements by speech input. In addition, it was confirmed that the pupil response is effective for supporting the embodied interaction and communication using the developed system. In this paper, in order to realize the smooth interaction between human and robot, we developed a pupil response system using hemispherical displays for enhancing affective conveyance. This system looks like robot’s eyeballs and expresses vivid pupil response by speech input. We carried out a sensory evaluation experiment under the condition that the developed system speaks. The results demonstrated that the system effectively enhances affective conveyance. |
| first_indexed | 2024-04-13T04:46:34Z |
| format | Article |
| id | doaj.art-fc349e84a5ca455390c20e09a805b52c |
| institution | Directory Open Access Journal |
| issn | 1881-3054 |
| language | English |
| last_indexed | 2024-04-13T04:46:34Z |
| publishDate | 2019-04-01 |
| publisher | The Japan Society of Mechanical Engineers |
| record_format | Article |
| series | Journal of Advanced Mechanical Design, Systems, and Manufacturing |
| spelling | doaj.art-fc349e84a5ca455390c20e09a805b52c2022-12-22T03:01:50ZengThe Japan Society of Mechanical EngineersJournal of Advanced Mechanical Design, Systems, and Manufacturing1881-30542019-04-01132JAMDSM0032JAMDSM003210.1299/jamdsm.2019jamdsm0032jamdsmA pupil response system using hemispherical displays for enhancing affective conveyanceYoshihiro SEJIMA0Shoichi EGAWA1Yoichiro SATO2Tomio WATANABE3Faculty of Informatics, Kansai UniversityGraduate School of Computer Science and Systems Engineering, Okayama Prefectural UniversityFaculty of Computer Science and Systems Engineering, Okayama Prefectural UniversityFaculty of Computer Science and Systems Engineering, Okayama Prefectural UniversityIn human interaction and communication, not only verbal messages but also nonverbal behaviors such as facial expressions, body movements, gazes and pupil responses play an important role in expressions of talker’s affect. These expressions encourage to read the emotional cues and to cause the sharing of embodiment and empathy. We focused on the pupil response which is closely related to human affect, and developed an embodied communication system in which an interactive CG character generates the pupil response as well as communicative actions and movements such as nodding and body movements by speech input. In addition, it was confirmed that the pupil response is effective for supporting the embodied interaction and communication using the developed system. In this paper, in order to realize the smooth interaction between human and robot, we developed a pupil response system using hemispherical displays for enhancing affective conveyance. This system looks like robot’s eyeballs and expresses vivid pupil response by speech input. We carried out a sensory evaluation experiment under the condition that the developed system speaks. The results demonstrated that the system effectively enhances affective conveyance.https://www.jstage.jst.go.jp/article/jamdsm/13/2/13_2019jamdsm0032/_pdf/-char/enhuman interfacehuman-robot interaction designkansei and affective engineeringmedia representationempathypupil response |
| spellingShingle | Yoshihiro SEJIMA Shoichi EGAWA Yoichiro SATO Tomio WATANABE A pupil response system using hemispherical displays for enhancing affective conveyance Journal of Advanced Mechanical Design, Systems, and Manufacturing human interface human-robot interaction design kansei and affective engineering media representation empathy pupil response |
| title | A pupil response system using hemispherical displays for enhancing affective conveyance |
| title_full | A pupil response system using hemispherical displays for enhancing affective conveyance |
| title_fullStr | A pupil response system using hemispherical displays for enhancing affective conveyance |
| title_full_unstemmed | A pupil response system using hemispherical displays for enhancing affective conveyance |
| title_short | A pupil response system using hemispherical displays for enhancing affective conveyance |
| title_sort | pupil response system using hemispherical displays for enhancing affective conveyance |
| topic | human interface human-robot interaction design kansei and affective engineering media representation empathy pupil response |
| url | https://www.jstage.jst.go.jp/article/jamdsm/13/2/13_2019jamdsm0032/_pdf/-char/en |
| work_keys_str_mv | AT yoshihirosejima apupilresponsesystemusinghemisphericaldisplaysforenhancingaffectiveconveyance AT shoichiegawa apupilresponsesystemusinghemisphericaldisplaysforenhancingaffectiveconveyance AT yoichirosato apupilresponsesystemusinghemisphericaldisplaysforenhancingaffectiveconveyance AT tomiowatanabe apupilresponsesystemusinghemisphericaldisplaysforenhancingaffectiveconveyance AT yoshihirosejima pupilresponsesystemusinghemisphericaldisplaysforenhancingaffectiveconveyance AT shoichiegawa pupilresponsesystemusinghemisphericaldisplaysforenhancingaffectiveconveyance AT yoichirosato pupilresponsesystemusinghemisphericaldisplaysforenhancingaffectiveconveyance AT tomiowatanabe pupilresponsesystemusinghemisphericaldisplaysforenhancingaffectiveconveyance |