The Implementation and Evaluation of Individual Preference in Robot Facial Expression Based on Emotion Estimation Using Biological Signals
Recently, robot services have been widely applied in many fields. To provide optimum service, it is essential to maintain good acceptance of the robot for more effective interaction with users. Previously, we attempted to implement facial expressions by synchronizing an estimated human emotion on th...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2021-09-01
|
| Series: | Sensors |
| Subjects: | |
| Online Access: | https://www.mdpi.com/1424-8220/21/18/6322 |
| _version_ | 1797517214105993216 |
|---|---|
| author | Peeraya Sripian Muhammad Nur Adilin Mohd Anuardi Jiawei Yu Midori Sugaya |
| author_facet | Peeraya Sripian Muhammad Nur Adilin Mohd Anuardi Jiawei Yu Midori Sugaya |
| author_sort | Peeraya Sripian |
| collection | DOAJ |
| description | Recently, robot services have been widely applied in many fields. To provide optimum service, it is essential to maintain good acceptance of the robot for more effective interaction with users. Previously, we attempted to implement facial expressions by synchronizing an estimated human emotion on the face of a robot. The results revealed that the robot could present different perceptions according to individual preferences. In this study, we considered individual differences to improve the acceptance of the robot by changing the robot’s expression according to the emotion of its interacting partner. The emotion was estimated using biological signals, and the robot changed its expression according to three conditions: synchronized with the estimated emotion, inversely synchronized, and a funny expression. During the experiment, the participants provided feedback regarding the robot’s expression by choosing whether they “like” or “dislike” the expression. We investigated individual differences in the acceptance of the robot expression using the Semantic Differential scale method. In addition, logistic regression was used to create a classification model by considering individual differences based on the biological data and feedback from each participant. We found that the robot expression based on inverse synchronization when the participants felt a negative emotion could result in impression differences among individuals. Then, the robot’s expression was determined based on the classification model, and the Semantic Differential scale on the impression of the robot was compared with the three conditions. Overall, we found that the participants were most accepting when the robot expression was calculated using the proposed personalized method. |
| first_indexed | 2024-03-10T07:13:37Z |
| format | Article |
| id | doaj.art-8a61cdb8fa6e471ba21334e43d798444 |
| institution | Directory Open Access Journal |
| issn | 1424-8220 |
| language | English |
| last_indexed | 2024-03-10T07:13:37Z |
| publishDate | 2021-09-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Sensors |
| spelling | doaj.art-8a61cdb8fa6e471ba21334e43d7984442023-11-22T15:15:05ZengMDPI AGSensors1424-82202021-09-012118632210.3390/s21186322The Implementation and Evaluation of Individual Preference in Robot Facial Expression Based on Emotion Estimation Using Biological SignalsPeeraya Sripian0Muhammad Nur Adilin Mohd Anuardi1Jiawei Yu2Midori Sugaya3College of Engineering, Shibaura Institute of Technology, Tokyo 135-8548, JapanCollege of Engineering, Shibaura Institute of Technology, Tokyo 135-8548, JapanCollege of Engineering, Shibaura Institute of Technology, Tokyo 135-8548, JapanCollege of Engineering, Shibaura Institute of Technology, Tokyo 135-8548, JapanRecently, robot services have been widely applied in many fields. To provide optimum service, it is essential to maintain good acceptance of the robot for more effective interaction with users. Previously, we attempted to implement facial expressions by synchronizing an estimated human emotion on the face of a robot. The results revealed that the robot could present different perceptions according to individual preferences. In this study, we considered individual differences to improve the acceptance of the robot by changing the robot’s expression according to the emotion of its interacting partner. The emotion was estimated using biological signals, and the robot changed its expression according to three conditions: synchronized with the estimated emotion, inversely synchronized, and a funny expression. During the experiment, the participants provided feedback regarding the robot’s expression by choosing whether they “like” or “dislike” the expression. We investigated individual differences in the acceptance of the robot expression using the Semantic Differential scale method. In addition, logistic regression was used to create a classification model by considering individual differences based on the biological data and feedback from each participant. We found that the robot expression based on inverse synchronization when the participants felt a negative emotion could result in impression differences among individuals. Then, the robot’s expression was determined based on the classification model, and the Semantic Differential scale on the impression of the robot was compared with the three conditions. Overall, we found that the participants were most accepting when the robot expression was calculated using the proposed personalized method.https://www.mdpi.com/1424-8220/21/18/6322robotrobot facial expressionemotion estimationbiological signalsEEGHRV |
| spellingShingle | Peeraya Sripian Muhammad Nur Adilin Mohd Anuardi Jiawei Yu Midori Sugaya The Implementation and Evaluation of Individual Preference in Robot Facial Expression Based on Emotion Estimation Using Biological Signals Sensors robot robot facial expression emotion estimation biological signals EEG HRV |
| title | The Implementation and Evaluation of Individual Preference in Robot Facial Expression Based on Emotion Estimation Using Biological Signals |
| title_full | The Implementation and Evaluation of Individual Preference in Robot Facial Expression Based on Emotion Estimation Using Biological Signals |
| title_fullStr | The Implementation and Evaluation of Individual Preference in Robot Facial Expression Based on Emotion Estimation Using Biological Signals |
| title_full_unstemmed | The Implementation and Evaluation of Individual Preference in Robot Facial Expression Based on Emotion Estimation Using Biological Signals |
| title_short | The Implementation and Evaluation of Individual Preference in Robot Facial Expression Based on Emotion Estimation Using Biological Signals |
| title_sort | implementation and evaluation of individual preference in robot facial expression based on emotion estimation using biological signals |
| topic | robot robot facial expression emotion estimation biological signals EEG HRV |
| url | https://www.mdpi.com/1424-8220/21/18/6322 |
| work_keys_str_mv | AT peerayasripian theimplementationandevaluationofindividualpreferenceinrobotfacialexpressionbasedonemotionestimationusingbiologicalsignals AT muhammadnuradilinmohdanuardi theimplementationandevaluationofindividualpreferenceinrobotfacialexpressionbasedonemotionestimationusingbiologicalsignals AT jiaweiyu theimplementationandevaluationofindividualpreferenceinrobotfacialexpressionbasedonemotionestimationusingbiologicalsignals AT midorisugaya theimplementationandevaluationofindividualpreferenceinrobotfacialexpressionbasedonemotionestimationusingbiologicalsignals AT peerayasripian implementationandevaluationofindividualpreferenceinrobotfacialexpressionbasedonemotionestimationusingbiologicalsignals AT muhammadnuradilinmohdanuardi implementationandevaluationofindividualpreferenceinrobotfacialexpressionbasedonemotionestimationusingbiologicalsignals AT jiaweiyu implementationandevaluationofindividualpreferenceinrobotfacialexpressionbasedonemotionestimationusingbiologicalsignals AT midorisugaya implementationandevaluationofindividualpreferenceinrobotfacialexpressionbasedonemotionestimationusingbiologicalsignals |