Smiles as a Signal of Prosocial Behaviors Toward the Robot in the Therapeutic Setting for Children With Autism Spectrum Disorder
We explored how robot-assisted therapy based on smile analysis may facilitate the prosocial behaviors of children with autism spectrum disorder. Prosocial behaviors, which are actions for the benefit of others, are required to belong to society and increase the quality of life. As smiling is a candi...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Frontiers Media S.A.
2021-05-01
|
| Series: | Frontiers in Robotics and AI |
| Subjects: | |
| Online Access: | https://www.frontiersin.org/articles/10.3389/frobt.2021.599755/full |
| _version_ | 1819047269945573376 |
|---|---|
| author | SunKyoung Kim Masakazu Hirokawa Soichiro Matsuda Atsushi Funahashi Kenji Suzuki |
| author_facet | SunKyoung Kim Masakazu Hirokawa Soichiro Matsuda Atsushi Funahashi Kenji Suzuki |
| author_sort | SunKyoung Kim |
| collection | DOAJ |
| description | We explored how robot-assisted therapy based on smile analysis may facilitate the prosocial behaviors of children with autism spectrum disorder. Prosocial behaviors, which are actions for the benefit of others, are required to belong to society and increase the quality of life. As smiling is a candidate for predicting prosocial behaviors in robot-assisted therapy, we measured smiles by annotating behaviors that were recorded with video cameras and by classifying facial muscle activities recorded with a wearable device. While interacting with a robot, the participants experienced two situations where participants' prosocial behaviors are expected, which were supporting the robot to walk and helping the robot from falling. We first explored the overall smiles at specific timings and prosocial behaviors. Then, we explored the smiles triggered by a robot and behavior changes before engaging in prosocial behaviors. The results show that the specific timing of smiles and prosocial behaviors increased in the second session of children with autism spectrum disorder. Additionally, a smile was followed by a series of behaviors before prosocial behavior. With a proposed Bayesian model, smiling, or heading predicted prosocial behaviors with higher accuracy compared to other variables. Particularly, voluntary prosocial behaviors were observed after smiling. The findings of this exploratory study imply that smiles might be a signal of prosocial behaviors. We also suggest a probabilistic model for predicting prosocial behaviors based on smile analysis, which could be applied to personalized robot-assisted therapy by controlling a robot's movements to arouse smiles and increase the probability that a child with autism spectrum disorder will engage in prosocial behaviors. |
| first_indexed | 2024-12-21T10:57:41Z |
| format | Article |
| id | doaj.art-c322e0d4155e467cbd6211a077f514fc |
| institution | Directory Open Access Journal |
| issn | 2296-9144 |
| language | English |
| last_indexed | 2024-12-21T10:57:41Z |
| publishDate | 2021-05-01 |
| publisher | Frontiers Media S.A. |
| record_format | Article |
| series | Frontiers in Robotics and AI |
| spelling | doaj.art-c322e0d4155e467cbd6211a077f514fc2022-12-21T19:06:28ZengFrontiers Media S.A.Frontiers in Robotics and AI2296-91442021-05-01810.3389/frobt.2021.599755599755Smiles as a Signal of Prosocial Behaviors Toward the Robot in the Therapeutic Setting for Children With Autism Spectrum DisorderSunKyoung Kim0Masakazu Hirokawa1Soichiro Matsuda2Atsushi Funahashi3Kenji Suzuki4Faculty of Engineering, Information and Systems, University of Tsukuba, Tsukuba, JapanFaculty of Engineering, Information and Systems, University of Tsukuba, Tsukuba, JapanFaculty of Human Sciences, University of Tsukuba, Tsukuba, JapanFaculty of Sport Science, Nippon Sport Science University, Yokohama, JapanFaculty of Engineering, Information and Systems, University of Tsukuba, Tsukuba, JapanWe explored how robot-assisted therapy based on smile analysis may facilitate the prosocial behaviors of children with autism spectrum disorder. Prosocial behaviors, which are actions for the benefit of others, are required to belong to society and increase the quality of life. As smiling is a candidate for predicting prosocial behaviors in robot-assisted therapy, we measured smiles by annotating behaviors that were recorded with video cameras and by classifying facial muscle activities recorded with a wearable device. While interacting with a robot, the participants experienced two situations where participants' prosocial behaviors are expected, which were supporting the robot to walk and helping the robot from falling. We first explored the overall smiles at specific timings and prosocial behaviors. Then, we explored the smiles triggered by a robot and behavior changes before engaging in prosocial behaviors. The results show that the specific timing of smiles and prosocial behaviors increased in the second session of children with autism spectrum disorder. Additionally, a smile was followed by a series of behaviors before prosocial behavior. With a proposed Bayesian model, smiling, or heading predicted prosocial behaviors with higher accuracy compared to other variables. Particularly, voluntary prosocial behaviors were observed after smiling. The findings of this exploratory study imply that smiles might be a signal of prosocial behaviors. We also suggest a probabilistic model for predicting prosocial behaviors based on smile analysis, which could be applied to personalized robot-assisted therapy by controlling a robot's movements to arouse smiles and increase the probability that a child with autism spectrum disorder will engage in prosocial behaviors.https://www.frontiersin.org/articles/10.3389/frobt.2021.599755/fullsmileprosocial behaviorrobot-assisted therapyNAOBayesian modelelectromyogram |
| spellingShingle | SunKyoung Kim Masakazu Hirokawa Soichiro Matsuda Atsushi Funahashi Kenji Suzuki Smiles as a Signal of Prosocial Behaviors Toward the Robot in the Therapeutic Setting for Children With Autism Spectrum Disorder Frontiers in Robotics and AI smile prosocial behavior robot-assisted therapy NAO Bayesian model electromyogram |
| title | Smiles as a Signal of Prosocial Behaviors Toward the Robot in the Therapeutic Setting for Children With Autism Spectrum Disorder |
| title_full | Smiles as a Signal of Prosocial Behaviors Toward the Robot in the Therapeutic Setting for Children With Autism Spectrum Disorder |
| title_fullStr | Smiles as a Signal of Prosocial Behaviors Toward the Robot in the Therapeutic Setting for Children With Autism Spectrum Disorder |
| title_full_unstemmed | Smiles as a Signal of Prosocial Behaviors Toward the Robot in the Therapeutic Setting for Children With Autism Spectrum Disorder |
| title_short | Smiles as a Signal of Prosocial Behaviors Toward the Robot in the Therapeutic Setting for Children With Autism Spectrum Disorder |
| title_sort | smiles as a signal of prosocial behaviors toward the robot in the therapeutic setting for children with autism spectrum disorder |
| topic | smile prosocial behavior robot-assisted therapy NAO Bayesian model electromyogram |
| url | https://www.frontiersin.org/articles/10.3389/frobt.2021.599755/full |
| work_keys_str_mv | AT sunkyoungkim smilesasasignalofprosocialbehaviorstowardtherobotinthetherapeuticsettingforchildrenwithautismspectrumdisorder AT masakazuhirokawa smilesasasignalofprosocialbehaviorstowardtherobotinthetherapeuticsettingforchildrenwithautismspectrumdisorder AT soichiromatsuda smilesasasignalofprosocialbehaviorstowardtherobotinthetherapeuticsettingforchildrenwithautismspectrumdisorder AT atsushifunahashi smilesasasignalofprosocialbehaviorstowardtherobotinthetherapeuticsettingforchildrenwithautismspectrumdisorder AT kenjisuzuki smilesasasignalofprosocialbehaviorstowardtherobotinthetherapeuticsettingforchildrenwithautismspectrumdisorder |