Fostering Emotion Recognition in Children with Autism Spectrum Disorder
Facial expressions are of utmost importance in social interactions, allowing communicative prompts for a speaking turn and feedback. Nevertheless, not all have the ability to express themselves socially and emotionally in verbal and non-verbal communication. In particular, individuals with Autism Sp...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2021-09-01
|
| Series: | Multimodal Technologies and Interaction |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2414-4088/5/10/57 |
| _version_ | 1797513675690475520 |
|---|---|
| author | Vinícius Silva Filomena Soares João Sena Esteves Cristina P. Santos Ana Paula Pereira |
| author_facet | Vinícius Silva Filomena Soares João Sena Esteves Cristina P. Santos Ana Paula Pereira |
| author_sort | Vinícius Silva |
| collection | DOAJ |
| description | Facial expressions are of utmost importance in social interactions, allowing communicative prompts for a speaking turn and feedback. Nevertheless, not all have the ability to express themselves socially and emotionally in verbal and non-verbal communication. In particular, individuals with Autism Spectrum Disorder (ASD) are characterized by impairments in social communication, repetitive patterns of behaviour, and restricted activities or interests. In the literature, the use of robotic tools is reported to promote social interaction with children with ASD. The main goal of this work is to develop a system capable of automatic detecting emotions through facial expressions and interfacing them with a robotic platform (Zeno R50 Robokind<sup>®</sup> robotic platform, named ZECA) in order to allow social interaction with children with ASD. ZECA was used as a mediator in social communication activities. The experimental setup and methodology for a real-time facial expression (happiness, sadness, anger, surprise, fear, and neutral) recognition system was based on the Intel<sup>®</sup> RealSense™ 3D sensor and on facial features extraction and multiclass Support Vector Machine classifier. The results obtained allowed to infer that the proposed system is adequate in support sessions with children with ASD, giving a strong indication that it may be used in fostering emotion recognition and imitation skills. |
| first_indexed | 2024-03-10T06:19:57Z |
| format | Article |
| id | doaj.art-373da4111d6a4979abf685dd536f77bb |
| institution | Directory Open Access Journal |
| issn | 2414-4088 |
| language | English |
| last_indexed | 2024-03-10T06:19:57Z |
| publishDate | 2021-09-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Multimodal Technologies and Interaction |
| spelling | doaj.art-373da4111d6a4979abf685dd536f77bb2023-11-22T19:21:34ZengMDPI AGMultimodal Technologies and Interaction2414-40882021-09-015105710.3390/mti5100057Fostering Emotion Recognition in Children with Autism Spectrum DisorderVinícius Silva0Filomena Soares1João Sena Esteves2Cristina P. Santos3Ana Paula Pereira4Centro Algoritmi, Campus of Azurém, University of Minho, 4800-058 Guimaraes, PortugalCentro Algoritmi, Campus of Azurém, University of Minho, 4800-058 Guimaraes, PortugalCentro Algoritmi, Campus of Azurém, University of Minho, 4800-058 Guimaraes, PortugalCMEMS R&D, Center for Microelectromechanical Systems, University of Minho, 4800-058 Guimaraes, PortugalEducation Research Center, Institute of Education, University of Minho, 4710-057 Braga, PortugalFacial expressions are of utmost importance in social interactions, allowing communicative prompts for a speaking turn and feedback. Nevertheless, not all have the ability to express themselves socially and emotionally in verbal and non-verbal communication. In particular, individuals with Autism Spectrum Disorder (ASD) are characterized by impairments in social communication, repetitive patterns of behaviour, and restricted activities or interests. In the literature, the use of robotic tools is reported to promote social interaction with children with ASD. The main goal of this work is to develop a system capable of automatic detecting emotions through facial expressions and interfacing them with a robotic platform (Zeno R50 Robokind<sup>®</sup> robotic platform, named ZECA) in order to allow social interaction with children with ASD. ZECA was used as a mediator in social communication activities. The experimental setup and methodology for a real-time facial expression (happiness, sadness, anger, surprise, fear, and neutral) recognition system was based on the Intel<sup>®</sup> RealSense™ 3D sensor and on facial features extraction and multiclass Support Vector Machine classifier. The results obtained allowed to infer that the proposed system is adequate in support sessions with children with ASD, giving a strong indication that it may be used in fostering emotion recognition and imitation skills.https://www.mdpi.com/2414-4088/5/10/57Human Computer InteractionZeno R50 RobotSupport Vector Machinefacial expressionsemotions recognitionAutism Spectrum Disorder |
| spellingShingle | Vinícius Silva Filomena Soares João Sena Esteves Cristina P. Santos Ana Paula Pereira Fostering Emotion Recognition in Children with Autism Spectrum Disorder Multimodal Technologies and Interaction Human Computer Interaction Zeno R50 Robot Support Vector Machine facial expressions emotions recognition Autism Spectrum Disorder |
| title | Fostering Emotion Recognition in Children with Autism Spectrum Disorder |
| title_full | Fostering Emotion Recognition in Children with Autism Spectrum Disorder |
| title_fullStr | Fostering Emotion Recognition in Children with Autism Spectrum Disorder |
| title_full_unstemmed | Fostering Emotion Recognition in Children with Autism Spectrum Disorder |
| title_short | Fostering Emotion Recognition in Children with Autism Spectrum Disorder |
| title_sort | fostering emotion recognition in children with autism spectrum disorder |
| topic | Human Computer Interaction Zeno R50 Robot Support Vector Machine facial expressions emotions recognition Autism Spectrum Disorder |
| url | https://www.mdpi.com/2414-4088/5/10/57 |
| work_keys_str_mv | AT viniciussilva fosteringemotionrecognitioninchildrenwithautismspectrumdisorder AT filomenasoares fosteringemotionrecognitioninchildrenwithautismspectrumdisorder AT joaosenaesteves fosteringemotionrecognitioninchildrenwithautismspectrumdisorder AT cristinapsantos fosteringemotionrecognitioninchildrenwithautismspectrumdisorder AT anapaulapereira fosteringemotionrecognitioninchildrenwithautismspectrumdisorder |