DS-CNN: Deep Convolutional Neural Networks for Facial Emotion Detection in Children with Down Syndrome during Dolphin-Assisted Therapy
In Mexico, according to data from the General Directorate of Health Information (2018), there is an annual incidence of 689 newborns with Trisomy 21, well-known as Down Syndrome. Worldwide, this incidence is estimated between 1 in every 1000 newborns, approximately. That is why this work focuses on...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2023-08-01
|
| Series: | Healthcare |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2227-9032/11/16/2295 |
| _version_ | 1797584551883571200 |
|---|---|
| author | Jesús Jaime Moreno Escobar Oswaldo Morales Matamoros Erika Yolanda Aguilar del Villar Hugo Quintana Espinosa Liliana Chanona Hernández |
| author_facet | Jesús Jaime Moreno Escobar Oswaldo Morales Matamoros Erika Yolanda Aguilar del Villar Hugo Quintana Espinosa Liliana Chanona Hernández |
| author_sort | Jesús Jaime Moreno Escobar |
| collection | DOAJ |
| description | In Mexico, according to data from the General Directorate of Health Information (2018), there is an annual incidence of 689 newborns with Trisomy 21, well-known as Down Syndrome. Worldwide, this incidence is estimated between 1 in every 1000 newborns, approximately. That is why this work focuses on the detection and analysis of facial emotions in children with Down Syndrome in order to predict their emotions throughout a dolphin-assisted therapy. In this work, two databases are used: Exploratory Data Analysis, with a total of 20,214 images, and the Down’s Syndrome Dataset database, with 1445 images for training, validation, and testing of the neural network models. The construction of two architectures based on a Deep Convolutional Neural Network manages an efficiency of 79%, when these architectures are tested with a large reference image database. Then, the architecture that achieves better results is trained, validated, and tested in a small-image database with the facial emotions of children with Down Syndrome, obtaining an efficiency of 72%. However, this increases by 9% when the brain activity of the child is included in the training, resulting in an average precision of 81%. Using electroencephalogram (EEG) signals in a Convolutional Neural Network (CNN) along with the Down’s Syndrome Dataset (DSDS) has promising advantages in the field of brain–computer interfaces. EEG provides direct access to the electrical activity of the brain, allowing for real-time monitoring and analysis of cognitive states. Integrating EEG signals into a CNN architecture can enhance learning and decision-making capabilities. It is important to note that this work has the primary objective of addressing a doubly vulnerable population, as these children also have a disability. |
| first_indexed | 2024-03-10T23:54:19Z |
| format | Article |
| id | doaj.art-634cd83f938c45a09d970f4efe4a6e29 |
| institution | Directory Open Access Journal |
| issn | 2227-9032 |
| language | English |
| last_indexed | 2024-03-10T23:54:19Z |
| publishDate | 2023-08-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Healthcare |
| spelling | doaj.art-634cd83f938c45a09d970f4efe4a6e292023-11-19T01:18:49ZengMDPI AGHealthcare2227-90322023-08-011116229510.3390/healthcare11162295DS-CNN: Deep Convolutional Neural Networks for Facial Emotion Detection in Children with Down Syndrome during Dolphin-Assisted TherapyJesús Jaime Moreno Escobar0Oswaldo Morales Matamoros1Erika Yolanda Aguilar del Villar2Hugo Quintana Espinosa3Liliana Chanona Hernández4Escuela Superior de Ingeniería Mecánica y Eléctrica, Unidad Zacatenco, Instituto Politécnico Nacional, Ciudad de México 07340, MexicoEscuela Superior de Ingeniería Mecánica y Eléctrica, Unidad Zacatenco, Instituto Politécnico Nacional, Ciudad de México 07340, MexicoEscuela Superior de Ingeniería Mecánica y Eléctrica, Unidad Zacatenco, Instituto Politécnico Nacional, Ciudad de México 07340, MexicoEscuela Superior de Ingeniería Mecánica y Eléctrica, Unidad Zacatenco, Instituto Politécnico Nacional, Ciudad de México 07340, MexicoEscuela Superior de Ingeniería Mecánica y Eléctrica, Unidad Zacatenco, Instituto Politécnico Nacional, Ciudad de México 07340, MexicoIn Mexico, according to data from the General Directorate of Health Information (2018), there is an annual incidence of 689 newborns with Trisomy 21, well-known as Down Syndrome. Worldwide, this incidence is estimated between 1 in every 1000 newborns, approximately. That is why this work focuses on the detection and analysis of facial emotions in children with Down Syndrome in order to predict their emotions throughout a dolphin-assisted therapy. In this work, two databases are used: Exploratory Data Analysis, with a total of 20,214 images, and the Down’s Syndrome Dataset database, with 1445 images for training, validation, and testing of the neural network models. The construction of two architectures based on a Deep Convolutional Neural Network manages an efficiency of 79%, when these architectures are tested with a large reference image database. Then, the architecture that achieves better results is trained, validated, and tested in a small-image database with the facial emotions of children with Down Syndrome, obtaining an efficiency of 72%. However, this increases by 9% when the brain activity of the child is included in the training, resulting in an average precision of 81%. Using electroencephalogram (EEG) signals in a Convolutional Neural Network (CNN) along with the Down’s Syndrome Dataset (DSDS) has promising advantages in the field of brain–computer interfaces. EEG provides direct access to the electrical activity of the brain, allowing for real-time monitoring and analysis of cognitive states. Integrating EEG signals into a CNN architecture can enhance learning and decision-making capabilities. It is important to note that this work has the primary objective of addressing a doubly vulnerable population, as these children also have a disability.https://www.mdpi.com/2227-9032/11/16/2295Down Syndromedeep convolutional neural networkdeep learningdolphin-assisted therapyfacial emotion detection |
| spellingShingle | Jesús Jaime Moreno Escobar Oswaldo Morales Matamoros Erika Yolanda Aguilar del Villar Hugo Quintana Espinosa Liliana Chanona Hernández DS-CNN: Deep Convolutional Neural Networks for Facial Emotion Detection in Children with Down Syndrome during Dolphin-Assisted Therapy Healthcare Down Syndrome deep convolutional neural network deep learning dolphin-assisted therapy facial emotion detection |
| title | DS-CNN: Deep Convolutional Neural Networks for Facial Emotion Detection in Children with Down Syndrome during Dolphin-Assisted Therapy |
| title_full | DS-CNN: Deep Convolutional Neural Networks for Facial Emotion Detection in Children with Down Syndrome during Dolphin-Assisted Therapy |
| title_fullStr | DS-CNN: Deep Convolutional Neural Networks for Facial Emotion Detection in Children with Down Syndrome during Dolphin-Assisted Therapy |
| title_full_unstemmed | DS-CNN: Deep Convolutional Neural Networks for Facial Emotion Detection in Children with Down Syndrome during Dolphin-Assisted Therapy |
| title_short | DS-CNN: Deep Convolutional Neural Networks for Facial Emotion Detection in Children with Down Syndrome during Dolphin-Assisted Therapy |
| title_sort | ds cnn deep convolutional neural networks for facial emotion detection in children with down syndrome during dolphin assisted therapy |
| topic | Down Syndrome deep convolutional neural network deep learning dolphin-assisted therapy facial emotion detection |
| url | https://www.mdpi.com/2227-9032/11/16/2295 |
| work_keys_str_mv | AT jesusjaimemorenoescobar dscnndeepconvolutionalneuralnetworksforfacialemotiondetectioninchildrenwithdownsyndromeduringdolphinassistedtherapy AT oswaldomoralesmatamoros dscnndeepconvolutionalneuralnetworksforfacialemotiondetectioninchildrenwithdownsyndromeduringdolphinassistedtherapy AT erikayolandaaguilardelvillar dscnndeepconvolutionalneuralnetworksforfacialemotiondetectioninchildrenwithdownsyndromeduringdolphinassistedtherapy AT hugoquintanaespinosa dscnndeepconvolutionalneuralnetworksforfacialemotiondetectioninchildrenwithdownsyndromeduringdolphinassistedtherapy AT lilianachanonahernandez dscnndeepconvolutionalneuralnetworksforfacialemotiondetectioninchildrenwithdownsyndromeduringdolphinassistedtherapy |