Towards Robot-Assisted Therapy for Children With Autism—The Ontological Knowledge Models and Reinforcement Learning-Based Algorithms
Robots are more and more present in our lives, particularly in the health sector. In therapeutic centers, some therapists are beginning to explore various tools like video games, Internet exchanges, and robot-assisted therapy. These tools will be at the disposal of these professionals as additional...
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Frontiers Media S.A.
2022-04-01
|
| Series: | Frontiers in Robotics and AI |
| Subjects: | |
| Online Access: | https://www.frontiersin.org/articles/10.3389/frobt.2022.713964/full |
| _version_ | 1811297561250627584 |
|---|---|
| author | Intissar Salhi Mohammed Qbadou Soukaina Gouraguine Khalifa Mansouri Chris Lytridis Vassilis Kaburlasos |
| author_facet | Intissar Salhi Mohammed Qbadou Soukaina Gouraguine Khalifa Mansouri Chris Lytridis Vassilis Kaburlasos |
| author_sort | Intissar Salhi |
| collection | DOAJ |
| description | Robots are more and more present in our lives, particularly in the health sector. In therapeutic centers, some therapists are beginning to explore various tools like video games, Internet exchanges, and robot-assisted therapy. These tools will be at the disposal of these professionals as additional resources that can support them to assist their patients intuitively and remotely. The humanoid robot can capture young children’s attention and then attract the attention of researchers. It can be considered as a play partner and can directly interact with children or without a third party’s presence. It can equally perform repetitive tasks that humans cannot achieve in the same way. Moreover, humanoid robots can assist a therapist by allowing him to teleoperated and interact from a distance. In this context, our research focuses on robot-assisted therapy and introduces a humanoid social robot in a pediatric hospital care unit. That will be performed by analyzing many aspects of the child’s behavior, such as verbal interactions, gestures and facial expressions, etc. Consequently, the robot can reproduce consistent experiences and actions for children with communication capacity restrictions. This work is done by applying a novel approach based on deep learning and reinforcement learning algorithms supported by an ontological knowledge base that contains relevant information and knowledge about patients, screening tests, and therapies. In this study, we realized a humanoid robot that will assist a therapist by equipping the robot NAO: 1) to detect whether a child is autistic or not using a convolutional neural network, 2) to recommend a set of therapies based on a selection algorithm using a correspondence matrix between screening test and therapies, and 2) to assist and monitor autistic children by executing tasks that require those therapies. |
| first_indexed | 2024-04-13T06:06:15Z |
| format | Article |
| id | doaj.art-9d34073c67fd4cc8a6b659742feaef93 |
| institution | Directory Open Access Journal |
| issn | 2296-9144 |
| language | English |
| last_indexed | 2024-04-13T06:06:15Z |
| publishDate | 2022-04-01 |
| publisher | Frontiers Media S.A. |
| record_format | Article |
| series | Frontiers in Robotics and AI |
| spelling | doaj.art-9d34073c67fd4cc8a6b659742feaef932022-12-22T02:59:14ZengFrontiers Media S.A.Frontiers in Robotics and AI2296-91442022-04-01910.3389/frobt.2022.713964713964Towards Robot-Assisted Therapy for Children With Autism—The Ontological Knowledge Models and Reinforcement Learning-Based AlgorithmsIntissar Salhi0Mohammed Qbadou1Soukaina Gouraguine2Khalifa Mansouri3Chris Lytridis4Vassilis Kaburlasos5SSDIA, ENSET, Department of Mathematics & Computer Science, Hassan II University of Casablanca, Mohammedia, MoroccoSSDIA, ENSET, Department of Mathematics & Computer Science, Hassan II University of Casablanca, Mohammedia, MoroccoSSDIA, ENSET, Department of Mathematics & Computer Science, Hassan II University of Casablanca, Mohammedia, MoroccoSSDIA, ENSET, Department of Mathematics & Computer Science, Hassan II University of Casablanca, Mohammedia, MoroccoHUman-MAchines INteraction (HUMAIN) Lab, Department of Computer Science, International Hellenic University (IHU), Kavala, GreeceHUman-MAchines INteraction (HUMAIN) Lab, Department of Computer Science, International Hellenic University (IHU), Kavala, GreeceRobots are more and more present in our lives, particularly in the health sector. In therapeutic centers, some therapists are beginning to explore various tools like video games, Internet exchanges, and robot-assisted therapy. These tools will be at the disposal of these professionals as additional resources that can support them to assist their patients intuitively and remotely. The humanoid robot can capture young children’s attention and then attract the attention of researchers. It can be considered as a play partner and can directly interact with children or without a third party’s presence. It can equally perform repetitive tasks that humans cannot achieve in the same way. Moreover, humanoid robots can assist a therapist by allowing him to teleoperated and interact from a distance. In this context, our research focuses on robot-assisted therapy and introduces a humanoid social robot in a pediatric hospital care unit. That will be performed by analyzing many aspects of the child’s behavior, such as verbal interactions, gestures and facial expressions, etc. Consequently, the robot can reproduce consistent experiences and actions for children with communication capacity restrictions. This work is done by applying a novel approach based on deep learning and reinforcement learning algorithms supported by an ontological knowledge base that contains relevant information and knowledge about patients, screening tests, and therapies. In this study, we realized a humanoid robot that will assist a therapist by equipping the robot NAO: 1) to detect whether a child is autistic or not using a convolutional neural network, 2) to recommend a set of therapies based on a selection algorithm using a correspondence matrix between screening test and therapies, and 2) to assist and monitor autistic children by executing tasks that require those therapies.https://www.frontiersin.org/articles/10.3389/frobt.2022.713964/fullrobot-assisted therapyhumanoid social robotdeep learningreinforcement learningontological knowledge database |
| spellingShingle | Intissar Salhi Mohammed Qbadou Soukaina Gouraguine Khalifa Mansouri Chris Lytridis Vassilis Kaburlasos Towards Robot-Assisted Therapy for Children With Autism—The Ontological Knowledge Models and Reinforcement Learning-Based Algorithms Frontiers in Robotics and AI robot-assisted therapy humanoid social robot deep learning reinforcement learning ontological knowledge database |
| title | Towards Robot-Assisted Therapy for Children With Autism—The Ontological Knowledge Models and Reinforcement Learning-Based Algorithms |
| title_full | Towards Robot-Assisted Therapy for Children With Autism—The Ontological Knowledge Models and Reinforcement Learning-Based Algorithms |
| title_fullStr | Towards Robot-Assisted Therapy for Children With Autism—The Ontological Knowledge Models and Reinforcement Learning-Based Algorithms |
| title_full_unstemmed | Towards Robot-Assisted Therapy for Children With Autism—The Ontological Knowledge Models and Reinforcement Learning-Based Algorithms |
| title_short | Towards Robot-Assisted Therapy for Children With Autism—The Ontological Knowledge Models and Reinforcement Learning-Based Algorithms |
| title_sort | towards robot assisted therapy for children with autism the ontological knowledge models and reinforcement learning based algorithms |
| topic | robot-assisted therapy humanoid social robot deep learning reinforcement learning ontological knowledge database |
| url | https://www.frontiersin.org/articles/10.3389/frobt.2022.713964/full |
| work_keys_str_mv | AT intissarsalhi towardsrobotassistedtherapyforchildrenwithautismtheontologicalknowledgemodelsandreinforcementlearningbasedalgorithms AT mohammedqbadou towardsrobotassistedtherapyforchildrenwithautismtheontologicalknowledgemodelsandreinforcementlearningbasedalgorithms AT soukainagouraguine towardsrobotassistedtherapyforchildrenwithautismtheontologicalknowledgemodelsandreinforcementlearningbasedalgorithms AT khalifamansouri towardsrobotassistedtherapyforchildrenwithautismtheontologicalknowledgemodelsandreinforcementlearningbasedalgorithms AT chrislytridis towardsrobotassistedtherapyforchildrenwithautismtheontologicalknowledgemodelsandreinforcementlearningbasedalgorithms AT vassiliskaburlasos towardsrobotassistedtherapyforchildrenwithautismtheontologicalknowledgemodelsandreinforcementlearningbasedalgorithms |