Drawing Interpretation Using Neural Networks and Accessibility Implementation in Mobile Application

This paper continues the research of the previous work, regarding PandaSays mobile application, having its main purpose to detect the affective state of the child from his drawings, using MobileNet neural network. Children diagnosed with autism spectrum disorder, have difficulties in expressing thei...

Full description

Bibliographic Details
Main Authors: Aura-Loredana Popescu, Nirvana Popescu
Format: Article
Language:English
Published: MDPI AG 2022-11-01
Series:Computation
Subjects:
Online Access:https://www.mdpi.com/2079-3197/10/11/202
_version_ 1797465616021454848
author Aura-Loredana Popescu
Nirvana Popescu
author_facet Aura-Loredana Popescu
Nirvana Popescu
author_sort Aura-Loredana Popescu
collection DOAJ
description This paper continues the research of the previous work, regarding PandaSays mobile application, having its main purpose to detect the affective state of the child from his drawings, using MobileNet neural network. Children diagnosed with autism spectrum disorder, have difficulties in expressing their feelings and communicating with others. The purpose of PandaSays mobile application, is to help parents and tutors that have children diagnosed with autism, to communicate better with them and to understand their feelings. The main goal was to improve the model’s accuracy, trained with MobileNet neural network, which reached the value of 84.583%. For training the model, it was used Python programming language. The study focuses further on accessibility and its importance to children diagnosed with autism. Relevant screenshots of the mobile application are presented, in order to indicate that the application follows the accessibility guidelines and rules. Finally, there is presented the interaction with Marty robot and the efficiency of mobile application’s drawing prediction.
first_indexed 2024-03-09T18:24:25Z
format Article
id doaj.art-5e8cb6c5fb5449aaab1bc4d3110945e3
institution Directory Open Access Journal
issn 2079-3197
language English
last_indexed 2024-03-09T18:24:25Z
publishDate 2022-11-01
publisher MDPI AG
record_format Article
series Computation
spelling doaj.art-5e8cb6c5fb5449aaab1bc4d3110945e32023-11-24T08:01:36ZengMDPI AGComputation2079-31972022-11-01101120210.3390/computation10110202Drawing Interpretation Using Neural Networks and Accessibility Implementation in Mobile ApplicationAura-Loredana Popescu0Nirvana Popescu1Computer Science Department, University Politehnica of Bucharest, 060042 Bucharest, RomaniaComputer Science Department, University Politehnica of Bucharest, 060042 Bucharest, RomaniaThis paper continues the research of the previous work, regarding PandaSays mobile application, having its main purpose to detect the affective state of the child from his drawings, using MobileNet neural network. Children diagnosed with autism spectrum disorder, have difficulties in expressing their feelings and communicating with others. The purpose of PandaSays mobile application, is to help parents and tutors that have children diagnosed with autism, to communicate better with them and to understand their feelings. The main goal was to improve the model’s accuracy, trained with MobileNet neural network, which reached the value of 84.583%. For training the model, it was used Python programming language. The study focuses further on accessibility and its importance to children diagnosed with autism. Relevant screenshots of the mobile application are presented, in order to indicate that the application follows the accessibility guidelines and rules. Finally, there is presented the interaction with Marty robot and the efficiency of mobile application’s drawing prediction.https://www.mdpi.com/2079-3197/10/11/202machine learningneural networksautismhumanoid robotsmobile applicationdrawing interpretation
spellingShingle Aura-Loredana Popescu
Nirvana Popescu
Drawing Interpretation Using Neural Networks and Accessibility Implementation in Mobile Application
Computation
machine learning
neural networks
autism
humanoid robots
mobile application
drawing interpretation
title Drawing Interpretation Using Neural Networks and Accessibility Implementation in Mobile Application
title_full Drawing Interpretation Using Neural Networks and Accessibility Implementation in Mobile Application
title_fullStr Drawing Interpretation Using Neural Networks and Accessibility Implementation in Mobile Application
title_full_unstemmed Drawing Interpretation Using Neural Networks and Accessibility Implementation in Mobile Application
title_short Drawing Interpretation Using Neural Networks and Accessibility Implementation in Mobile Application
title_sort drawing interpretation using neural networks and accessibility implementation in mobile application
topic machine learning
neural networks
autism
humanoid robots
mobile application
drawing interpretation
url https://www.mdpi.com/2079-3197/10/11/202
work_keys_str_mv AT auraloredanapopescu drawinginterpretationusingneuralnetworksandaccessibilityimplementationinmobileapplication
AT nirvanapopescu drawinginterpretationusingneuralnetworksandaccessibilityimplementationinmobileapplication