Design and Development of Eye Tracking System for Children with Autism

Autism Spectrum Disorder (ASD) is a neurodevelopmental condition impacting communication and social interaction in children. Eye-tracking technology has emerged as a valuable tool to investigate visual attention patterns in children with ASD. This paper presents the design and development of an eye-...

Full description

Bibliographic Details
Main Authors: Slamet Saputro Joko, Kirana Anggarani Fadjri, Yusuf Munawir, Basu Dewa Refansyah, Aston Susetyo Ricky, Yusuf Hayyan
Format: Article
Language:English
Published: EDP Sciences 2023-01-01
Series:E3S Web of Conferences
Online Access:https://www.e3s-conferences.org/articles/e3sconf/pdf/2023/102/e3sconf_icimece2023_02060.pdf
_version_ 1797344998173179904
author Slamet Saputro Joko
Kirana Anggarani Fadjri
Yusuf Munawir
Basu Dewa Refansyah
Aston Susetyo Ricky
Yusuf Hayyan
author_facet Slamet Saputro Joko
Kirana Anggarani Fadjri
Yusuf Munawir
Basu Dewa Refansyah
Aston Susetyo Ricky
Yusuf Hayyan
author_sort Slamet Saputro Joko
collection DOAJ
description Autism Spectrum Disorder (ASD) is a neurodevelopmental condition impacting communication and social interaction in children. Eye-tracking technology has emerged as a valuable tool to investigate visual attention patterns in children with ASD. This paper presents the design and development of an eye-tracking system for children with ASD, employing a Raspberry Pi 4, Noir camera, gaze tracker, and LED display to create an immersive virtual reality (VR) environment for precise visual attention measurement. The hardware implementation involves integrating the Raspberry Pi circuitry and AMOLED screen into a VR box, with the Noir camera capturing eye images. A meticulous calibration process maps pupil coordinates to screen coordinates accurately. The system's software, employing OpenCV for image processing and Firebase for data storage, is rigorously tested on adults to ensure reliable gaze tracking prior to assessing children with autism. Successful tracking of gaze coordinates during stimulus display indicates its potential for accurate data collection. However, minor reading errors from the sensor slightly hinder accuracy, suggesting improvements via camera sensor and microcontroller upgrades. The eye-tracking system offers a promising avenue for early and accurate ASD diagnosis, offering critical insights into visual attention patterns, and facilitating effective interventions to enhance social and communication skills in children with ASD.
first_indexed 2024-03-08T11:11:05Z
format Article
id doaj.art-130a00d2248e4a3d8c0713a6ad163de5
institution Directory Open Access Journal
issn 2267-1242
language English
last_indexed 2024-03-08T11:11:05Z
publishDate 2023-01-01
publisher EDP Sciences
record_format Article
series E3S Web of Conferences
spelling doaj.art-130a00d2248e4a3d8c0713a6ad163de52024-01-26T10:42:39ZengEDP SciencesE3S Web of Conferences2267-12422023-01-014650206010.1051/e3sconf/202346502060e3sconf_icimece2023_02060Design and Development of Eye Tracking System for Children with AutismSlamet Saputro Joko0Kirana Anggarani Fadjri1Yusuf Munawir2Basu Dewa Refansyah3Aston Susetyo Ricky4Yusuf Hayyan5Electrical Engineering Department Universitas Sebelas Maret SurakartaPsycology Department Universitas Sebelas Maret SurakartaSpecials Education Department Universitas Sebelas Maret SurakartaElectrical Engineering Department Universitas Sebelas Maret SurakartaElectrical Engineering Department Universitas Sebelas Maret SurakartaElectrical Engineering Department Universitas Sebelas Maret SurakartaAutism Spectrum Disorder (ASD) is a neurodevelopmental condition impacting communication and social interaction in children. Eye-tracking technology has emerged as a valuable tool to investigate visual attention patterns in children with ASD. This paper presents the design and development of an eye-tracking system for children with ASD, employing a Raspberry Pi 4, Noir camera, gaze tracker, and LED display to create an immersive virtual reality (VR) environment for precise visual attention measurement. The hardware implementation involves integrating the Raspberry Pi circuitry and AMOLED screen into a VR box, with the Noir camera capturing eye images. A meticulous calibration process maps pupil coordinates to screen coordinates accurately. The system's software, employing OpenCV for image processing and Firebase for data storage, is rigorously tested on adults to ensure reliable gaze tracking prior to assessing children with autism. Successful tracking of gaze coordinates during stimulus display indicates its potential for accurate data collection. However, minor reading errors from the sensor slightly hinder accuracy, suggesting improvements via camera sensor and microcontroller upgrades. The eye-tracking system offers a promising avenue for early and accurate ASD diagnosis, offering critical insights into visual attention patterns, and facilitating effective interventions to enhance social and communication skills in children with ASD.https://www.e3s-conferences.org/articles/e3sconf/pdf/2023/102/e3sconf_icimece2023_02060.pdf
spellingShingle Slamet Saputro Joko
Kirana Anggarani Fadjri
Yusuf Munawir
Basu Dewa Refansyah
Aston Susetyo Ricky
Yusuf Hayyan
Design and Development of Eye Tracking System for Children with Autism
E3S Web of Conferences
title Design and Development of Eye Tracking System for Children with Autism
title_full Design and Development of Eye Tracking System for Children with Autism
title_fullStr Design and Development of Eye Tracking System for Children with Autism
title_full_unstemmed Design and Development of Eye Tracking System for Children with Autism
title_short Design and Development of Eye Tracking System for Children with Autism
title_sort design and development of eye tracking system for children with autism
url https://www.e3s-conferences.org/articles/e3sconf/pdf/2023/102/e3sconf_icimece2023_02060.pdf
work_keys_str_mv AT slametsaputrojoko designanddevelopmentofeyetrackingsystemforchildrenwithautism
AT kiranaanggaranifadjri designanddevelopmentofeyetrackingsystemforchildrenwithautism
AT yusufmunawir designanddevelopmentofeyetrackingsystemforchildrenwithautism
AT basudewarefansyah designanddevelopmentofeyetrackingsystemforchildrenwithautism
AT astonsusetyoricky designanddevelopmentofeyetrackingsystemforchildrenwithautism
AT yusufhayyan designanddevelopmentofeyetrackingsystemforchildrenwithautism