Immersive multi-modal pedagogical conversational artificial intelligence for early childhood education: An exploratory case study in the wild

Educational technology research has found that parents of young children widely share concerns about extended screen time, lack of physical activity, and lack of social interaction. Kid Space was developed to address these concerns by enabling multi-modal and immersive collaborative play-based learn...

Full description

Bibliographic Details
Main Authors: Sinem Aslan, Lenitra M. Durham, Nese Alyuz, Eda Okur, Sangita Sharma, Celal Savur, Lama Nachman
Format: Article
Language:English
Published: Elsevier 2024-06-01
Series:Computers and Education: Artificial Intelligence
Subjects:
Online Access:http://www.sciencedirect.com/science/article/pii/S2666920X24000213
_version_ 1827221647130624000
author Sinem Aslan
Lenitra M. Durham
Nese Alyuz
Eda Okur
Sangita Sharma
Celal Savur
Lama Nachman
author_facet Sinem Aslan
Lenitra M. Durham
Nese Alyuz
Eda Okur
Sangita Sharma
Celal Savur
Lama Nachman
author_sort Sinem Aslan
collection DOAJ
description Educational technology research has found that parents of young children widely share concerns about extended screen time, lack of physical activity, and lack of social interaction. Kid Space was developed to address these concerns by enabling multi-modal and immersive collaborative play-based learning. Kid Space utilizes multiple sensing technologies with an immersive physical space through a human-scale wall projection and incorporates a conversational AI agent to interact with children, understand individual progress, and personalize learning experiences in a blended physical and digital environment. To evaluate Kid Space in the wild, we conducted a multi-method user study involving a quasi-experimental design and exploratory case study with 14 students and three educators in an elementary school. Mixed methods for data collection and analysis were used to understand the students' and educators' perceptions of Kid Space and its impact on the students’ educational outcomes (learning engagement, experience, and performance). The findings showed (1) positive perceptions toward Kid Space, (2) high levels of engagement - with decreased screen time (41% of the time), increased physical activity (99.3% of the time), and increased social interactions with conversational AI agent and the other collaborating student (52% of the time), and (3) significant learning gains after experiencing Kid Space (24% gain, paired t-test: p < 0.01). These positive results are accompanied by critical user insights for improving future iterations of Kid Space to validate long-term educational outcomes.
first_indexed 2024-04-24T08:11:26Z
format Article
id doaj.art-423bf53ed0ba41f7b97d23b542a902e5
institution Directory Open Access Journal
issn 2666-920X
language English
last_indexed 2025-03-21T16:25:55Z
publishDate 2024-06-01
publisher Elsevier
record_format Article
series Computers and Education: Artificial Intelligence
spelling doaj.art-423bf53ed0ba41f7b97d23b542a902e52024-06-17T05:59:19ZengElsevierComputers and Education: Artificial Intelligence2666-920X2024-06-016100220Immersive multi-modal pedagogical conversational artificial intelligence for early childhood education: An exploratory case study in the wildSinem Aslan0Lenitra M. Durham1Nese Alyuz2Eda Okur3Sangita Sharma4Celal Savur5Lama Nachman6Corresponding author.; Intel Labs, USAIntel Labs, USAIntel Labs, USAIntel Labs, USAIntel Labs, USAIntel Labs, USAIntel Labs, USAEducational technology research has found that parents of young children widely share concerns about extended screen time, lack of physical activity, and lack of social interaction. Kid Space was developed to address these concerns by enabling multi-modal and immersive collaborative play-based learning. Kid Space utilizes multiple sensing technologies with an immersive physical space through a human-scale wall projection and incorporates a conversational AI agent to interact with children, understand individual progress, and personalize learning experiences in a blended physical and digital environment. To evaluate Kid Space in the wild, we conducted a multi-method user study involving a quasi-experimental design and exploratory case study with 14 students and three educators in an elementary school. Mixed methods for data collection and analysis were used to understand the students' and educators' perceptions of Kid Space and its impact on the students’ educational outcomes (learning engagement, experience, and performance). The findings showed (1) positive perceptions toward Kid Space, (2) high levels of engagement - with decreased screen time (41% of the time), increased physical activity (99.3% of the time), and increased social interactions with conversational AI agent and the other collaborating student (52% of the time), and (3) significant learning gains after experiencing Kid Space (24% gain, paired t-test: p < 0.01). These positive results are accompanied by critical user insights for improving future iterations of Kid Space to validate long-term educational outcomes.http://www.sciencedirect.com/science/article/pii/S2666920X24000213Game-based learningOnline learningIntelligent tutoring systemsMulti-modal conversational artificial intelligenceHuman-AI collaboration
spellingShingle Sinem Aslan
Lenitra M. Durham
Nese Alyuz
Eda Okur
Sangita Sharma
Celal Savur
Lama Nachman
Immersive multi-modal pedagogical conversational artificial intelligence for early childhood education: An exploratory case study in the wild
Computers and Education: Artificial Intelligence
Game-based learning
Online learning
Intelligent tutoring systems
Multi-modal conversational artificial intelligence
Human-AI collaboration
title Immersive multi-modal pedagogical conversational artificial intelligence for early childhood education: An exploratory case study in the wild
title_full Immersive multi-modal pedagogical conversational artificial intelligence for early childhood education: An exploratory case study in the wild
title_fullStr Immersive multi-modal pedagogical conversational artificial intelligence for early childhood education: An exploratory case study in the wild
title_full_unstemmed Immersive multi-modal pedagogical conversational artificial intelligence for early childhood education: An exploratory case study in the wild
title_short Immersive multi-modal pedagogical conversational artificial intelligence for early childhood education: An exploratory case study in the wild
title_sort immersive multi modal pedagogical conversational artificial intelligence for early childhood education an exploratory case study in the wild
topic Game-based learning
Online learning
Intelligent tutoring systems
Multi-modal conversational artificial intelligence
Human-AI collaboration
url http://www.sciencedirect.com/science/article/pii/S2666920X24000213
work_keys_str_mv AT sinemaslan immersivemultimodalpedagogicalconversationalartificialintelligenceforearlychildhoodeducationanexploratorycasestudyinthewild
AT lenitramdurham immersivemultimodalpedagogicalconversationalartificialintelligenceforearlychildhoodeducationanexploratorycasestudyinthewild
AT nesealyuz immersivemultimodalpedagogicalconversationalartificialintelligenceforearlychildhoodeducationanexploratorycasestudyinthewild
AT edaokur immersivemultimodalpedagogicalconversationalartificialintelligenceforearlychildhoodeducationanexploratorycasestudyinthewild
AT sangitasharma immersivemultimodalpedagogicalconversationalartificialintelligenceforearlychildhoodeducationanexploratorycasestudyinthewild
AT celalsavur immersivemultimodalpedagogicalconversationalartificialintelligenceforearlychildhoodeducationanexploratorycasestudyinthewild
AT lamanachman immersivemultimodalpedagogicalconversationalartificialintelligenceforearlychildhoodeducationanexploratorycasestudyinthewild