The effect of generative artificial intelligence (AI)-based tool use on students' computational thinking skills, programming self-efficacy and motivation

ChatGPT (generative pre-trained transformer) is one of the artificial intelligence (AI) technologies that have started to be used in programming education. However, the effect of using ChatGPT in programming education on learning processes and outcomes is not yet known. This study investigated the e...

Full description

Bibliographic Details
Main Authors: Ramazan Yilmaz, Fatma Gizem Karaoglan Yilmaz
Format: Article
Language:English
Published: Elsevier 2023-01-01
Series:Computers and Education: Artificial Intelligence
Subjects:
Online Access:http://www.sciencedirect.com/science/article/pii/S2666920X23000267
_version_ 1797799910769164288
author Ramazan Yilmaz
Fatma Gizem Karaoglan Yilmaz
author_facet Ramazan Yilmaz
Fatma Gizem Karaoglan Yilmaz
author_sort Ramazan Yilmaz
collection DOAJ
description ChatGPT (generative pre-trained transformer) is one of the artificial intelligence (AI) technologies that have started to be used in programming education. However, the effect of using ChatGPT in programming education on learning processes and outcomes is not yet known. This study investigated the effect of programming education using the ChatGPT on students' computational thinking skills, programming self-efficacy, and motivation toward the lesson. The research was conducted on 45 undergraduate students who took a university-level programming course. The research was carried out according to the experimental design with the pretest-posttest control group. Students were randomly divided into experimental (n = 21) and control (n = 24) groups. While the experimental group students benefited from the ChatGPT during the weekly programming practices, the control group students did not use this tool. Research data were obtained through the computational thinking scale, computer programming self-efficacy scale, and learning motivation in computer programming courses scale. Research findings revealed that the experimental group students' computational thinking skills, programming self-efficacy, and motivation for the lesson were significantly higher than the control group students. In line with this result, it can be said that it may be useful to benefit from AI technologies such as ChatGPT in programming trainings. The research findings, it was emphasized how the most effective use of AI support in the lessons could be made, and various suggestions were made for researchers and educators in this regard.
first_indexed 2024-03-13T04:27:05Z
format Article
id doaj.art-95e6973cbb53430cb6b704b7af6c3470
institution Directory Open Access Journal
issn 2666-920X
language English
last_indexed 2024-03-13T04:27:05Z
publishDate 2023-01-01
publisher Elsevier
record_format Article
series Computers and Education: Artificial Intelligence
spelling doaj.art-95e6973cbb53430cb6b704b7af6c34702023-06-20T04:21:19ZengElsevierComputers and Education: Artificial Intelligence2666-920X2023-01-014100147The effect of generative artificial intelligence (AI)-based tool use on students' computational thinking skills, programming self-efficacy and motivationRamazan Yilmaz0Fatma Gizem Karaoglan Yilmaz1Corresponding author.; Faculty of Science, Department of Computer Technology & Information Systems, Bartin University, Bartin, TurkeyFaculty of Science, Department of Computer Technology & Information Systems, Bartin University, Bartin, TurkeyChatGPT (generative pre-trained transformer) is one of the artificial intelligence (AI) technologies that have started to be used in programming education. However, the effect of using ChatGPT in programming education on learning processes and outcomes is not yet known. This study investigated the effect of programming education using the ChatGPT on students' computational thinking skills, programming self-efficacy, and motivation toward the lesson. The research was conducted on 45 undergraduate students who took a university-level programming course. The research was carried out according to the experimental design with the pretest-posttest control group. Students were randomly divided into experimental (n = 21) and control (n = 24) groups. While the experimental group students benefited from the ChatGPT during the weekly programming practices, the control group students did not use this tool. Research data were obtained through the computational thinking scale, computer programming self-efficacy scale, and learning motivation in computer programming courses scale. Research findings revealed that the experimental group students' computational thinking skills, programming self-efficacy, and motivation for the lesson were significantly higher than the control group students. In line with this result, it can be said that it may be useful to benefit from AI technologies such as ChatGPT in programming trainings. The research findings, it was emphasized how the most effective use of AI support in the lessons could be made, and various suggestions were made for researchers and educators in this regard.http://www.sciencedirect.com/science/article/pii/S2666920X23000267Artificial intelligenceChatGPTGenerative pretrained transformerProgramming educationComputational thinking
spellingShingle Ramazan Yilmaz
Fatma Gizem Karaoglan Yilmaz
The effect of generative artificial intelligence (AI)-based tool use on students' computational thinking skills, programming self-efficacy and motivation
Computers and Education: Artificial Intelligence
Artificial intelligence
ChatGPT
Generative pretrained transformer
Programming education
Computational thinking
title The effect of generative artificial intelligence (AI)-based tool use on students' computational thinking skills, programming self-efficacy and motivation
title_full The effect of generative artificial intelligence (AI)-based tool use on students' computational thinking skills, programming self-efficacy and motivation
title_fullStr The effect of generative artificial intelligence (AI)-based tool use on students' computational thinking skills, programming self-efficacy and motivation
title_full_unstemmed The effect of generative artificial intelligence (AI)-based tool use on students' computational thinking skills, programming self-efficacy and motivation
title_short The effect of generative artificial intelligence (AI)-based tool use on students' computational thinking skills, programming self-efficacy and motivation
title_sort effect of generative artificial intelligence ai based tool use on students computational thinking skills programming self efficacy and motivation
topic Artificial intelligence
ChatGPT
Generative pretrained transformer
Programming education
Computational thinking
url http://www.sciencedirect.com/science/article/pii/S2666920X23000267
work_keys_str_mv AT ramazanyilmaz theeffectofgenerativeartificialintelligenceaibasedtooluseonstudentscomputationalthinkingskillsprogrammingselfefficacyandmotivation
AT fatmagizemkaraoglanyilmaz theeffectofgenerativeartificialintelligenceaibasedtooluseonstudentscomputationalthinkingskillsprogrammingselfefficacyandmotivation
AT ramazanyilmaz effectofgenerativeartificialintelligenceaibasedtooluseonstudentscomputationalthinkingskillsprogrammingselfefficacyandmotivation
AT fatmagizemkaraoglanyilmaz effectofgenerativeartificialintelligenceaibasedtooluseonstudentscomputationalthinkingskillsprogrammingselfefficacyandmotivation