An experimental study on a conversational agent in software testing lessons

Nowadays, few professionals understand the techniques and testing criteria to systematize the software testing activity in the software industry. Towards shedding some light on such problems and promoting software testing, professors in the area have established Massive Open Online Courses as educat...

Full description

Bibliographic Details
Main Authors: Leo Natan PASCHOAL, Silvana Morita MELO, Vânia de Oliveira NEVES, Tayana Uchôa CONTE, Simone do Rocio Senger de SOUZA
Format: Article
Language:English
Published: Vilnius University 2023-03-01
Series:Informatics in Education
Subjects:
Online Access:https://infedu.vu.lt/doi/10.15388/infedu.2023.01
_version_ 1797870124399591424
author Leo Natan PASCHOAL
Silvana Morita MELO
Vânia de Oliveira NEVES
Tayana Uchôa CONTE
Simone do Rocio Senger de SOUZA
author_facet Leo Natan PASCHOAL
Silvana Morita MELO
Vânia de Oliveira NEVES
Tayana Uchôa CONTE
Simone do Rocio Senger de SOUZA
author_sort Leo Natan PASCHOAL
collection DOAJ
description Nowadays, few professionals understand the techniques and testing criteria to systematize the software testing activity in the software industry. Towards shedding some light on such problems and promoting software testing, professors in the area have established Massive Open Online Courses as educational initiatives. However, the main limitation is the professor’s lack of supervision of students. A conversation agent called TOB-STT has been defined in trying to avoid the problem. A previous study introduced TOB-STT; however, it did not analyze its efficacy. This article addresses a controlled experiment that analyzed its efficacy and revealed it was not expressive in its current version. Therefore, we conducted an in-depth analysis to find what caused this result and provided a detailed discussion. The findings contribute to the TOB-STT since the experimental results show that improvements need to be made in the conversational agent before we use it in Massive Open Online Courses.
first_indexed 2024-04-10T00:23:28Z
format Article
id doaj.art-aad95168d9874219a8fdaef3187853a6
institution Directory Open Access Journal
issn 1648-5831
2335-8971
language English
last_indexed 2024-04-10T00:23:28Z
publishDate 2023-03-01
publisher Vilnius University
record_format Article
series Informatics in Education
spelling doaj.art-aad95168d9874219a8fdaef3187853a62023-03-15T14:32:26ZengVilnius UniversityInformatics in Education1648-58312335-89712023-03-012219912010.15388/infedu.2023.01An experimental study on a conversational agent in software testing lessonsLeo Natan PASCHOAL0Silvana Morita MELO1Vânia de Oliveira NEVES2Tayana Uchôa CONTE3Simone do Rocio Senger de SOUZA4Universiy of Sao Paulo - São Carlos, BrazilFederal University of Grande Dourados - Dourados, BrazilFluminense Federal University - Niterói, BrazilFederal University of Amazonas - Manaus, BrazilUniversiy of Sao Paulo - São Carlos, BrazilNowadays, few professionals understand the techniques and testing criteria to systematize the software testing activity in the software industry. Towards shedding some light on such problems and promoting software testing, professors in the area have established Massive Open Online Courses as educational initiatives. However, the main limitation is the professor’s lack of supervision of students. A conversation agent called TOB-STT has been defined in trying to avoid the problem. A previous study introduced TOB-STT; however, it did not analyze its efficacy. This article addresses a controlled experiment that analyzed its efficacy and revealed it was not expressive in its current version. Therefore, we conducted an in-depth analysis to find what caused this result and provided a detailed discussion. The findings contribute to the TOB-STT since the experimental results show that improvements need to be made in the conversational agent before we use it in Massive Open Online Courses.https://infedu.vu.lt/doi/10.15388/infedu.2023.01chatbotcomputer science educationsoftware testing
spellingShingle Leo Natan PASCHOAL
Silvana Morita MELO
Vânia de Oliveira NEVES
Tayana Uchôa CONTE
Simone do Rocio Senger de SOUZA
An experimental study on a conversational agent in software testing lessons
Informatics in Education
chatbot
computer science education
software testing
title An experimental study on a conversational agent in software testing lessons
title_full An experimental study on a conversational agent in software testing lessons
title_fullStr An experimental study on a conversational agent in software testing lessons
title_full_unstemmed An experimental study on a conversational agent in software testing lessons
title_short An experimental study on a conversational agent in software testing lessons
title_sort experimental study on a conversational agent in software testing lessons
topic chatbot
computer science education
software testing
url https://infedu.vu.lt/doi/10.15388/infedu.2023.01
work_keys_str_mv AT leonatanpaschoal anexperimentalstudyonaconversationalagentinsoftwaretestinglessons
AT silvanamoritamelo anexperimentalstudyonaconversationalagentinsoftwaretestinglessons
AT vaniadeoliveiraneves anexperimentalstudyonaconversationalagentinsoftwaretestinglessons
AT tayanauchoaconte anexperimentalstudyonaconversationalagentinsoftwaretestinglessons
AT simonedorociosengerdesouza anexperimentalstudyonaconversationalagentinsoftwaretestinglessons
AT leonatanpaschoal experimentalstudyonaconversationalagentinsoftwaretestinglessons
AT silvanamoritamelo experimentalstudyonaconversationalagentinsoftwaretestinglessons
AT vaniadeoliveiraneves experimentalstudyonaconversationalagentinsoftwaretestinglessons
AT tayanauchoaconte experimentalstudyonaconversationalagentinsoftwaretestinglessons
AT simonedorociosengerdesouza experimentalstudyonaconversationalagentinsoftwaretestinglessons