Augmenting assessment with AI coding of online student discourse: A question of reliability

Augmenting assessment with AI coding of online student discourse: A question of reliability

Currently, many generative Artificial Intelligence (AI) tools are being integrated into the educational technology landscape for instructors. Our paper examines the potential and challenges of using Large Language Models (LLMs) to code student-generated content in online discussions based on intende...

Full description

Bibliographic Details
Main Authors:	Kamila Misiejuk, Rogers Kaliisa, Jennifer Scianna
Format:	Article
Language:	English
Published:	Elsevier 2024-06-01
Series:	Computers and Education: Artificial Intelligence
Subjects:	Artificial intelligence Data coding ChatGPT Large language models Learning analytics AI-driven assessment
Online Access:	http://www.sciencedirect.com/science/article/pii/S2666920X24000171

Similar Items

AI unveiled: a comparative analysis of code accuracy and reliability across various chatbot platforms
by: Choy, Ji En
Published: (2024)

AI meets comedy: Viewers' reactions to GPT-4 generated humor translation
by: Hussein Abu-Rayyash
Published: (2024-06-01)

Breaking Boundaries with Generative AI: Good Practice of Unleashing the Power of ChatGPT for Inter- and Transdisciplinary Breakthroughs in the Age of Complexity
by: Beata Jones
Published: (2023-06-01)

Dawn of the dialogue: AI's leap from lab to living room
by: Tyler Thomas Procko, et al.
Published: (2024-03-01)

ChatGPT and the rise of generative AI: Threat to academic integrity?
by: Damian Okaibedi Eke
Published: (2023-04-01)

Revolutionizing Education: The Transformative Power of AI Technologies in PR
by: Manuela Toteva
Published: (2023-12-01)

El ChatGPT y las reflexiones de un investigador escéptico
by: Carlos Alberto Agudelo A.
Published: (2022-07-01)

Editorial
by: Editorial team of Babylonia
Published: (2023-09-01)

ChatGPT, can you create a didactic scenario for language teaching in a museum?
Published: (2023-08-01)

Assistant, Parrot, or Colonizing Loudspeaker? ChatGPT Metaphors for Developing Critical AI Literacies
by: Anuj Gupta, et al.
Published: (2024-02-01)

A Survey on ChatGPT: AI–Generated Contents, Challenges, and Solutions
by: Yuntao Wang, et al.
Published: (2023-01-01)

Integrating generative AI in knowledge building
by: Bodong Chen, et al.
Published: (2023-01-01)

The influence of the COVID-19 pandemic on the adoption and impact of AI ChatGPT: Challenges, applications, and ethical considerations
by: Talib Hussain, et al.
Published: (2024-06-01)

The TrollLabs open hackathon dataset: Generative AI and large language models for prototyping in engineering design
by: Daniel Nygård Ege, et al.
Published: (2024-06-01)

Generative AI for Transformative Healthcare: A Comprehensive Study of Emerging Models, Applications, Case Studies, and Limitations
by: Siva Sai, et al.
Published: (2024-01-01)

AI and its consequences for the written word
by: Thomas Hellström
Published: (2024-01-01)

Generative AI in Medicine and Healthcare: Promises, Opportunities and Challenges
by: Peng Zhang, et al.
Published: (2023-08-01)

How are AI assistants changing higher education?
by: Eva-Maria Schön, et al.
Published: (2023-07-01)

Brainstorming Will Never Be the Same Again—A Human Group Supported by Artificial Intelligence
by: Franc Lavrič, et al.
Published: (2023-09-01)

ChatGPT’s Accuracy on Magnetic Resonance Imaging Basics: Characteristics and Limitations Depending on the Question Type
by: Kyu-Hong Lee, et al.
Published: (2024-01-01)

Enhancing infectious disease response: A demonstrative dialogue with ChatGPT and ChatGPT-4 for future outbreak preparedness
by: Jaffar A. Al-Tawfiq, et al.
Published: (2023-06-01)

Adoption and impacts of generative artificial intelligence: Theoretical underpinnings and research agenda
by: Ruchi Gupta, et al.
Published: (2024-04-01)

What will ChatGPT revolutionize in the financial industry?
by: Hassnian Ali, et al.
Published: (2023-11-01)

From Joseph Weizenbaum to ChatGPT
by: Christiane Floyd
Published: (2023-10-01)

Public perception of generative AI on Twitter: an empirical study based on occupation and usage
by: Kunihiro Miyazaki, et al.
Published: (2024-01-01)

ChatGPT and Open-AI Models: A Preliminary Review
by: Konstantinos I. Roumeliotis, et al.
Published: (2023-05-01)

GPT models in construction industry: Opportunities, limitations, and a use case validation
by: Abdullahi Saka, et al.
Published: (2024-03-01)

Students’ Experiences of Using ChatGPT in an Undergraduate Programming Course
by: Philipp Haindl, et al.
Published: (2024-01-01)

Overview of Chatbots with special emphasis on artificial intelligence-enabled ChatGPT in medical science
by: Chiranjib Chakraborty, et al.
Published: (2023-10-01)

What ChatGPT Tells Us about Gender: A Cautionary Tale about Performativity and Gender Biases in AI
by: Nicole Gross
Published: (2023-08-01)

The Power of Generative AI: A Review of Requirements, Models, Input–Output Formats, Evaluation Metrics, and Challenges
by: Ajay Bandi, et al.
Published: (2023-07-01)

Do teachers spot AI? Evaluating the detectability of AI-generated texts among student essays
by: Johanna Fleckenstein, et al.
Published: (2024-06-01)

The AI generation gap: Are Gen Z students more interested in adopting generative AI such as ChatGPT in teaching and learning than their Gen X and millennial generation teachers?
by: Cecilia Ka Yuk Chan, et al.
Published: (2023-11-01)

AI-based online chat and the future of oncology care: a promising technology or a solution in search of a problem?
by: Joseph Kassab, et al.
Published: (2023-05-01)

Students’ voices on generative AI: perceptions, benefits, and challenges in higher education
by: Cecilia Ka Yuk Chan, et al.
Published: (2023-07-01)

“Chatting with ChatGPT”: Analyzing the factors influencing users' intention to Use the Open AI's ChatGPT using the UTAUT model
by: Devadas Menon, et al.
Published: (2023-11-01)

Programming with ChatGPT: How far can we go?
by: Alessio Bucaioni, et al.
Published: (2024-03-01)

Large Language Models: Their Success and Impact
by: Spyros Makridakis, et al.
Published: (2023-08-01)

Do we still need teachers? Navigating the paradigm shift of the teacher's role in the AI era
by: Manuel Gentile, et al.
Published: (2023-03-01)

Building a web based AI-powered job applicator
by: Yap, Regine Hui Xin
Published: (2024)