An application of Bayesian inference to examine student retention and attrition in the STEM classroom

IntroductionAs artificial intelligence (AI) technology becomes more widespread in the classroom environment, educators have relied on data-driven machine learning (ML) techniques and statistical frameworks to derive insights into student performance patterns. Bayesian methodologies have emerged as a...

Full description

Bibliographic Details
Main Authors: Roberto Bertolini, Stephen J. Finch, Ross H. Nehm
Format: Article
Language:English
Published: Frontiers Media S.A. 2023-02-01
Series:Frontiers in Education
Subjects:
Online Access:https://www.frontiersin.org/articles/10.3389/feduc.2023.1073829/full
_version_ 1811164263263240192
author Roberto Bertolini
Stephen J. Finch
Ross H. Nehm
author_facet Roberto Bertolini
Stephen J. Finch
Ross H. Nehm
author_sort Roberto Bertolini
collection DOAJ
description IntroductionAs artificial intelligence (AI) technology becomes more widespread in the classroom environment, educators have relied on data-driven machine learning (ML) techniques and statistical frameworks to derive insights into student performance patterns. Bayesian methodologies have emerged as a more intuitive approach to frequentist methods of inference since they link prior assumptions and data together to provide a quantitative distribution of final model parameter estimates. Despite their alignment with four recent ML assessment criteria developed in the educational literature, Bayesian methodologies have received considerably less attention by academic stakeholders prompting the need to empirically discern how these techniques can be used to provide actionable insights into student performance.MethodsTo identify the factors most indicative of student retention and attrition, we apply a Bayesian framework to comparatively examine the differential impact that the amalgamation of traditional and AI-driven predictors has on student performance in an undergraduate in-person science, technology, engineering, and mathematics (STEM) course.ResultsInteraction with the course learning management system (LMS) and performance on diagnostic concept inventory (CI) assessments provided the greatest insights into final course performance. Establishing informative prior values using historical classroom data did not always appreciably enhance model fit.DiscussionWe discuss how Bayesian methodologies are a more pragmatic and interpretable way of assessing student performance and are a promising tool for use in science education research and assessment.
first_indexed 2024-04-10T15:18:41Z
format Article
id doaj.art-c104d692d872432a821e6a8e194de180
institution Directory Open Access Journal
issn 2504-284X
language English
last_indexed 2024-04-10T15:18:41Z
publishDate 2023-02-01
publisher Frontiers Media S.A.
record_format Article
series Frontiers in Education
spelling doaj.art-c104d692d872432a821e6a8e194de1802023-02-14T17:45:18ZengFrontiers Media S.A.Frontiers in Education2504-284X2023-02-01810.3389/feduc.2023.10738291073829An application of Bayesian inference to examine student retention and attrition in the STEM classroomRoberto Bertolini0Stephen J. Finch1Ross H. Nehm2Department of Applied Mathematics and Statistics, Stony Brook University, Stony Brook, NY, United StatesDepartment of Applied Mathematics and Statistics, Stony Brook University, Stony Brook, NY, United StatesDepartment of Ecology and Evolution, Program in Science Education, Stony Brook University, Stony Brook, NY, United StatesIntroductionAs artificial intelligence (AI) technology becomes more widespread in the classroom environment, educators have relied on data-driven machine learning (ML) techniques and statistical frameworks to derive insights into student performance patterns. Bayesian methodologies have emerged as a more intuitive approach to frequentist methods of inference since they link prior assumptions and data together to provide a quantitative distribution of final model parameter estimates. Despite their alignment with four recent ML assessment criteria developed in the educational literature, Bayesian methodologies have received considerably less attention by academic stakeholders prompting the need to empirically discern how these techniques can be used to provide actionable insights into student performance.MethodsTo identify the factors most indicative of student retention and attrition, we apply a Bayesian framework to comparatively examine the differential impact that the amalgamation of traditional and AI-driven predictors has on student performance in an undergraduate in-person science, technology, engineering, and mathematics (STEM) course.ResultsInteraction with the course learning management system (LMS) and performance on diagnostic concept inventory (CI) assessments provided the greatest insights into final course performance. Establishing informative prior values using historical classroom data did not always appreciably enhance model fit.DiscussionWe discuss how Bayesian methodologies are a more pragmatic and interpretable way of assessing student performance and are a promising tool for use in science education research and assessment.https://www.frontiersin.org/articles/10.3389/feduc.2023.1073829/fullBayesian methodsretention and attritionlearning management systemconcept inventorymachine learningSTEM education
spellingShingle Roberto Bertolini
Stephen J. Finch
Ross H. Nehm
An application of Bayesian inference to examine student retention and attrition in the STEM classroom
Frontiers in Education
Bayesian methods
retention and attrition
learning management system
concept inventory
machine learning
STEM education
title An application of Bayesian inference to examine student retention and attrition in the STEM classroom
title_full An application of Bayesian inference to examine student retention and attrition in the STEM classroom
title_fullStr An application of Bayesian inference to examine student retention and attrition in the STEM classroom
title_full_unstemmed An application of Bayesian inference to examine student retention and attrition in the STEM classroom
title_short An application of Bayesian inference to examine student retention and attrition in the STEM classroom
title_sort application of bayesian inference to examine student retention and attrition in the stem classroom
topic Bayesian methods
retention and attrition
learning management system
concept inventory
machine learning
STEM education
url https://www.frontiersin.org/articles/10.3389/feduc.2023.1073829/full
work_keys_str_mv AT robertobertolini anapplicationofbayesianinferencetoexaminestudentretentionandattritioninthestemclassroom
AT stephenjfinch anapplicationofbayesianinferencetoexaminestudentretentionandattritioninthestemclassroom
AT rosshnehm anapplicationofbayesianinferencetoexaminestudentretentionandattritioninthestemclassroom
AT robertobertolini applicationofbayesianinferencetoexaminestudentretentionandattritioninthestemclassroom
AT stephenjfinch applicationofbayesianinferencetoexaminestudentretentionandattritioninthestemclassroom
AT rosshnehm applicationofbayesianinferencetoexaminestudentretentionandattritioninthestemclassroom