Using a Quasi-Experimental Design in Combination with Multivariate Analysis to Assess Student Learning

College professors in the social sciences and professional studies have adopted numerous strategies for teaching undergraduate statistics, yet few researchers provide empirical evidence students’ learning actually increased because of the instructional innovation. Assessment of pedagogy is frequentl...

Full description

Bibliographic Details
Main Author: Michael Delucchi
Format: Article
Language:English
Published: Indiana University Office of Scholarly Publishing 2018-10-01
Series:Journal of the Scholarship of Teaching and Learning
Subjects:
Online Access:https://scholarworks.iu.edu/journals/index.php/josotl/article/view/24474
_version_ 1811258057260269568
author Michael Delucchi
author_facet Michael Delucchi
author_sort Michael Delucchi
collection DOAJ
description College professors in the social sciences and professional studies have adopted numerous strategies for teaching undergraduate statistics, yet few researchers provide empirical evidence students’ learning actually increased because of the instructional innovation. Assessment of pedagogy is frequently subjective and based on comments from students or faculty. Consequently, evaluating the effectiveness of teaching activities on student learning in statistical analysis courses is warranted. This study employed a pretest-posttest design to measure student learning and then examined the relationship between student demographics, prior knowledge, and course characteristics on knowledge gained in undergraduate statistics. Data derived from 185 students enrolled in six different sections of a statistical analysis course taught over a seven-year period by the same instructor. Multiple regression analyses revealed age, age X gender (interaction effect), major, prior knowledge, examinations, and group projects all had statistically significant effects on how much students learned in the course. The results suggest faculty assess students’ prior knowledge at the beginning of the semester and use such data to inform both the content and delivery of statistical analysis. Moreover, before embracing a new pedagogy, faculty should establish empirically that learning is linked to the teaching innovation.
first_indexed 2024-04-12T18:07:25Z
format Article
id doaj.art-88fc3c3845cf458ea3bd31ca32a2e1dd
institution Directory Open Access Journal
issn 1527-9316
language English
last_indexed 2024-04-12T18:07:25Z
publishDate 2018-10-01
publisher Indiana University Office of Scholarly Publishing
record_format Article
series Journal of the Scholarship of Teaching and Learning
spelling doaj.art-88fc3c3845cf458ea3bd31ca32a2e1dd2022-12-22T03:21:57ZengIndiana University Office of Scholarly PublishingJournal of the Scholarship of Teaching and Learning1527-93162018-10-0119210.14434/josotl.v19i1.24474Using a Quasi-Experimental Design in Combination with Multivariate Analysis to Assess Student LearningMichael Delucchi0University of HawaiiCollege professors in the social sciences and professional studies have adopted numerous strategies for teaching undergraduate statistics, yet few researchers provide empirical evidence students’ learning actually increased because of the instructional innovation. Assessment of pedagogy is frequently subjective and based on comments from students or faculty. Consequently, evaluating the effectiveness of teaching activities on student learning in statistical analysis courses is warranted. This study employed a pretest-posttest design to measure student learning and then examined the relationship between student demographics, prior knowledge, and course characteristics on knowledge gained in undergraduate statistics. Data derived from 185 students enrolled in six different sections of a statistical analysis course taught over a seven-year period by the same instructor. Multiple regression analyses revealed age, age X gender (interaction effect), major, prior knowledge, examinations, and group projects all had statistically significant effects on how much students learned in the course. The results suggest faculty assess students’ prior knowledge at the beginning of the semester and use such data to inform both the content and delivery of statistical analysis. Moreover, before embracing a new pedagogy, faculty should establish empirically that learning is linked to the teaching innovation.https://scholarworks.iu.edu/journals/index.php/josotl/article/view/24474learning versus performanceknowledge gaindirect measurespretest/post-test assessmentexaminationsgroup work
spellingShingle Michael Delucchi
Using a Quasi-Experimental Design in Combination with Multivariate Analysis to Assess Student Learning
Journal of the Scholarship of Teaching and Learning
learning versus performance
knowledge gain
direct measures
pretest/post-test assessment
examinations
group work
title Using a Quasi-Experimental Design in Combination with Multivariate Analysis to Assess Student Learning
title_full Using a Quasi-Experimental Design in Combination with Multivariate Analysis to Assess Student Learning
title_fullStr Using a Quasi-Experimental Design in Combination with Multivariate Analysis to Assess Student Learning
title_full_unstemmed Using a Quasi-Experimental Design in Combination with Multivariate Analysis to Assess Student Learning
title_short Using a Quasi-Experimental Design in Combination with Multivariate Analysis to Assess Student Learning
title_sort using a quasi experimental design in combination with multivariate analysis to assess student learning
topic learning versus performance
knowledge gain
direct measures
pretest/post-test assessment
examinations
group work
url https://scholarworks.iu.edu/journals/index.php/josotl/article/view/24474
work_keys_str_mv AT michaeldelucchi usingaquasiexperimentaldesignincombinationwithmultivariateanalysistoassessstudentlearning