Effects of grading leniency and low workload on students' evaluations of teaching: Popular myth, bias, validity, or innocent bystanders?

Two studies debunk popular myths that student evaluations of teaching (SETs) are substantially biased by low workload and grading leniency. A workload bias is untenable because the workload-SET relation is positive. The small grade-SET relation (.20 for overall ratings) has many well-supported expla...

Full description

Bibliographic Details
Main Authors: Marsh, H, Roche, L
Format: Journal article
Published: 2000
_version_ 1797057889668431872
author Marsh, H
Roche, L
author_facet Marsh, H
Roche, L
author_sort Marsh, H
collection OXFORD
description Two studies debunk popular myths that student evaluations of teaching (SETs) are substantially biased by low workload and grading leniency. A workload bias is untenable because the workload-SET relation is positive. The small grade-SET relation (.20 for overall ratings) has many well-supported explanations that do not involve bias. Some SET factors (e.g., Organization, Enthusiasm) are unrelated to grades, and the highest relation is with Learning (.30), implying valid teaching effects rather than bias. Structural equation models confirmed that perceived learning and prior characteristics (course level, prior subject interest) account for much of the grade-SET relation. The relation is also nonlinear, so that high grades (sometimes misused as a leniency measure) are unrelated to SETs. Contrary to dire predictions based on bias claims, Workload, expected grades, and their relations with SETs were stable over 12 years.
first_indexed 2024-03-06T19:42:44Z
format Journal article
id oxford-uuid:21387473-ae2f-4f0c-bb44-07b8890147e8
institution University of Oxford
last_indexed 2024-03-06T19:42:44Z
publishDate 2000
record_format dspace
spelling oxford-uuid:21387473-ae2f-4f0c-bb44-07b8890147e82022-03-26T11:32:08ZEffects of grading leniency and low workload on students' evaluations of teaching: Popular myth, bias, validity, or innocent bystanders?Journal articlehttp://purl.org/coar/resource_type/c_dcae04bcuuid:21387473-ae2f-4f0c-bb44-07b8890147e8Symplectic Elements at Oxford2000Marsh, HRoche, LTwo studies debunk popular myths that student evaluations of teaching (SETs) are substantially biased by low workload and grading leniency. A workload bias is untenable because the workload-SET relation is positive. The small grade-SET relation (.20 for overall ratings) has many well-supported explanations that do not involve bias. Some SET factors (e.g., Organization, Enthusiasm) are unrelated to grades, and the highest relation is with Learning (.30), implying valid teaching effects rather than bias. Structural equation models confirmed that perceived learning and prior characteristics (course level, prior subject interest) account for much of the grade-SET relation. The relation is also nonlinear, so that high grades (sometimes misused as a leniency measure) are unrelated to SETs. Contrary to dire predictions based on bias claims, Workload, expected grades, and their relations with SETs were stable over 12 years.
spellingShingle Marsh, H
Roche, L
Effects of grading leniency and low workload on students' evaluations of teaching: Popular myth, bias, validity, or innocent bystanders?
title Effects of grading leniency and low workload on students' evaluations of teaching: Popular myth, bias, validity, or innocent bystanders?
title_full Effects of grading leniency and low workload on students' evaluations of teaching: Popular myth, bias, validity, or innocent bystanders?
title_fullStr Effects of grading leniency and low workload on students' evaluations of teaching: Popular myth, bias, validity, or innocent bystanders?
title_full_unstemmed Effects of grading leniency and low workload on students' evaluations of teaching: Popular myth, bias, validity, or innocent bystanders?
title_short Effects of grading leniency and low workload on students' evaluations of teaching: Popular myth, bias, validity, or innocent bystanders?
title_sort effects of grading leniency and low workload on students evaluations of teaching popular myth bias validity or innocent bystanders
work_keys_str_mv AT marshh effectsofgradingleniencyandlowworkloadonstudentsevaluationsofteachingpopularmythbiasvalidityorinnocentbystanders
AT rochel effectsofgradingleniencyandlowworkloadonstudentsevaluationsofteachingpopularmythbiasvalidityorinnocentbystanders