Low Inter-Rater Reliability of a High Stakes Performance Assessment of Teacher Candidates
The Performance Assessment for California Teachers (PACT) is a high stakes summative assessment that was designed to measure pre-service teacher readiness. We examined the inter-rater reliability (IRR) of trained PACT evaluators who rated 19 candidates. As measured by Cohen’s weighted kappa, the ove...
Main Authors: | Scott A. Lyness, Kent Peterson, Kenneth Yates |
---|---|
Format: | Article |
Language: | English |
Published: |
MDPI AG
2021-10-01
|
Series: | Education Sciences |
Subjects: | |
Online Access: | https://www.mdpi.com/2227-7102/11/10/648 |
Similar Items
-
More Evidence of Low Inter-Rater Reliability of a High-Stakes Performance Assessment of Teacher Candidates
by: Scott A. Lyness
Published: (2024-03-01) -
Investigating the Impact of Feedback Instruction: Partnering Preservice Teachers with Middle School Students to Provide Digital, Scaffolded Feedback
by: Angela Falter Thomas, et al.
Published: (2015-08-01) -
Computing Inter-Rater Reliability for Observational Data: An Overview and Tutorial
by: Kevin A. Hallgren
Published: (2012-02-01) -
An Empirical Comparative Assessment of Inter-Rater Agreement of Binary Outcomes and Multiple Raters
by: Menelaos Konstantinidis, et al.
Published: (2022-01-01) -
Erratum to Hallgren, K. A. (2012). Computing inter-rater reliability for observational data: An overview and tutorial.
by: Kevin A. Hallgren
Published: (2013-10-01)