Comparative Judgement for Linking Two Existing Scales
This article describes an efficient way of using comparative judgement to calibrate scores from different educational assessments against one another (a task often referred to as test linking or equating). The context is distinct from other applications of comparative judgement as there is no need t...
| Main Author: | |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Frontiers Media S.A.
2021-12-01
|
| Series: | Frontiers in Education |
| Subjects: | |
| Online Access: | https://www.frontiersin.org/articles/10.3389/feduc.2021.775203/full |
| _version_ | 1831716922546192384 |
|---|---|
| author | Tom Benton |
| author_facet | Tom Benton |
| author_sort | Tom Benton |
| collection | DOAJ |
| description | This article describes an efficient way of using comparative judgement to calibrate scores from different educational assessments against one another (a task often referred to as test linking or equating). The context is distinct from other applications of comparative judgement as there is no need to create a new achievement scale using a Bradley-Terry model (or similar). The proposed method takes advantage of this fact to include evidence from the largest possible number of examples of students’ performances on the separate assessments whilst keeping the amount of time required from expert judges as low as possible. The paper describes the method and shows, via simulation, how it achieves greater accuracy than alternative approaches to the use of comparative judgement for test equating or linking. |
| first_indexed | 2024-12-21T00:48:51Z |
| format | Article |
| id | doaj.art-85820393f91a4c47906367ea7da689fe |
| institution | Directory Open Access Journal |
| issn | 2504-284X |
| language | English |
| last_indexed | 2024-12-21T00:48:51Z |
| publishDate | 2021-12-01 |
| publisher | Frontiers Media S.A. |
| record_format | Article |
| series | Frontiers in Education |
| spelling | doaj.art-85820393f91a4c47906367ea7da689fe2022-12-21T19:21:27ZengFrontiers Media S.A.Frontiers in Education2504-284X2021-12-01610.3389/feduc.2021.775203775203Comparative Judgement for Linking Two Existing ScalesTom BentonThis article describes an efficient way of using comparative judgement to calibrate scores from different educational assessments against one another (a task often referred to as test linking or equating). The context is distinct from other applications of comparative judgement as there is no need to create a new achievement scale using a Bradley-Terry model (or similar). The proposed method takes advantage of this fact to include evidence from the largest possible number of examples of students’ performances on the separate assessments whilst keeping the amount of time required from expert judges as low as possible. The paper describes the method and shows, via simulation, how it achieves greater accuracy than alternative approaches to the use of comparative judgement for test equating or linking.https://www.frontiersin.org/articles/10.3389/feduc.2021.775203/fullcomparative judgementstandard maintainingequatinglinkingassessment |
| spellingShingle | Tom Benton Comparative Judgement for Linking Two Existing Scales Frontiers in Education comparative judgement standard maintaining equating linking assessment |
| title | Comparative Judgement for Linking Two Existing Scales |
| title_full | Comparative Judgement for Linking Two Existing Scales |
| title_fullStr | Comparative Judgement for Linking Two Existing Scales |
| title_full_unstemmed | Comparative Judgement for Linking Two Existing Scales |
| title_short | Comparative Judgement for Linking Two Existing Scales |
| title_sort | comparative judgement for linking two existing scales |
| topic | comparative judgement standard maintaining equating linking assessment |
| url | https://www.frontiersin.org/articles/10.3389/feduc.2021.775203/full |
| work_keys_str_mv | AT tombenton comparativejudgementforlinkingtwoexistingscales |