Assessing Differential Item Functioning on the Test of Relational Reasoning
The test of relational reasoning (TORR) is designed to assess the ability to identify complex patterns within visuospatial stimuli. The TORR is designed for use in school and university settings, and therefore, its measurement invariance across diverse groups is critical. In this investigation, a la...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Frontiers Media S.A.
2018-03-01
|
| Series: | Frontiers in Education |
| Subjects: | |
| Online Access: | http://journal.frontiersin.org/article/10.3389/feduc.2018.00014/full |
| _version_ | 1819151128534712320 |
|---|---|
| author | Denis Dumas Patricia Alexander |
| author_facet | Denis Dumas Patricia Alexander |
| author_sort | Denis Dumas |
| collection | DOAJ |
| description | The test of relational reasoning (TORR) is designed to assess the ability to identify complex patterns within visuospatial stimuli. The TORR is designed for use in school and university settings, and therefore, its measurement invariance across diverse groups is critical. In this investigation, a large sample, representative of a major university on key demographic variables, was collected, and the resulting data were analyzed using a multi-group, multidimensional item-response theory model-comparison procedure. No significant differential item functioning was found on any of the TORR items across any of the demographic groups of interest. This finding is interpreted as evidence of the cultural fairness of the TORR, and potential test-development choices that may have contributed to that cultural fairness are discussed. |
| first_indexed | 2024-12-22T14:28:28Z |
| format | Article |
| id | doaj.art-200c95eb2a1648b3b01ac607b0a7746e |
| institution | Directory Open Access Journal |
| issn | 2504-284X |
| language | English |
| last_indexed | 2024-12-22T14:28:28Z |
| publishDate | 2018-03-01 |
| publisher | Frontiers Media S.A. |
| record_format | Article |
| series | Frontiers in Education |
| spelling | doaj.art-200c95eb2a1648b3b01ac607b0a7746e2022-12-21T18:22:49ZengFrontiers Media S.A.Frontiers in Education2504-284X2018-03-01310.3389/feduc.2018.00014312247Assessing Differential Item Functioning on the Test of Relational ReasoningDenis Dumas0Patricia Alexander1Research Methods and Statistics, University of Denver, Denver, CO, United StatesHuman Development and Quantitative Methods, University of Maryland, College Park, College Park, MD, United StatesThe test of relational reasoning (TORR) is designed to assess the ability to identify complex patterns within visuospatial stimuli. The TORR is designed for use in school and university settings, and therefore, its measurement invariance across diverse groups is critical. In this investigation, a large sample, representative of a major university on key demographic variables, was collected, and the resulting data were analyzed using a multi-group, multidimensional item-response theory model-comparison procedure. No significant differential item functioning was found on any of the TORR items across any of the demographic groups of interest. This finding is interpreted as evidence of the cultural fairness of the TORR, and potential test-development choices that may have contributed to that cultural fairness are discussed.http://journal.frontiersin.org/article/10.3389/feduc.2018.00014/fulldifferential item functioningrelational reasoningcultural fairnesseducational testing and assessmentpsychometrics |
| spellingShingle | Denis Dumas Patricia Alexander Assessing Differential Item Functioning on the Test of Relational Reasoning Frontiers in Education differential item functioning relational reasoning cultural fairness educational testing and assessment psychometrics |
| title | Assessing Differential Item Functioning on the Test of Relational Reasoning |
| title_full | Assessing Differential Item Functioning on the Test of Relational Reasoning |
| title_fullStr | Assessing Differential Item Functioning on the Test of Relational Reasoning |
| title_full_unstemmed | Assessing Differential Item Functioning on the Test of Relational Reasoning |
| title_short | Assessing Differential Item Functioning on the Test of Relational Reasoning |
| title_sort | assessing differential item functioning on the test of relational reasoning |
| topic | differential item functioning relational reasoning cultural fairness educational testing and assessment psychometrics |
| url | http://journal.frontiersin.org/article/10.3389/feduc.2018.00014/full |
| work_keys_str_mv | AT denisdumas assessingdifferentialitemfunctioningonthetestofrelationalreasoning AT patriciaalexander assessingdifferentialitemfunctioningonthetestofrelationalreasoning |