Impact of differential item functioning on group score reporting in the context of large-scale assessments

Impact of differential item functioning on group score reporting in the context of large-scale assessments

Abstract We investigated the potential impact of differential item functioning (DIF) on group-level mean and standard deviation estimates using empirical and simulated data in the context of large-scale assessment. For the empirical investigation, PISA 2018 cognitive domains (Reading, Mathematics, a...

Full description

Bibliographic Details
Main Authors:	Sean Joo, Usama Ali, Frederic Robin, Hyo Jeong Shin
Format:	Article
Language:	English
Published:	SpringerOpen 2022-11-01
Series:	Large-scale Assessments in Education
Subjects:	Large-scale assessment Programme for International Student Assessment Differential item functioning Group score reporting Jackknife sampling
Online Access:	https://doi.org/10.1186/s40536-022-00135-7

Similar Items

Nonignorable Consequences of (Partially) Ignoring Missing Item Responses: Students Omit (Constructed Response) Items Due to a Lack of Knowledge
by: Alexander Robitzsch
Published: (2023-04-01)

Analytical Approximation of the Jackknife Linking Error in Item Response Models Utilizing a Taylor Expansion of the Log-Likelihood Function
by: Alexander Robitzsch
Published: (2023-01-01)

Evaluating the effects of analytical decisions in large-scale assessments: analyzing PISA mathematics 2003-2012
by: Jörg-Henrik Heine, et al.
Published: (2022-08-01)

Insight orientation scale: A promising tool for organizational outcomes–A psychometric analysis using item response theory
by: Alessio Gori, et al.
Published: (2022-09-01)

Improved Scoring of Satisfaction with Life Scale
by: Satyendra Chakrabartty
Published: (2023-04-01)

Comparison of disengagement levels and the impact of disengagement on item parameters between PISA 2015 and PISA 2018 in the United States
by: Huan Kuang, et al.
Published: (2023-02-01)

Performance of Missing Data Approaches Under Nonignorable Missing Data Conditions
by: Steffi Pohl, et al.
Published: (2020-06-01)

Comparing different trend estimation approaches in country means and standard deviations in international large-scale assessment studies
by: Alexander Robitzsch, et al.
Published: (2023-07-01)

The dependence on mathematical theory in TIMSS, PISA and TIMSS Advanced test items and its relation to student achievement
by: Arne Hole, et al.
Published: (2018-05-01)

Using Automated Processes to Generate Test Items And Their Associated Solutions and Rationales to Support Formative Feedback
by: Mark Gierl, et al.
Published: (2015-08-01)

Replicating the comparison between item-based tests and language samples in Portuguese kindergarteners’ language assessment
by: Alves Paula C., et al.
Published: (2023-01-01)

Correction: Impact of differential item functioning on group score reporting in the context of large-scale assessments
by: Sean Joo, et al.
Published: (2022-12-01)

Effects of DIF in MST routing in ILSAs
by: Montserrat Valdivia Medinaceli, et al.
Published: (2023-06-01)

Using four-parameter item response theory to model human figure drawings
by: Ricardo Primi, et al.
Published: (2018-12-01)

The Use of Single-Item Ratings Versus Traditional Multiple-Item Questionnaires to Assess Mood and Health
by: Joris C. Verster, et al.
Published: (2021-02-01)

Linguo-Pedagogical Design of Open Question Items in the Context of Digitalization
by: A. V. Alikina, et al.
Published: (2024-01-01)

Exploring the Multiverse of Analytical Decisions in Scaling Educational Large-Scale Assessment Data: A Specification Curve Analysis for PISA 2018 Mathematics Data
by: Alexander Robitzsch
Published: (2022-07-01)

Análisis de correspondencias a partir de una muestra probabilística Analysis of Correspondence from a Probabilistic Sample
by: JAVIER RAMÍREZ, et al.
Published: (2010-01-01)

Comparing Perceptual Speed Between Educational Contexts <subtitle>The Case of Students With Special Educational Needs</subtitle>
by: Timo Gnambs, et al.
Published: (2021-12-01)

A successful intervention to improve conceptual knowledge of medical students who rely on memorization of disclosed items
by: Stefan Heber, et al.
Published: (2023-08-01)

An Item–Item Collaborative Filtering Recommender System Based on Item Reviews: An Approach with Deep Learning
by: Falguni Roy, et al.
Published: (2023-11-01)

Robust and Nonrobust Linking of Two Groups for the Rasch Model with Balanced and Unbalanced Random DIF: A Comparative Simulation Study and the Simultaneous Assessment of Standard Errors and Linking Errors with Resampling Techniques
by: Alexander Robitzsch
Published: (2021-11-01)

A JACKKNIFE VARIANCE ESTIMATOR UNDER TWO-FASES SAMPLING WITH UNEQUAL PROBABILITY UN ESTIMADOR JACKKNIFE DE VARIANZA EN MUESTREO EN DOS FASES CON PROBABILIDADES DESIGUALES
by: Pacheco Mario, et al.
Published: (2007-11-01)

The Effect of Person Misfit on Item Parameter Estimation and Classification Accuracy: A Simulation Study
by: Amin Mousavi, et al.
Published: (2020-11-01)

Automatic item generation: foundations and machine learning-based approaches for assessments
by: Ruhan Circi, et al.
Published: (2023-05-01)

Item analysis of multiple choice questions of undergraduate pharmacology examinations in an International Medical School in India
by: Yeshwanth Rao Karkal, et al.
Published: (2016-01-01)

Comparing Single-Item and Multi-Item Trust Scales: Insights for Assessing Trust in Project Leaders
by: Marcela Souto Castro, et al.
Published: (2023-09-01)

Automated Item Generation: impact of item variants on performance and standard setting
by: R. Westacott, et al.
Published: (2023-09-01)

About the Equivalence of the Latent D-Scoring Model and the Two-Parameter Logistic Item Response Model
by: Alexander Robitzsch
Published: (2021-06-01)

Why ability point estimates can be pointless: a primer on using skill measures from large-scale assessments in secondary analyses
by: Clemens M. Lechner, et al.
Published: (2021-01-01)

The role of PS ability and RC skill in predicting growth trajectories of mathematics achievement
by: Alvin Vista
Published: (2016-12-01)

Generating group-level scores under response accuracy-time conditional dependence
by: Hyo Jeong Shin, et al.
Published: (2022-06-01)

Optimal cutoff scores of the Chinese version of 15-item negative symptom assessment that indicate prominent negative symptoms of schizophrenia
by: Qi Zhou, et al.
Published: (2023-04-01)

ITEM ANALYSIS IN MULTIPLE-CHOICE LISTENING TESTS FROM CILS CERTIFICATE IN ITALIAN AS A FOREIGN LANGUAGE
by: Paulo Torresan
Published: (2015-12-01)

Motivations of assessment item writers in medical programs: a qualitative study
by: Sowmiya Karthikeyan, et al.
Published: (2020-09-01)

Un estimador jackknife de varianza en muestreo en dos fases con probabilidades desiguales A Jackknife Variance Estimator under Two-Fases Sampling with Unequal Probability
by: MARIO PACHECO, et al.
Published: (2007-01-01)

Sample Size and Test Length for Item Parameter Estimate and Exam Parameter Estimate
by: Riswan Riswan
Published: (2021-12-01)

The USE Test in History and Its Validity: Experts of Regional Subject-Specific Committees Speculating on Free-Response Items
by: Oleg Fedorov, et al.
Published: (2021-09-01)

Item Response Analysis of a Structured Mixture Item Response Model with <tt>mirt</tt> Package in <tt>R</tt>
by: Minho Lee, et al.
Published: (2024-03-01)

Item Analysis
by: Christopher Reznich
Published: (2012-08-01)