Examination of Gender-Related Differential Item Functioning Through Poly-BW Indices

The existing differential item functioning (DIF) detection approaches relying on item difficulty or item discrimination are limited for understanding the associates of DIF items, and consequently, DIF items were conventionally either deleted or ignored. Given the importance of minimizing DIF items i...

Full description

Bibliographic Details
Main Authors: Tsai-Wei Huang, Pei-Chen Wu, Magdalena Mo Ching Mok
Format: Article
Language:English
Published: Frontiers Media S.A. 2022-02-01
Series:Frontiers in Psychology
Subjects:
Online Access:https://www.frontiersin.org/articles/10.3389/fpsyg.2022.821459/full
_version_ 1818319681088389120
author Tsai-Wei Huang
Pei-Chen Wu
Magdalena Mo Ching Mok
Magdalena Mo Ching Mok
author_facet Tsai-Wei Huang
Pei-Chen Wu
Magdalena Mo Ching Mok
Magdalena Mo Ching Mok
author_sort Tsai-Wei Huang
collection DOAJ
description The existing differential item functioning (DIF) detection approaches relying on item difficulty or item discrimination are limited for understanding the associates of DIF items, and consequently, DIF items were conventionally either deleted or ignored. Given the importance of minimizing DIF items in test construction, teachers or testing practitioners need more information regarding possible associates of DIF items. Using an example of a teacher-made mathematics achievement test, this study aimed to examine how the Poly-BW indices (power, defenselessness, disturbance, and hint) contributed to the properties of gender-related DIF items. Data from a 34-item mathematics achievement test that involved 1,439 seventh-grade students from Taiwan (51.01% boys and 48.99% girls) showed that the differences of the defenselessness (mp) and power (cp) indices between men and women served as salient predictors of the DIF measures estimated by the Poly Simultaneous Item Bias Test (Poly-SIBTEST) procedure and with satisfactory accuracy of hit rates. Items with relatively large defenselessness for men were likely to present male-favoring DIFs, whereas items with relatively large power for men were likely to present female-favoring DIFs. The Poly-BW indices yielded directions for modifying items for teachers in practice.
first_indexed 2024-12-13T10:12:58Z
format Article
id doaj.art-6cea2c6c04364a7fbd7336995f631bc6
institution Directory Open Access Journal
issn 1664-1078
language English
last_indexed 2024-12-13T10:12:58Z
publishDate 2022-02-01
publisher Frontiers Media S.A.
record_format Article
series Frontiers in Psychology
spelling doaj.art-6cea2c6c04364a7fbd7336995f631bc62022-12-21T23:51:22ZengFrontiers Media S.A.Frontiers in Psychology1664-10782022-02-011310.3389/fpsyg.2022.821459821459Examination of Gender-Related Differential Item Functioning Through Poly-BW IndicesTsai-Wei Huang0Pei-Chen Wu1Magdalena Mo Ching Mok2Magdalena Mo Ching Mok3Department of Counseling, National Chiayi University, Chiayi, TaiwanDepartment of Educational Psychology and Counseling, National Pingtung University, Pingtung, TaiwanGraduate Institute of Educational Information and Measurement, National Taichung University of Education, Taichung, TaiwanDepartment of Psychology, Assessment Research Centre, The Education University of Hong Kong, Tai Po, Hong Kong SAR, ChinaThe existing differential item functioning (DIF) detection approaches relying on item difficulty or item discrimination are limited for understanding the associates of DIF items, and consequently, DIF items were conventionally either deleted or ignored. Given the importance of minimizing DIF items in test construction, teachers or testing practitioners need more information regarding possible associates of DIF items. Using an example of a teacher-made mathematics achievement test, this study aimed to examine how the Poly-BW indices (power, defenselessness, disturbance, and hint) contributed to the properties of gender-related DIF items. Data from a 34-item mathematics achievement test that involved 1,439 seventh-grade students from Taiwan (51.01% boys and 48.99% girls) showed that the differences of the defenselessness (mp) and power (cp) indices between men and women served as salient predictors of the DIF measures estimated by the Poly Simultaneous Item Bias Test (Poly-SIBTEST) procedure and with satisfactory accuracy of hit rates. Items with relatively large defenselessness for men were likely to present male-favoring DIFs, whereas items with relatively large power for men were likely to present female-favoring DIFs. The Poly-BW indices yielded directions for modifying items for teachers in practice.https://www.frontiersin.org/articles/10.3389/fpsyg.2022.821459/fulldifferential item functioning (DIF)Poly-SIBTESTPoly-BW indicesteacher-made mathematics testitem-fit statistics
spellingShingle Tsai-Wei Huang
Pei-Chen Wu
Magdalena Mo Ching Mok
Magdalena Mo Ching Mok
Examination of Gender-Related Differential Item Functioning Through Poly-BW Indices
Frontiers in Psychology
differential item functioning (DIF)
Poly-SIBTEST
Poly-BW indices
teacher-made mathematics test
item-fit statistics
title Examination of Gender-Related Differential Item Functioning Through Poly-BW Indices
title_full Examination of Gender-Related Differential Item Functioning Through Poly-BW Indices
title_fullStr Examination of Gender-Related Differential Item Functioning Through Poly-BW Indices
title_full_unstemmed Examination of Gender-Related Differential Item Functioning Through Poly-BW Indices
title_short Examination of Gender-Related Differential Item Functioning Through Poly-BW Indices
title_sort examination of gender related differential item functioning through poly bw indices
topic differential item functioning (DIF)
Poly-SIBTEST
Poly-BW indices
teacher-made mathematics test
item-fit statistics
url https://www.frontiersin.org/articles/10.3389/fpsyg.2022.821459/full
work_keys_str_mv AT tsaiweihuang examinationofgenderrelateddifferentialitemfunctioningthroughpolybwindices
AT peichenwu examinationofgenderrelateddifferentialitemfunctioningthroughpolybwindices
AT magdalenamochingmok examinationofgenderrelateddifferentialitemfunctioningthroughpolybwindices
AT magdalenamochingmok examinationofgenderrelateddifferentialitemfunctioningthroughpolybwindices