Improving the fairness of ECL listening tests by detecting gender-biased items
The first main objective of this study is to examine whether ECL listening tests in German at CEFR level B2 are equally fair to both male and female test takers. The second aim is to explore distinctive patterns that can be associated with gender-related differential item functioning (DIF) and poten...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | deu |
| Published: |
Croatian Philological Association
2021-01-01
|
| Series: | Strani Jezici |
| Subjects: | |
| Online Access: | https://hrcak.srce.hr/file/392051 |
| _version_ | 1818750119229521920 |
|---|---|
| author | Hrisztalina Hrisztova-Gotthardt Réka Werner |
| author_facet | Hrisztalina Hrisztova-Gotthardt Réka Werner |
| author_sort | Hrisztalina Hrisztova-Gotthardt |
| collection | DOAJ |
| description | The first main objective of this study is to examine whether ECL listening tests in German at CEFR level B2 are equally fair to both male and female test takers. The second aim is to explore distinctive patterns that can be associated with gender-related differential item functioning (DIF) and potentially result in gender-biased items. For this purpose, two complementary approaches are used:
(1) a multi-faceted Rasch analysis in order to detect items showing DIF in terms of gender, and
(2) item characteristics and content analyses in order to identify potential systematic sources of gender-biased items.
According to the results of the statistical analysis, only 6.5 per cent of the items show differential item functioning, thus verifying that the ECL German listening tests are generally fair toward the two gender groups. The findings of the study did not show any systematic patterns that can be clearly associated with gender-related DIF or can potentially result in gender-biased items. |
| first_indexed | 2024-12-18T04:14:36Z |
| format | Article |
| id | doaj.art-87a4dec6f0b3485fa1ef639b4f2e916c |
| institution | Directory Open Access Journal |
| issn | 0351-0840 2459-671X |
| language | deu |
| last_indexed | 2024-12-18T04:14:36Z |
| publishDate | 2021-01-01 |
| publisher | Croatian Philological Association |
| record_format | Article |
| series | Strani Jezici |
| spelling | doaj.art-87a4dec6f0b3485fa1ef639b4f2e916c2022-12-21T21:21:23ZdeuCroatian Philological AssociationStrani Jezici0351-08402459-671X2021-01-01502207234https://doi.org/10.22210/strjez/50-2/3126Improving the fairness of ECL listening tests by detecting gender-biased itemsHrisztalina Hrisztova-Gotthardt0Réka Werner1Foreign Language Centre, University of PécsForeign Language Centre, University of PécsThe first main objective of this study is to examine whether ECL listening tests in German at CEFR level B2 are equally fair to both male and female test takers. The second aim is to explore distinctive patterns that can be associated with gender-related differential item functioning (DIF) and potentially result in gender-biased items. For this purpose, two complementary approaches are used: (1) a multi-faceted Rasch analysis in order to detect items showing DIF in terms of gender, and (2) item characteristics and content analyses in order to identify potential systematic sources of gender-biased items. According to the results of the statistical analysis, only 6.5 per cent of the items show differential item functioning, thus verifying that the ECL German listening tests are generally fair toward the two gender groups. The findings of the study did not show any systematic patterns that can be clearly associated with gender-related DIF or can potentially result in gender-biased items.https://hrcak.srce.hr/file/392051test fairness, validity, dif, gender-biased item, ecl german listening tests |
| spellingShingle | Hrisztalina Hrisztova-Gotthardt Réka Werner Improving the fairness of ECL listening tests by detecting gender-biased items Strani Jezici test fairness, validity, dif, gender-biased item, ecl german listening tests |
| title | Improving the fairness of ECL listening tests by detecting gender-biased items |
| title_full | Improving the fairness of ECL listening tests by detecting gender-biased items |
| title_fullStr | Improving the fairness of ECL listening tests by detecting gender-biased items |
| title_full_unstemmed | Improving the fairness of ECL listening tests by detecting gender-biased items |
| title_short | Improving the fairness of ECL listening tests by detecting gender-biased items |
| title_sort | improving the fairness of ecl listening tests by detecting gender biased items |
| topic | test fairness, validity, dif, gender-biased item, ecl german listening tests |
| url | https://hrcak.srce.hr/file/392051 |
| work_keys_str_mv | AT hrisztalinahrisztovagotthardt improvingthefairnessofecllisteningtestsbydetectinggenderbiaseditems AT rekawerner improvingthefairnessofecllisteningtestsbydetectinggenderbiaseditems |