A Comparison of Classical Test Theory and Nonparametric Item Response Theory with Respect to the Effects of Testees’ Characteristics on Item Characteristics and vice versa
This study aimed at comparing Classical Test Theory and Nonparametric Item Response Theory with respect to the effect of testees’ characteristics on item characteristics and vice versa. The research method was of the applied, descriptive type. Library research served to exam the issue from a theoret...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | fas |
| Published: |
Organization for educational research and planning
2006-12-01
|
| Series: | فصلنامه نوآوریهای آموزشی |
| Subjects: | |
| Online Access: | https://noavaryedu.oerp.ir/article_78809_9d8a2618391136d07023c5f7894c45de.pdf |
| _version_ | 1797689991709589504 |
|---|---|
| author | Ali delavar Ali Moghaddamzadeh Seyedeh Tayebeh Motiee Langroudi |
| author_facet | Ali delavar Ali Moghaddamzadeh Seyedeh Tayebeh Motiee Langroudi |
| author_sort | Ali delavar |
| collection | DOAJ |
| description | This study aimed at comparing Classical Test Theory and Nonparametric Item Response Theory with respect to the effect of testees’ characteristics on item characteristics and vice versa. The research method was of the applied, descriptive type. Library research served to exam the issue from a theoretical point of view and the descriptive method was employed to treat the issue from a theoretical perspective. In the practical study, the answer sheets of the candidates for the university entrance exam in the field of physics-math, and emprial science were studied for their performance on the math respectively. First, out of the candidates in the physics-math group, 3,000 were selected based on systematic sampling. Then several sample groups were selected, using the appropriate software and the size of the sample to respond to the research questions. Out of the candidates in the empirical science group, 1,000 were chosed for the purpose of this research. The two research questions in this study were treated theatrically, and in each question, the advantages of Nonparametric Item Response Theory over Classical Test Theory were examined. The research questions were also examined from a practical point of view. To analyze data, the statistical methods based on Classical Test Model – such as mean, item difficulty, item variance, biserial correlation (rb), and point-biserial correlation (rpb) – were applied. KR-20, frequency distribution, and test score plot were employed to analyze the total tests in this model. To analyze data according to Item Response Theory, statistical methods such as paired t-test, Pearson Cofficient Correlation and tests of significant were used. The result from the two methods of data analysis showed that the differences between the two groups of candidates affected the item indexes in CTT, but they did not affect the item index in NIRT. The results also showed that the ability parameter was affected by Item characteristics in CTT; however, in NIRT, item characteristics failed to measure the ability parameter of the testees and, like the item parameter, the ability parameter was invariant and non-skewed. |
| first_indexed | 2024-03-12T01:53:12Z |
| format | Article |
| id | doaj.art-54f615fb010b431fbaf01b9c88972a24 |
| institution | Directory Open Access Journal |
| issn | 1735-1235 |
| language | fas |
| last_indexed | 2024-03-12T01:53:12Z |
| publishDate | 2006-12-01 |
| publisher | Organization for educational research and planning |
| record_format | Article |
| series | فصلنامه نوآوریهای آموزشی |
| spelling | doaj.art-54f615fb010b431fbaf01b9c88972a242023-09-08T07:52:39ZfasOrganization for educational research and planningفصلنامه نوآوریهای آموزشی1735-12352006-12-0154415678809A Comparison of Classical Test Theory and Nonparametric Item Response Theory with Respect to the Effects of Testees’ Characteristics on Item Characteristics and vice versaAli delavar0Ali Moghaddamzadeh1Seyedeh Tayebeh Motiee Langroudi2Professor of Allameh Tabatabai University in TehranMaster of assessment and measurement of Allameh Tabatabai UniversityMaster of Educational Research Tehran UniversityThis study aimed at comparing Classical Test Theory and Nonparametric Item Response Theory with respect to the effect of testees’ characteristics on item characteristics and vice versa. The research method was of the applied, descriptive type. Library research served to exam the issue from a theoretical point of view and the descriptive method was employed to treat the issue from a theoretical perspective. In the practical study, the answer sheets of the candidates for the university entrance exam in the field of physics-math, and emprial science were studied for their performance on the math respectively. First, out of the candidates in the physics-math group, 3,000 were selected based on systematic sampling. Then several sample groups were selected, using the appropriate software and the size of the sample to respond to the research questions. Out of the candidates in the empirical science group, 1,000 were chosed for the purpose of this research. The two research questions in this study were treated theatrically, and in each question, the advantages of Nonparametric Item Response Theory over Classical Test Theory were examined. The research questions were also examined from a practical point of view. To analyze data, the statistical methods based on Classical Test Model – such as mean, item difficulty, item variance, biserial correlation (rb), and point-biserial correlation (rpb) – were applied. KR-20, frequency distribution, and test score plot were employed to analyze the total tests in this model. To analyze data according to Item Response Theory, statistical methods such as paired t-test, Pearson Cofficient Correlation and tests of significant were used. The result from the two methods of data analysis showed that the differences between the two groups of candidates affected the item indexes in CTT, but they did not affect the item index in NIRT. The results also showed that the ability parameter was affected by Item characteristics in CTT; however, in NIRT, item characteristics failed to measure the ability parameter of the testees and, like the item parameter, the ability parameter was invariant and non-skewed.https://noavaryedu.oerp.ir/article_78809_9d8a2618391136d07023c5f7894c45de.pdfclassical test theoryitem response theorytestees’ characteristicsitem characteristics |
| spellingShingle | Ali delavar Ali Moghaddamzadeh Seyedeh Tayebeh Motiee Langroudi A Comparison of Classical Test Theory and Nonparametric Item Response Theory with Respect to the Effects of Testees’ Characteristics on Item Characteristics and vice versa فصلنامه نوآوریهای آموزشی classical test theory item response theory testees’ characteristics item characteristics |
| title | A Comparison of Classical Test Theory and Nonparametric Item Response Theory with Respect to the Effects of Testees’ Characteristics on Item Characteristics and vice versa |
| title_full | A Comparison of Classical Test Theory and Nonparametric Item Response Theory with Respect to the Effects of Testees’ Characteristics on Item Characteristics and vice versa |
| title_fullStr | A Comparison of Classical Test Theory and Nonparametric Item Response Theory with Respect to the Effects of Testees’ Characteristics on Item Characteristics and vice versa |
| title_full_unstemmed | A Comparison of Classical Test Theory and Nonparametric Item Response Theory with Respect to the Effects of Testees’ Characteristics on Item Characteristics and vice versa |
| title_short | A Comparison of Classical Test Theory and Nonparametric Item Response Theory with Respect to the Effects of Testees’ Characteristics on Item Characteristics and vice versa |
| title_sort | comparison of classical test theory and nonparametric item response theory with respect to the effects of testees characteristics on item characteristics and vice versa |
| topic | classical test theory item response theory testees’ characteristics item characteristics |
| url | https://noavaryedu.oerp.ir/article_78809_9d8a2618391136d07023c5f7894c45de.pdf |
| work_keys_str_mv | AT alidelavar acomparisonofclassicaltesttheoryandnonparametricitemresponsetheorywithrespecttotheeffectsoftesteescharacteristicsonitemcharacteristicsandviceversa AT alimoghaddamzadeh acomparisonofclassicaltesttheoryandnonparametricitemresponsetheorywithrespecttotheeffectsoftesteescharacteristicsonitemcharacteristicsandviceversa AT seyedehtayebehmotieelangroudi acomparisonofclassicaltesttheoryandnonparametricitemresponsetheorywithrespecttotheeffectsoftesteescharacteristicsonitemcharacteristicsandviceversa AT alidelavar comparisonofclassicaltesttheoryandnonparametricitemresponsetheorywithrespecttotheeffectsoftesteescharacteristicsonitemcharacteristicsandviceversa AT alimoghaddamzadeh comparisonofclassicaltesttheoryandnonparametricitemresponsetheorywithrespecttotheeffectsoftesteescharacteristicsonitemcharacteristicsandviceversa AT seyedehtayebehmotieelangroudi comparisonofclassicaltesttheoryandnonparametricitemresponsetheorywithrespecttotheeffectsoftesteescharacteristicsonitemcharacteristicsandviceversa |