Evaluating Assessment via Item Response Theory Utilizing Information Function With R
Item and test information functions that measure the reliability of an assessment via Item response theory (IRT) are described in the paper for the practitioners. While the four parameters binary IRT models are frequently used, their relationship to the precision level is not commonly discussed. Mor...
| Main Author: | |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Université d'Ottawa
2024-03-01
|
| Series: | Tutorials in Quantitative Methods for Psychology |
| Subjects: | |
| Online Access: | https://www.tqmp.org/RegularArticles/vol20-1/p033/p033.pdf |
| _version_ | 1797236637343678464 |
|---|---|
| author | Tan, Teck Kiang |
| author_facet | Tan, Teck Kiang |
| author_sort | Tan, Teck Kiang |
| collection | DOAJ |
| description | Item and test information functions that measure the reliability of an assessment via Item response theory (IRT) are described in the paper for the practitioners. While the four parameters binary IRT models are frequently used, their relationship to the precision level is not commonly discussed. More notably, the benefits, limitations, and constraints of the information approach have not been fully examined systematically. On this basis, with useful and practical examples, the paper formally introduces the graphical approach of presenting item and test information functions that could be easily carried out using the irt R package. The simple R syntax is illuminated throughout the text to show the separate item parameter effects and the combinational and offsetting effects on the information when all the item parameters are used in an assessment. In particular, the characteristics of the 4PL information function that have not been paid much attention to are highlighted and illustrated about its functionality and application. The paper ends with a guide on the information approach to the selection of the items and setting up an assessment. The scope, limitations, and constraints of the graphical approach are also discussed. |
| first_indexed | 2024-04-24T17:07:01Z |
| format | Article |
| id | doaj.art-3458357a70274bf0ae36cee2357ab5af |
| institution | Directory Open Access Journal |
| issn | 1913-4126 |
| language | English |
| last_indexed | 2024-04-24T17:07:01Z |
| publishDate | 2024-03-01 |
| publisher | Université d'Ottawa |
| record_format | Article |
| series | Tutorials in Quantitative Methods for Psychology |
| spelling | doaj.art-3458357a70274bf0ae36cee2357ab5af2024-03-28T20:58:06ZengUniversité d'OttawaTutorials in Quantitative Methods for Psychology1913-41262024-03-01201334910.20982/tqmp.20.1.p033Evaluating Assessment via Item Response Theory Utilizing Information Function With RTan, Teck KiangItem and test information functions that measure the reliability of an assessment via Item response theory (IRT) are described in the paper for the practitioners. While the four parameters binary IRT models are frequently used, their relationship to the precision level is not commonly discussed. More notably, the benefits, limitations, and constraints of the information approach have not been fully examined systematically. On this basis, with useful and practical examples, the paper formally introduces the graphical approach of presenting item and test information functions that could be easily carried out using the irt R package. The simple R syntax is illuminated throughout the text to show the separate item parameter effects and the combinational and offsetting effects on the information when all the item parameters are used in an assessment. In particular, the characteristics of the 4PL information function that have not been paid much attention to are highlighted and illustrated about its functionality and application. The paper ends with a guide on the information approach to the selection of the items and setting up an assessment. The scope, limitations, and constraints of the graphical approach are also discussed.https://www.tqmp.org/RegularArticles/vol20-1/p033/p033.pdftest information functionitem information functionitem response theoryr |
| spellingShingle | Tan, Teck Kiang Evaluating Assessment via Item Response Theory Utilizing Information Function With R Tutorials in Quantitative Methods for Psychology test information function item information function item response theory r |
| title | Evaluating Assessment via Item Response Theory Utilizing Information Function With R |
| title_full | Evaluating Assessment via Item Response Theory Utilizing Information Function With R |
| title_fullStr | Evaluating Assessment via Item Response Theory Utilizing Information Function With R |
| title_full_unstemmed | Evaluating Assessment via Item Response Theory Utilizing Information Function With R |
| title_short | Evaluating Assessment via Item Response Theory Utilizing Information Function With R |
| title_sort | evaluating assessment via item response theory utilizing information function with r |
| topic | test information function item information function item response theory r |
| url | https://www.tqmp.org/RegularArticles/vol20-1/p033/p033.pdf |
| work_keys_str_mv | AT tanteckkiang evaluatingassessmentviaitemresponsetheoryutilizinginformationfunctionwithr |