Relationship between item difficulty and discrimination indices in true/false-type multiple choice questions of a para-clinical multidisciplinary paper.
INTRODUCTION: This paper reports the relationship between the difficulty level and the discrimination power of true/false-type multiple-choice questions (MCQs) in a multidisciplinary paper for the para-clinical year of an undergraduate medical programme. MATERIALS AND METHODS: MCQ items in papers...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Published: |
Academy of Medicine, Singapore
2006
|
| Subjects: |
| _version_ | 1825718455986290688 |
|---|---|
| author | Sim, Si Mui Rasiah, Raja Isaiah |
| author_facet | Sim, Si Mui Rasiah, Raja Isaiah |
| author_sort | Sim, Si Mui |
| collection | UM |
| description | INTRODUCTION: This paper reports the relationship between the difficulty level and the discrimination power of true/false-type multiple-choice questions (MCQs) in a multidisciplinary paper for the para-clinical year of an undergraduate medical programme.
MATERIALS AND METHODS: MCQ items in papers taken from Year II Parts A, B and C examinations for Sessions 2001/02, and Part B examinations for 2002/03 and 2003/04, were analysed to obtain their difficulty indices and discrimination indices. Each paper consisted of 250 true/false items (50 questions of 5 items each) on topics drawn from different disciplines. The questions were first constructed and vetted by the individual departments before being submitted to a central committee, where the final selection of the MCQs was made, based purely on the academic judgement of the committee.
RESULTS: There was a wide distribution of item difficulty indices in all the MCQ papers analysed. Furthermore, the relationship between the difficulty index (P) and discrimination index (D) of the MCQ items in a paper was not linear, but more dome-shaped. Maximal discrimination (D = 51% to 71%) occurred with moderately easy/difficult items (P = 40% to 74%). On average, about 38% of the MCQ items in each paper were "very easy" (P > or =75%), while about 9% were "very difficult" (P <25%). About two-thirds of these very easy/difficult items had "very poor" or even negative discrimination (D < or =20%).
CONCLUSIONS: MCQ items that demonstrate good discriminating potential tend to be moderately difficult items, and the moderately-to-very difficult items are more likely to show negative discrimination. There is a need to evaluate the effectiveness of our MCQ items. |
| first_indexed | 2024-03-06T05:04:52Z |
| format | Article |
| id | um.eprints-600 |
| institution | Universiti Malaya |
| last_indexed | 2024-03-06T05:04:52Z |
| publishDate | 2006 |
| publisher | Academy of Medicine, Singapore |
| record_format | dspace |
| spelling | um.eprints-6002020-02-18T02:48:07Z http://eprints.um.edu.my/600/ Relationship between item difficulty and discrimination indices in true/false-type multiple choice questions of a para-clinical multidisciplinary paper. Sim, Si Mui Rasiah, Raja Isaiah R Medicine (General) INTRODUCTION: This paper reports the relationship between the difficulty level and the discrimination power of true/false-type multiple-choice questions (MCQs) in a multidisciplinary paper for the para-clinical year of an undergraduate medical programme. MATERIALS AND METHODS: MCQ items in papers taken from Year II Parts A, B and C examinations for Sessions 2001/02, and Part B examinations for 2002/03 and 2003/04, were analysed to obtain their difficulty indices and discrimination indices. Each paper consisted of 250 true/false items (50 questions of 5 items each) on topics drawn from different disciplines. The questions were first constructed and vetted by the individual departments before being submitted to a central committee, where the final selection of the MCQs was made, based purely on the academic judgement of the committee. RESULTS: There was a wide distribution of item difficulty indices in all the MCQ papers analysed. Furthermore, the relationship between the difficulty index (P) and discrimination index (D) of the MCQ items in a paper was not linear, but more dome-shaped. Maximal discrimination (D = 51% to 71%) occurred with moderately easy/difficult items (P = 40% to 74%). On average, about 38% of the MCQ items in each paper were "very easy" (P > or =75%), while about 9% were "very difficult" (P <25%). About two-thirds of these very easy/difficult items had "very poor" or even negative discrimination (D < or =20%). CONCLUSIONS: MCQ items that demonstrate good discriminating potential tend to be moderately difficult items, and the moderately-to-very difficult items are more likely to show negative discrimination. There is a need to evaluate the effectiveness of our MCQ items. Academy of Medicine, Singapore 2006-02 Article PeerReviewed Sim, Si Mui and Rasiah, Raja Isaiah (2006) Relationship between item difficulty and discrimination indices in true/false-type multiple choice questions of a para-clinical multidisciplinary paper. Annals, Academy of Medicine, Singapore, 35 (2). pp. 67-71. ISSN 0304-4602, DOI 16565756. http://www.annals.edu.sg/pdf/35VolNo2200603/V35N2p67.pdf 16565756 |
| spellingShingle | R Medicine (General) Sim, Si Mui Rasiah, Raja Isaiah Relationship between item difficulty and discrimination indices in true/false-type multiple choice questions of a para-clinical multidisciplinary paper. |
| title | Relationship between item difficulty and discrimination indices in true/false-type multiple choice questions of a para-clinical multidisciplinary paper. |
| title_full | Relationship between item difficulty and discrimination indices in true/false-type multiple choice questions of a para-clinical multidisciplinary paper. |
| title_fullStr | Relationship between item difficulty and discrimination indices in true/false-type multiple choice questions of a para-clinical multidisciplinary paper. |
| title_full_unstemmed | Relationship between item difficulty and discrimination indices in true/false-type multiple choice questions of a para-clinical multidisciplinary paper. |
| title_short | Relationship between item difficulty and discrimination indices in true/false-type multiple choice questions of a para-clinical multidisciplinary paper. |
| title_sort | relationship between item difficulty and discrimination indices in true false type multiple choice questions of a para clinical multidisciplinary paper |
| topic | R Medicine (General) |
| work_keys_str_mv | AT simsimui relationshipbetweenitemdifficultyanddiscriminationindicesintruefalsetypemultiplechoicequestionsofaparaclinicalmultidisciplinarypaper AT rasiahrajaisaiah relationshipbetweenitemdifficultyanddiscriminationindicesintruefalsetypemultiplechoicequestionsofaparaclinicalmultidisciplinarypaper |