A survey of quality and quantity indexes of multiple choice question (MCQ) exams of medical residents at Kermanshah University of Medical Sciences: 2008-2012
Introduction: Multiple choice questions (MCQs) are widely used to assess medical residents. The study aims to analyse MCQ exams of medical residents administered at Kermanshah University of Medical Sciences during 2008-2012. Method: Data of this retrospective study were extracted from 63 MCQ exams i...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | fas |
| Published: |
Shahid Sadoughi University of Medical Sciences
2014-03-01
|
| Series: | Journal of Medical Education and Development |
| Subjects: | |
| Online Access: | http://jmed.ssu.ac.ir/browse.php?a_code=A-10-278-2&slc_lang=en&sid=1 |
| _version_ | 1828412574879711232 |
|---|---|
| author | R pourmirza kalhori M rezeai B Karami Matin F Roshan Pour |
| author_facet | R pourmirza kalhori M rezeai B Karami Matin F Roshan Pour |
| author_sort | R pourmirza kalhori |
| collection | DOAJ |
| description | Introduction: Multiple choice questions (MCQs) are widely used to assess medical residents. The study aims to analyse MCQ exams of medical residents administered at Kermanshah University of Medical Sciences during 2008-2012. Method: Data of this retrospective study were extracted from 63 MCQ exams including 9600 tests. Quantity related variables included discrimination index, difficulty level, reliability of test index (KR20). Quality related variables included proportion of questions without structural defect and proportion of taxonomy 1, 2 and 3 questions. Data were collected using MCQs from question bank and analyzed by SPSS V.16 software. Results: Over the specified five years, the average difficulty level was %0.62, the average discrimination index was 0.27 and the average of reliability coefficient (KR20) in total exams was 0.88. The average of questions in Taxonomy 1 over the specified years was 33.5% and questions with taxonomy 2 and 3 were66.5%. The average of questions without structural defect was 62.6% which fell in the unacceptable range. A significant difference was observed in reliability coefficient (KR20)- (P=0.017), difficulty level (P=0.001), taxonomy 1 (P=0.001) and Taxonomy 2 and 3 (P=0.006). Conclusion: According to findings of this study, taxonomy 2 and 3 were decreased and taxonomy 1 was increased over the specified five years. We recommend the specialist board members and the Deputy for Education of the Ministry of Health to consider the results of this study and react to them by improving MCQ quality of future exams. |
| first_indexed | 2024-12-10T12:51:38Z |
| format | Article |
| id | doaj.art-bf88fb68353a42709901b1ae4ec416c3 |
| institution | Directory Open Access Journal |
| issn | 2251-7065 2251-8266 |
| language | fas |
| last_indexed | 2024-12-10T12:51:38Z |
| publishDate | 2014-03-01 |
| publisher | Shahid Sadoughi University of Medical Sciences |
| record_format | Article |
| series | Journal of Medical Education and Development |
| spelling | doaj.art-bf88fb68353a42709901b1ae4ec416c32022-12-22T01:48:13ZfasShahid Sadoughi University of Medical SciencesJournal of Medical Education and Development2251-70652251-82662014-03-01846475A survey of quality and quantity indexes of multiple choice question (MCQ) exams of medical residents at Kermanshah University of Medical Sciences: 2008-2012R pourmirza kalhori0M rezeai1B Karami Matin2F Roshan Pour3 Introduction: Multiple choice questions (MCQs) are widely used to assess medical residents. The study aims to analyse MCQ exams of medical residents administered at Kermanshah University of Medical Sciences during 2008-2012. Method: Data of this retrospective study were extracted from 63 MCQ exams including 9600 tests. Quantity related variables included discrimination index, difficulty level, reliability of test index (KR20). Quality related variables included proportion of questions without structural defect and proportion of taxonomy 1, 2 and 3 questions. Data were collected using MCQs from question bank and analyzed by SPSS V.16 software. Results: Over the specified five years, the average difficulty level was %0.62, the average discrimination index was 0.27 and the average of reliability coefficient (KR20) in total exams was 0.88. The average of questions in Taxonomy 1 over the specified years was 33.5% and questions with taxonomy 2 and 3 were66.5%. The average of questions without structural defect was 62.6% which fell in the unacceptable range. A significant difference was observed in reliability coefficient (KR20)- (P=0.017), difficulty level (P=0.001), taxonomy 1 (P=0.001) and Taxonomy 2 and 3 (P=0.006). Conclusion: According to findings of this study, taxonomy 2 and 3 were decreased and taxonomy 1 was increased over the specified five years. We recommend the specialist board members and the Deputy for Education of the Ministry of Health to consider the results of this study and react to them by improving MCQ quality of future exams.http://jmed.ssu.ac.ir/browse.php?a_code=A-10-278-2&slc_lang=en&sid=1Multiple choice questions exam analysis l residency board |
| spellingShingle | R pourmirza kalhori M rezeai B Karami Matin F Roshan Pour A survey of quality and quantity indexes of multiple choice question (MCQ) exams of medical residents at Kermanshah University of Medical Sciences: 2008-2012 Journal of Medical Education and Development Multiple choice questions exam analysis l residency board |
| title | A survey of quality and quantity indexes of multiple choice question (MCQ) exams of medical residents at Kermanshah University of Medical Sciences: 2008-2012 |
| title_full | A survey of quality and quantity indexes of multiple choice question (MCQ) exams of medical residents at Kermanshah University of Medical Sciences: 2008-2012 |
| title_fullStr | A survey of quality and quantity indexes of multiple choice question (MCQ) exams of medical residents at Kermanshah University of Medical Sciences: 2008-2012 |
| title_full_unstemmed | A survey of quality and quantity indexes of multiple choice question (MCQ) exams of medical residents at Kermanshah University of Medical Sciences: 2008-2012 |
| title_short | A survey of quality and quantity indexes of multiple choice question (MCQ) exams of medical residents at Kermanshah University of Medical Sciences: 2008-2012 |
| title_sort | survey of quality and quantity indexes of multiple choice question mcq exams of medical residents at kermanshah university of medical sciences 2008 2012 |
| topic | Multiple choice questions exam analysis l residency board |
| url | http://jmed.ssu.ac.ir/browse.php?a_code=A-10-278-2&slc_lang=en&sid=1 |
| work_keys_str_mv | AT rpourmirzakalhori asurveyofqualityandquantityindexesofmultiplechoicequestionmcqexamsofmedicalresidentsatkermanshahuniversityofmedicalsciences20082012 AT mrezeai asurveyofqualityandquantityindexesofmultiplechoicequestionmcqexamsofmedicalresidentsatkermanshahuniversityofmedicalsciences20082012 AT bkaramimatin asurveyofqualityandquantityindexesofmultiplechoicequestionmcqexamsofmedicalresidentsatkermanshahuniversityofmedicalsciences20082012 AT froshanpour asurveyofqualityandquantityindexesofmultiplechoicequestionmcqexamsofmedicalresidentsatkermanshahuniversityofmedicalsciences20082012 AT rpourmirzakalhori surveyofqualityandquantityindexesofmultiplechoicequestionmcqexamsofmedicalresidentsatkermanshahuniversityofmedicalsciences20082012 AT mrezeai surveyofqualityandquantityindexesofmultiplechoicequestionmcqexamsofmedicalresidentsatkermanshahuniversityofmedicalsciences20082012 AT bkaramimatin surveyofqualityandquantityindexesofmultiplechoicequestionmcqexamsofmedicalresidentsatkermanshahuniversityofmedicalsciences20082012 AT froshanpour surveyofqualityandquantityindexesofmultiplechoicequestionmcqexamsofmedicalresidentsatkermanshahuniversityofmedicalsciences20082012 |