Improvement of Design of Multiple Choice Questions in Annual Residency Exams by Giving Feedback
Background & Objective: The aim of this study was to survey the effect of presenting feedback on improvement of multiple choice questions (MCQ) design in annual residency exams Methods: In this semiexperimental study the structure and taxonomy in MCQs of annual residency exams in 2009 were analy...
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Kerman University of Medical Sciences
2013-05-01
|
| Series: | Strides in Development of Medical Education |
| Subjects: | |
| Online Access: | http://sdme.kmu.ac.ir/article_90257_4325af159d97864efa44e46493c62254.pdf |
| _version_ | 1829141206991372288 |
|---|---|
| author | Azam Meyari Mahdi Beiglarkhani |
| author_facet | Azam Meyari Mahdi Beiglarkhani |
| author_sort | Azam Meyari |
| collection | DOAJ |
| description | Background & Objective: The aim of this study was to survey the effect of presenting feedback on improvement of multiple choice questions (MCQ) design in annual residency exams Methods: In this semiexperimental study the structure and taxonomy in MCQs of annual residency exams in 2009 were analyzed through Millmans checklist Based on this data an interventional feedback on strengths and weaknesses was presented to question designers who had experience of attending MCQ workshops and designing questions in the past The principles of giving technical feedback in medical education such as objectivity right timing and being direct respectful and without judgment were considered After the annual residency exam in 2010 the questions of designers in both years were compared in respect to Millmans principals and taxonomy before and after the intervention Results: From 2500 questions 2035 questions were entered into the study 652% of the questions developed in 2009 had no structural flaw this increased to 828% after the intervention which was a significant difference (P < 0001) Moreover there was a significant increase in the percentage of questions with a high taxonomy from 38% in 2009 to 531% in 2010 (P < 0001) Conclusion: Giving interventional feedback based on its techniques in medical education to experienced designers of MCQs can affect the improvement of designing quality of questions |
| first_indexed | 2024-12-14T20:07:24Z |
| format | Article |
| id | doaj.art-8b40d57c4cdb42d59e420214f02f2795 |
| institution | Directory Open Access Journal |
| issn | 2645-3452 2645-3452 |
| language | English |
| last_indexed | 2024-12-14T20:07:24Z |
| publishDate | 2013-05-01 |
| publisher | Kerman University of Medical Sciences |
| record_format | Article |
| series | Strides in Development of Medical Education |
| spelling | doaj.art-8b40d57c4cdb42d59e420214f02f27952022-12-21T22:49:01ZengKerman University of Medical SciencesStrides in Development of Medical Education2645-34522645-34522013-05-0110110911890257Improvement of Design of Multiple Choice Questions in Annual Residency Exams by Giving FeedbackAzam Meyari0Mahdi Beiglarkhani1General Practitioner, M.Sc. in Medical Education, Medical Education Development Center, Hamedan University of Medical Sciences, Hamedan, IranGeneral Practitioner, M.Sc. in Medical Education, Instructor, Department of General Education, School of Medicine, Hamedan University of Medical Sciences, Hamedan, IranBackground & Objective: The aim of this study was to survey the effect of presenting feedback on improvement of multiple choice questions (MCQ) design in annual residency exams Methods: In this semiexperimental study the structure and taxonomy in MCQs of annual residency exams in 2009 were analyzed through Millmans checklist Based on this data an interventional feedback on strengths and weaknesses was presented to question designers who had experience of attending MCQ workshops and designing questions in the past The principles of giving technical feedback in medical education such as objectivity right timing and being direct respectful and without judgment were considered After the annual residency exam in 2010 the questions of designers in both years were compared in respect to Millmans principals and taxonomy before and after the intervention Results: From 2500 questions 2035 questions were entered into the study 652% of the questions developed in 2009 had no structural flaw this increased to 828% after the intervention which was a significant difference (P < 0001) Moreover there was a significant increase in the percentage of questions with a high taxonomy from 38% in 2009 to 531% in 2010 (P < 0001) Conclusion: Giving interventional feedback based on its techniques in medical education to experienced designers of MCQs can affect the improvement of designing quality of questionshttp://sdme.kmu.ac.ir/article_90257_4325af159d97864efa44e46493c62254.pdfmultiple choice questionsresidencymedical educationtaxonomymillman's principlesfeedback |
| spellingShingle | Azam Meyari Mahdi Beiglarkhani Improvement of Design of Multiple Choice Questions in Annual Residency Exams by Giving Feedback Strides in Development of Medical Education multiple choice questions residency medical education taxonomy millman's principles feedback |
| title | Improvement of Design of Multiple Choice Questions in Annual Residency Exams by Giving Feedback |
| title_full | Improvement of Design of Multiple Choice Questions in Annual Residency Exams by Giving Feedback |
| title_fullStr | Improvement of Design of Multiple Choice Questions in Annual Residency Exams by Giving Feedback |
| title_full_unstemmed | Improvement of Design of Multiple Choice Questions in Annual Residency Exams by Giving Feedback |
| title_short | Improvement of Design of Multiple Choice Questions in Annual Residency Exams by Giving Feedback |
| title_sort | improvement of design of multiple choice questions in annual residency exams by giving feedback |
| topic | multiple choice questions residency medical education taxonomy millman's principles feedback |
| url | http://sdme.kmu.ac.ir/article_90257_4325af159d97864efa44e46493c62254.pdf |
| work_keys_str_mv | AT azammeyari improvementofdesignofmultiplechoicequestionsinannualresidencyexamsbygivingfeedback AT mahdibeiglarkhani improvementofdesignofmultiplechoicequestionsinannualresidencyexamsbygivingfeedback |