Evaluation of Multiple Choice Questions of Oral and Maxillofacial Medicine Courses 1, 2, and 3 in the First Semester of Academic Year 2014-2015
Background and aim: Lack of proper assessment of students' knowledge regarding theoretical contents leads to disappointment and negligence by weak students. This study assessed multiple-choice questions (MCQs) of oral and maxillofacial medicine courses in the first semester of the academic year...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Islamic Azad University
2018-04-01
|
| Series: | Journal of Research in Dental and Maxillofacial Sciences |
| Subjects: | |
| Online Access: | http://jrdms.dentaliau.ac.ir/browse.php?a_code=A-10-620-1&slc_lang=en&sid=1 |
| _version_ | 1819169927696744448 |
|---|---|
| author | M Rezai T Farrokhnia M Vatanpour S Lesan SH Yazdipour |
| author_facet | M Rezai T Farrokhnia M Vatanpour S Lesan SH Yazdipour |
| author_sort | M Rezai |
| collection | DOAJ |
| description | Background and aim: Lack of proper assessment of students' knowledge regarding theoretical contents leads to disappointment and negligence by weak students. This study assessed multiple-choice questions (MCQs) of oral and maxillofacial medicine courses in the first semester of the academic year 2014-2015.
Materials and Methods: In this cross-sectional study, questions of theoretical oral medicine courses 1, 2, and 3 were assessed according to twelve items in Millman's checklist, including clearness of stem, negative option for stem, specific option, contrastive option, positive words in stem and options, writing structure of stem, duplicated option, the spelling of stem and options, vertically of options, positivity of stem and options, and use of "all of the above" and "none of the above" phrases in options. Difficulty and discrimination coefficients of each question and the rate of compliance with Millman's principles were evaluated using Excel 2007 and SPSS 16. Data were analyzed using descriptive statistics, analysis of variance (ANOVA), and Regression analysis.
Results: The responses of 219 students to 113 MCQs were evaluated. In theoretical course 1 with 40 MCQs, discrimination coefficient was 0.36±0.2, difficulty coefficient was 73.2±15.02, and correlation coefficient was 0.58. In theoretical course 2 with 35 MCQs, discrimination coefficient was 0.2±0.04, difficulty coefficient was 70.91±25.13, and correlation coefficient was 0.47. In theoretical course 3 with 38 MCQs, discrimination coefficient was 0.3±0.19, difficulty coefficient was 68.73±26.89, and correlation coefficient was 0.5. The percentage of compliance with Millman's principles was 81.88%, 83.58%, and 84.42% in courses 1, 2, and 3, respectively.
Conclusion: The weakest discrimination coefficient was noted in theoretical oral medicine 2. The high percentage of simple difficulty coefficient in the three theoretical courses indicates the necessity of training faculty members in designing questions. |
| first_indexed | 2024-12-22T19:27:17Z |
| format | Article |
| id | doaj.art-a57d19cca0d24557ae4b0dbaf8469e02 |
| institution | Directory Open Access Journal |
| issn | 2383-2754 |
| language | English |
| last_indexed | 2024-12-22T19:27:17Z |
| publishDate | 2018-04-01 |
| publisher | Islamic Azad University |
| record_format | Article |
| series | Journal of Research in Dental and Maxillofacial Sciences |
| spelling | doaj.art-a57d19cca0d24557ae4b0dbaf8469e022022-12-21T18:15:12ZengIslamic Azad UniversityJournal of Research in Dental and Maxillofacial Sciences2383-27542018-04-01322430Evaluation of Multiple Choice Questions of Oral and Maxillofacial Medicine Courses 1, 2, and 3 in the First Semester of Academic Year 2014-2015M Rezai0T Farrokhnia1M Vatanpour2S Lesan3SH Yazdipour4 Oral Medicine Dept, Dental Branch of Tehran, Islamic Azad University, Tehran, Iran. Oral Medicine Dept, Dental Branch of Tehran, Islamic Azad University, Tehran, Iran. Endodontics Dept, Dental Branch of Tehran, Islamic Azad University, Tehran, Iran Oral Medicine Dept, Dental Branch of Tehran, Islamic Azad University, Tehran, Iran. Dental Branch of Tehran, Islamic Azad University, Tehran, Iran Background and aim: Lack of proper assessment of students' knowledge regarding theoretical contents leads to disappointment and negligence by weak students. This study assessed multiple-choice questions (MCQs) of oral and maxillofacial medicine courses in the first semester of the academic year 2014-2015. Materials and Methods: In this cross-sectional study, questions of theoretical oral medicine courses 1, 2, and 3 were assessed according to twelve items in Millman's checklist, including clearness of stem, negative option for stem, specific option, contrastive option, positive words in stem and options, writing structure of stem, duplicated option, the spelling of stem and options, vertically of options, positivity of stem and options, and use of "all of the above" and "none of the above" phrases in options. Difficulty and discrimination coefficients of each question and the rate of compliance with Millman's principles were evaluated using Excel 2007 and SPSS 16. Data were analyzed using descriptive statistics, analysis of variance (ANOVA), and Regression analysis. Results: The responses of 219 students to 113 MCQs were evaluated. In theoretical course 1 with 40 MCQs, discrimination coefficient was 0.36±0.2, difficulty coefficient was 73.2±15.02, and correlation coefficient was 0.58. In theoretical course 2 with 35 MCQs, discrimination coefficient was 0.2±0.04, difficulty coefficient was 70.91±25.13, and correlation coefficient was 0.47. In theoretical course 3 with 38 MCQs, discrimination coefficient was 0.3±0.19, difficulty coefficient was 68.73±26.89, and correlation coefficient was 0.5. The percentage of compliance with Millman's principles was 81.88%, 83.58%, and 84.42% in courses 1, 2, and 3, respectively. Conclusion: The weakest discrimination coefficient was noted in theoretical oral medicine 2. The high percentage of simple difficulty coefficient in the three theoretical courses indicates the necessity of training faculty members in designing questions.http://jrdms.dentaliau.ac.ir/browse.php?a_code=A-10-620-1&slc_lang=en&sid=1Educational MeasurementEducational Test PerformancesLearningFeedbackOral Medicine |
| spellingShingle | M Rezai T Farrokhnia M Vatanpour S Lesan SH Yazdipour Evaluation of Multiple Choice Questions of Oral and Maxillofacial Medicine Courses 1, 2, and 3 in the First Semester of Academic Year 2014-2015 Journal of Research in Dental and Maxillofacial Sciences Educational Measurement Educational Test Performances Learning Feedback Oral Medicine |
| title | Evaluation of Multiple Choice Questions of Oral and Maxillofacial Medicine Courses 1, 2, and 3 in the First Semester of Academic Year 2014-2015 |
| title_full | Evaluation of Multiple Choice Questions of Oral and Maxillofacial Medicine Courses 1, 2, and 3 in the First Semester of Academic Year 2014-2015 |
| title_fullStr | Evaluation of Multiple Choice Questions of Oral and Maxillofacial Medicine Courses 1, 2, and 3 in the First Semester of Academic Year 2014-2015 |
| title_full_unstemmed | Evaluation of Multiple Choice Questions of Oral and Maxillofacial Medicine Courses 1, 2, and 3 in the First Semester of Academic Year 2014-2015 |
| title_short | Evaluation of Multiple Choice Questions of Oral and Maxillofacial Medicine Courses 1, 2, and 3 in the First Semester of Academic Year 2014-2015 |
| title_sort | evaluation of multiple choice questions of oral and maxillofacial medicine courses 1 2 and 3 in the first semester of academic year 2014 2015 |
| topic | Educational Measurement Educational Test Performances Learning Feedback Oral Medicine |
| url | http://jrdms.dentaliau.ac.ir/browse.php?a_code=A-10-620-1&slc_lang=en&sid=1 |
| work_keys_str_mv | AT mrezai evaluationofmultiplechoicequestionsoforalandmaxillofacialmedicinecourses12and3inthefirstsemesterofacademicyear20142015 AT tfarrokhnia evaluationofmultiplechoicequestionsoforalandmaxillofacialmedicinecourses12and3inthefirstsemesterofacademicyear20142015 AT mvatanpour evaluationofmultiplechoicequestionsoforalandmaxillofacialmedicinecourses12and3inthefirstsemesterofacademicyear20142015 AT slesan evaluationofmultiplechoicequestionsoforalandmaxillofacialmedicinecourses12and3inthefirstsemesterofacademicyear20142015 AT shyazdipour evaluationofmultiplechoicequestionsoforalandmaxillofacialmedicinecourses12and3inthefirstsemesterofacademicyear20142015 |