Analysis of Multiple Choice Questions Based On Classical Test Theory

Introduction: The aim of this study was to use Classical Test Theory (CTT) software for qualitative and quantitative analysis of Multiple Choice Questions (MCQ) for Master students of health discipline. Methods: This study was carried out on two groups each including 50 undergraduate students of pub...

Full description

Bibliographic Details
Main Authors: Mohammad Mehdi Amin, Shahram Shayan, Hassan Hashemi, Parinaz Poursafa, Afshin Ebrahimi
Format: Article
Language:fas
Published: Isfahan University of Medical Sciences, Medical Education Development Center 2011-02-01
Series:مجله ایرانی آموزش در علوم پزشکی
Subjects:
Online Access:http://ijme.mui.ac.ir/article-1-1543-en.pdf
_version_ 1797638400654704640
author Mohammad Mehdi Amin
Shahram Shayan
Hassan Hashemi
Parinaz Poursafa
Afshin Ebrahimi
author_facet Mohammad Mehdi Amin
Shahram Shayan
Hassan Hashemi
Parinaz Poursafa
Afshin Ebrahimi
author_sort Mohammad Mehdi Amin
collection DOAJ
description Introduction: The aim of this study was to use Classical Test Theory (CTT) software for qualitative and quantitative analysis of Multiple Choice Questions (MCQ) for Master students of health discipline. Methods: This study was carried out on two groups each including 50 undergraduate students of public health, and two groups of 50 and 26 undergraduate students of occupational health. The final exams were done to determine academic achievement of students using MCQ during the years 2004 and 2005 in the department of environmental health, school of health in Isfahan University of Medical Sciences. The questions were analyzed by CTT software in two phases before and after quantative analysis. Results: Having qualitative analysis performed, the questions set for the first stage exam were modified. At the following year, another group of students were examined using those modified questions of the first stage. Reliability coefficient for two exams of industrial solid wastes and health of water, before the quantitative analysis of the questions, were obtained 0.576, and 0.359, respectively. After quantitative analysis of these questions, the coefficients values improved to 0.671 and 0.694, respectively. Conclusion: The method of question analysis in this study led to improving reliability coefficient in the second stage. This coefficient is still far away from desirable coefficient (reliability coefficient greater than 0.8). Therefore, these questions still need to be modified, and analyzed again using the CTT software.
first_indexed 2024-03-11T13:02:04Z
format Article
id doaj.art-eb13ac149534439ca074eab63230d752
institution Directory Open Access Journal
issn 1608-9359
1735-8892
language fas
last_indexed 2024-03-11T13:02:04Z
publishDate 2011-02-01
publisher Isfahan University of Medical Sciences, Medical Education Development Center
record_format Article
series مجله ایرانی آموزش در علوم پزشکی
spelling doaj.art-eb13ac149534439ca074eab63230d7522023-11-03T16:33:00ZfasIsfahan University of Medical Sciences, Medical Education Development Centerمجله ایرانی آموزش در علوم پزشکی1608-93591735-88922011-02-01105719725Analysis of Multiple Choice Questions Based On Classical Test TheoryMohammad Mehdi Amin0Shahram Shayan1Hassan Hashemi2Parinaz Poursafa3Afshin Ebrahimi4 Introduction: The aim of this study was to use Classical Test Theory (CTT) software for qualitative and quantitative analysis of Multiple Choice Questions (MCQ) for Master students of health discipline. Methods: This study was carried out on two groups each including 50 undergraduate students of public health, and two groups of 50 and 26 undergraduate students of occupational health. The final exams were done to determine academic achievement of students using MCQ during the years 2004 and 2005 in the department of environmental health, school of health in Isfahan University of Medical Sciences. The questions were analyzed by CTT software in two phases before and after quantative analysis. Results: Having qualitative analysis performed, the questions set for the first stage exam were modified. At the following year, another group of students were examined using those modified questions of the first stage. Reliability coefficient for two exams of industrial solid wastes and health of water, before the quantitative analysis of the questions, were obtained 0.576, and 0.359, respectively. After quantitative analysis of these questions, the coefficients values improved to 0.671 and 0.694, respectively. Conclusion: The method of question analysis in this study led to improving reliability coefficient in the second stage. This coefficient is still far away from desirable coefficient (reliability coefficient greater than 0.8). Therefore, these questions still need to be modified, and analyzed again using the CTT software.http://ijme.mui.ac.ir/article-1-1543-en.pdfexam analysismultiple choice questions (mcq)classical test theory (ctt).
spellingShingle Mohammad Mehdi Amin
Shahram Shayan
Hassan Hashemi
Parinaz Poursafa
Afshin Ebrahimi
Analysis of Multiple Choice Questions Based On Classical Test Theory
مجله ایرانی آموزش در علوم پزشکی
exam analysis
multiple choice questions (mcq)
classical test theory (ctt).
title Analysis of Multiple Choice Questions Based On Classical Test Theory
title_full Analysis of Multiple Choice Questions Based On Classical Test Theory
title_fullStr Analysis of Multiple Choice Questions Based On Classical Test Theory
title_full_unstemmed Analysis of Multiple Choice Questions Based On Classical Test Theory
title_short Analysis of Multiple Choice Questions Based On Classical Test Theory
title_sort analysis of multiple choice questions based on classical test theory
topic exam analysis
multiple choice questions (mcq)
classical test theory (ctt).
url http://ijme.mui.ac.ir/article-1-1543-en.pdf
work_keys_str_mv AT mohammadmehdiamin analysisofmultiplechoicequestionsbasedonclassicaltesttheory
AT shahramshayan analysisofmultiplechoicequestionsbasedonclassicaltesttheory
AT hassanhashemi analysisofmultiplechoicequestionsbasedonclassicaltesttheory
AT parinazpoursafa analysisofmultiplechoicequestionsbasedonclassicaltesttheory
AT afshinebrahimi analysisofmultiplechoicequestionsbasedonclassicaltesttheory