Analysis of Multiple Choice Questions Based On Classical Test Theory
Introduction: The aim of this study was to use Classical Test Theory (CTT) software for qualitative and quantitative analysis of Multiple Choice Questions (MCQ) for Master students of health discipline. Methods: This study was carried out on two groups each including 50 undergraduate students of pub...
Main Authors: | , , , , |
---|---|
Format: | Article |
Language: | fas |
Published: |
Isfahan University of Medical Sciences, Medical Education Development Center
2011-02-01
|
Series: | مجله ایرانی آموزش در علوم پزشکی |
Subjects: | |
Online Access: | http://ijme.mui.ac.ir/article-1-1543-en.pdf |
_version_ | 1797638400654704640 |
---|---|
author | Mohammad Mehdi Amin Shahram Shayan Hassan Hashemi Parinaz Poursafa Afshin Ebrahimi |
author_facet | Mohammad Mehdi Amin Shahram Shayan Hassan Hashemi Parinaz Poursafa Afshin Ebrahimi |
author_sort | Mohammad Mehdi Amin |
collection | DOAJ |
description | Introduction: The aim of this study was to use Classical Test Theory (CTT) software for qualitative and quantitative analysis of Multiple Choice Questions (MCQ) for Master students of health discipline.
Methods: This study was carried out on two groups each including 50 undergraduate students of public health, and two groups of 50 and 26 undergraduate students of occupational health. The final exams were done to determine academic achievement of students using MCQ during the years 2004 and 2005 in the department of environmental health, school of health in Isfahan University of Medical Sciences. The questions were analyzed by CTT software in two phases before and after quantative analysis.
Results: Having qualitative analysis performed, the questions set for the first stage exam were modified. At the following year, another group of students were examined using those modified questions of the first stage. Reliability coefficient for two exams of industrial solid wastes and health of water, before the quantitative analysis of the questions, were obtained 0.576, and 0.359, respectively. After quantitative analysis of these questions, the coefficients values improved to 0.671 and 0.694, respectively.
Conclusion: The method of question analysis in this study led to improving reliability coefficient in the second stage. This coefficient is still far away from desirable coefficient (reliability coefficient greater than 0.8). Therefore, these questions still need to be modified, and analyzed again using the CTT software. |
first_indexed | 2024-03-11T13:02:04Z |
format | Article |
id | doaj.art-eb13ac149534439ca074eab63230d752 |
institution | Directory Open Access Journal |
issn | 1608-9359 1735-8892 |
language | fas |
last_indexed | 2024-03-11T13:02:04Z |
publishDate | 2011-02-01 |
publisher | Isfahan University of Medical Sciences, Medical Education Development Center |
record_format | Article |
series | مجله ایرانی آموزش در علوم پزشکی |
spelling | doaj.art-eb13ac149534439ca074eab63230d7522023-11-03T16:33:00ZfasIsfahan University of Medical Sciences, Medical Education Development Centerمجله ایرانی آموزش در علوم پزشکی1608-93591735-88922011-02-01105719725Analysis of Multiple Choice Questions Based On Classical Test TheoryMohammad Mehdi Amin0Shahram Shayan1Hassan Hashemi2Parinaz Poursafa3Afshin Ebrahimi4 Introduction: The aim of this study was to use Classical Test Theory (CTT) software for qualitative and quantitative analysis of Multiple Choice Questions (MCQ) for Master students of health discipline. Methods: This study was carried out on two groups each including 50 undergraduate students of public health, and two groups of 50 and 26 undergraduate students of occupational health. The final exams were done to determine academic achievement of students using MCQ during the years 2004 and 2005 in the department of environmental health, school of health in Isfahan University of Medical Sciences. The questions were analyzed by CTT software in two phases before and after quantative analysis. Results: Having qualitative analysis performed, the questions set for the first stage exam were modified. At the following year, another group of students were examined using those modified questions of the first stage. Reliability coefficient for two exams of industrial solid wastes and health of water, before the quantitative analysis of the questions, were obtained 0.576, and 0.359, respectively. After quantitative analysis of these questions, the coefficients values improved to 0.671 and 0.694, respectively. Conclusion: The method of question analysis in this study led to improving reliability coefficient in the second stage. This coefficient is still far away from desirable coefficient (reliability coefficient greater than 0.8). Therefore, these questions still need to be modified, and analyzed again using the CTT software.http://ijme.mui.ac.ir/article-1-1543-en.pdfexam analysismultiple choice questions (mcq)classical test theory (ctt). |
spellingShingle | Mohammad Mehdi Amin Shahram Shayan Hassan Hashemi Parinaz Poursafa Afshin Ebrahimi Analysis of Multiple Choice Questions Based On Classical Test Theory مجله ایرانی آموزش در علوم پزشکی exam analysis multiple choice questions (mcq) classical test theory (ctt). |
title | Analysis of Multiple Choice Questions Based On Classical Test Theory |
title_full | Analysis of Multiple Choice Questions Based On Classical Test Theory |
title_fullStr | Analysis of Multiple Choice Questions Based On Classical Test Theory |
title_full_unstemmed | Analysis of Multiple Choice Questions Based On Classical Test Theory |
title_short | Analysis of Multiple Choice Questions Based On Classical Test Theory |
title_sort | analysis of multiple choice questions based on classical test theory |
topic | exam analysis multiple choice questions (mcq) classical test theory (ctt). |
url | http://ijme.mui.ac.ir/article-1-1543-en.pdf |
work_keys_str_mv | AT mohammadmehdiamin analysisofmultiplechoicequestionsbasedonclassicaltesttheory AT shahramshayan analysisofmultiplechoicequestionsbasedonclassicaltesttheory AT hassanhashemi analysisofmultiplechoicequestionsbasedonclassicaltesttheory AT parinazpoursafa analysisofmultiplechoicequestionsbasedonclassicaltesttheory AT afshinebrahimi analysisofmultiplechoicequestionsbasedonclassicaltesttheory |