The Relationship between Negative Stem and Taxonomy of Multiple-Choice Questions in Residency Pre-Board and Board Exams
Introduction: Multiple-choice question tests are considered as one of the most common assessment methods, frequently used in university tests. This study examined the relationship between question taxonomy and negative stem questions in university pre-board tests in Tabriz University of Medical Scie...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Tabriz University of Medical Sciences
2016-06-01
|
| Series: | Research and Development in Medical Education |
| Subjects: | |
| Online Access: | http://journals.tbzmed.ac.ir/RDME/Manuscript/RDME-5-32.pdf |
| _version_ | 1818778123928338432 |
|---|---|
| author | Mohammad Hasan Karegar Maher Mohammad Barzegar Masoumeh Gasempour |
| author_facet | Mohammad Hasan Karegar Maher Mohammad Barzegar Masoumeh Gasempour |
| author_sort | Mohammad Hasan Karegar Maher |
| collection | DOAJ |
| description | Introduction: Multiple-choice question tests are considered as one of the most common assessment methods, frequently used in university tests. This study examined the relationship between question taxonomy and negative stem questions in university pre-board tests in Tabriz University of Medical Sciences and national boards tests in internal medicine, general surgery, pediatrics and obstetrics and gynecology residency examination from 2010-2011. Methods: In this cross-sectional study, 2400 written multiple-choice questions related to the mentioned fields were studied in terms of the relationship between taxonomy levels of the questions and their stems. If there were a negative word or negative concept in the question body, it was considered a negative stem. Taxonomy was graded: taxonomy I, ability to remember facts, Taxonomy II, ability to interpret data and taxonomy III ability to solve a new problem. The data collected were analyzed by SPSS18. P-value<0.05 was considered significant. Results: A total of 2400 questions from 8 tests (board, pre-board) in 4 fields were studied. In total, 23.1% of pre-board tests and 16.6% of national board tests had negative stems and the difference was statistically significant (P=0.0001). In this study 31.1% of questions were designed with positive stems and 63.9% with negative stems in taxonomy level I(P=0.0001). There is a correlation between negative stem questions and their taxonomy. This means that 63.9% of negative stem and 31.1% of positive stem questions have been designed in taxonomy level I(P=0.0001). Conclusion: The use of negative stem questions considerably resulted in the design of low-level cognitive questions. |
| first_indexed | 2024-12-18T11:39:44Z |
| format | Article |
| id | doaj.art-9ab73611b5604d3f92e049dbd712c5b4 |
| institution | Directory Open Access Journal |
| issn | 2322-2719 |
| language | English |
| last_indexed | 2024-12-18T11:39:44Z |
| publishDate | 2016-06-01 |
| publisher | Tabriz University of Medical Sciences |
| record_format | Article |
| series | Research and Development in Medical Education |
| spelling | doaj.art-9ab73611b5604d3f92e049dbd712c5b42022-12-21T21:09:26ZengTabriz University of Medical SciencesResearch and Development in Medical Education2322-27192016-06-0151323510.15171/rdme.2016.007RDME_1399_20151210115621The Relationship between Negative Stem and Taxonomy of Multiple-Choice Questions in Residency Pre-Board and Board ExamsMohammad Hasan Karegar Maher0Mohammad Barzegar1Masoumeh Gasempour2Medical Education Research Center, Tabriz University of Medical Sciences, Tabriz, IranPediatric Health Research Center, Tabriz University of Medical Sciences, Tabriz, IranMedical Education Research Center, Tabriz University of Medical Sciences, Tabriz, IranIntroduction: Multiple-choice question tests are considered as one of the most common assessment methods, frequently used in university tests. This study examined the relationship between question taxonomy and negative stem questions in university pre-board tests in Tabriz University of Medical Sciences and national boards tests in internal medicine, general surgery, pediatrics and obstetrics and gynecology residency examination from 2010-2011. Methods: In this cross-sectional study, 2400 written multiple-choice questions related to the mentioned fields were studied in terms of the relationship between taxonomy levels of the questions and their stems. If there were a negative word or negative concept in the question body, it was considered a negative stem. Taxonomy was graded: taxonomy I, ability to remember facts, Taxonomy II, ability to interpret data and taxonomy III ability to solve a new problem. The data collected were analyzed by SPSS18. P-value<0.05 was considered significant. Results: A total of 2400 questions from 8 tests (board, pre-board) in 4 fields were studied. In total, 23.1% of pre-board tests and 16.6% of national board tests had negative stems and the difference was statistically significant (P=0.0001). In this study 31.1% of questions were designed with positive stems and 63.9% with negative stems in taxonomy level I(P=0.0001). There is a correlation between negative stem questions and their taxonomy. This means that 63.9% of negative stem and 31.1% of positive stem questions have been designed in taxonomy level I(P=0.0001). Conclusion: The use of negative stem questions considerably resulted in the design of low-level cognitive questions.http://journals.tbzmed.ac.ir/RDME/Manuscript/RDME-5-32.pdfMultiple- choice questionExamsNegative stemTaxonomy |
| spellingShingle | Mohammad Hasan Karegar Maher Mohammad Barzegar Masoumeh Gasempour The Relationship between Negative Stem and Taxonomy of Multiple-Choice Questions in Residency Pre-Board and Board Exams Research and Development in Medical Education Multiple- choice question Exams Negative stem Taxonomy |
| title | The Relationship between Negative Stem and Taxonomy of Multiple-Choice Questions in Residency Pre-Board and Board Exams |
| title_full | The Relationship between Negative Stem and Taxonomy of Multiple-Choice Questions in Residency Pre-Board and Board Exams |
| title_fullStr | The Relationship between Negative Stem and Taxonomy of Multiple-Choice Questions in Residency Pre-Board and Board Exams |
| title_full_unstemmed | The Relationship between Negative Stem and Taxonomy of Multiple-Choice Questions in Residency Pre-Board and Board Exams |
| title_short | The Relationship between Negative Stem and Taxonomy of Multiple-Choice Questions in Residency Pre-Board and Board Exams |
| title_sort | relationship between negative stem and taxonomy of multiple choice questions in residency pre board and board exams |
| topic | Multiple- choice question Exams Negative stem Taxonomy |
| url | http://journals.tbzmed.ac.ir/RDME/Manuscript/RDME-5-32.pdf |
| work_keys_str_mv | AT mohammadhasankaregarmaher therelationshipbetweennegativestemandtaxonomyofmultiplechoicequestionsinresidencypreboardandboardexams AT mohammadbarzegar therelationshipbetweennegativestemandtaxonomyofmultiplechoicequestionsinresidencypreboardandboardexams AT masoumehgasempour therelationshipbetweennegativestemandtaxonomyofmultiplechoicequestionsinresidencypreboardandboardexams AT mohammadhasankaregarmaher relationshipbetweennegativestemandtaxonomyofmultiplechoicequestionsinresidencypreboardandboardexams AT mohammadbarzegar relationshipbetweennegativestemandtaxonomyofmultiplechoicequestionsinresidencypreboardandboardexams AT masoumehgasempour relationshipbetweennegativestemandtaxonomyofmultiplechoicequestionsinresidencypreboardandboardexams |