Comparison of the level of cognitive processing between case-based items and non-case-based items on the Interuniversity Progress Test of Medicine in the Netherlands
Purpose It is assumed that case-based questions require higher-order cognitive processing, whereas questions that are not case-based require lower-order cognitive processing. In this study, we investigated to what extent case-based and non-case-based questions followed this assumption based on Bloom...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Korea Health Personnel Licensing Examination Institute
2018-12-01
|
| Series: | Journal of Educational Evaluation for Health Professions |
| Subjects: | |
| Online Access: | http://www.jeehp.org/upload/jeehp-15-28.pdf |
| _version_ | 1797721531105673216 |
|---|---|
| author | Dario Cecilio-Fernandes Wouter Kerdijk Andreas Johannes Bremers Wytze Aalders René Anton Tio |
| author_facet | Dario Cecilio-Fernandes Wouter Kerdijk Andreas Johannes Bremers Wytze Aalders René Anton Tio |
| author_sort | Dario Cecilio-Fernandes |
| collection | DOAJ |
| description | Purpose It is assumed that case-based questions require higher-order cognitive processing, whereas questions that are not case-based require lower-order cognitive processing. In this study, we investigated to what extent case-based and non-case-based questions followed this assumption based on Bloom’s taxonomy. Methods In this article, 4,800 questions from the Interuniversity Progress Test of Medicine were classified based on whether they were case-based and on the level of Bloom’s taxonomy that they involved. Lower-order questions require students to remember or/and have a basic understanding of knowledge. Higher-order questions require students to apply, analyze, or/and evaluate. The phi coefficient was calculated to investigate the relationship between whether questions were case-based and the required level of cognitive processing. Results Our results demonstrated that 98.1% of case-based questions required higher-level cognitive processing. Of the non-case-based questions, 33.7% required higher-level cognitive processing. The phi coefficient demonstrated a significant, but moderate correlation between the presence of a patient case in a question and its required level of cognitive processing (phi coefficient= 0.55, P< 0.001). Conclusion Medical instructors should be aware of the association between item format (case-based versus non-case-based) and the cognitive processes they elicit in order to meet the desired balance in a test, taking the learning objectives and the test difficulty into account. |
| first_indexed | 2024-03-12T09:34:36Z |
| format | Article |
| id | doaj.art-e32284387b7f452ca5758f8ae491d158 |
| institution | Directory Open Access Journal |
| issn | 1975-5937 |
| language | English |
| last_indexed | 2024-03-12T09:34:36Z |
| publishDate | 2018-12-01 |
| publisher | Korea Health Personnel Licensing Examination Institute |
| record_format | Article |
| series | Journal of Educational Evaluation for Health Professions |
| spelling | doaj.art-e32284387b7f452ca5758f8ae491d1582023-09-02T13:48:02ZengKorea Health Personnel Licensing Examination InstituteJournal of Educational Evaluation for Health Professions1975-59372018-12-011510.3352/jeehp.2018.15.28298Comparison of the level of cognitive processing between case-based items and non-case-based items on the Interuniversity Progress Test of Medicine in the NetherlandsDario Cecilio-Fernandes0Wouter Kerdijk1Andreas Johannes Bremers2Wytze Aalders3René Anton Tio4Center for Education Development and Research in Health Professions (CEDAR), Research Group LEARN, University Medical Center Groningen, University of Groningen, Groningen, The NetherlandsDepartment of Education and Research, Hanze University of Applied Sciences, Groningen, The NetherlandsDepartment of Surgery, Radboud University Nijmegen Medical Center, Nijmegen, The NetherlandsCenter for Education Development and Research in Health Professions (CEDAR), Research Group LEARN, University Medical Center Groningen, University of Groningen, Groningen, The NetherlandsDepartment of Cardiology, Catharina Hospital, Eindhoven, The NetherlandsPurpose It is assumed that case-based questions require higher-order cognitive processing, whereas questions that are not case-based require lower-order cognitive processing. In this study, we investigated to what extent case-based and non-case-based questions followed this assumption based on Bloom’s taxonomy. Methods In this article, 4,800 questions from the Interuniversity Progress Test of Medicine were classified based on whether they were case-based and on the level of Bloom’s taxonomy that they involved. Lower-order questions require students to remember or/and have a basic understanding of knowledge. Higher-order questions require students to apply, analyze, or/and evaluate. The phi coefficient was calculated to investigate the relationship between whether questions were case-based and the required level of cognitive processing. Results Our results demonstrated that 98.1% of case-based questions required higher-level cognitive processing. Of the non-case-based questions, 33.7% required higher-level cognitive processing. The phi coefficient demonstrated a significant, but moderate correlation between the presence of a patient case in a question and its required level of cognitive processing (phi coefficient= 0.55, P< 0.001). Conclusion Medical instructors should be aware of the association between item format (case-based versus non-case-based) and the cognitive processes they elicit in order to meet the desired balance in a test, taking the learning objectives and the test difficulty into account.http://www.jeehp.org/upload/jeehp-15-28.pdfeducational assessmenteducational measurementmedical educationprogress testnetherlands |
| spellingShingle | Dario Cecilio-Fernandes Wouter Kerdijk Andreas Johannes Bremers Wytze Aalders René Anton Tio Comparison of the level of cognitive processing between case-based items and non-case-based items on the Interuniversity Progress Test of Medicine in the Netherlands Journal of Educational Evaluation for Health Professions educational assessment educational measurement medical education progress test netherlands |
| title | Comparison of the level of cognitive processing between case-based items and non-case-based items on the Interuniversity Progress Test of Medicine in the Netherlands |
| title_full | Comparison of the level of cognitive processing between case-based items and non-case-based items on the Interuniversity Progress Test of Medicine in the Netherlands |
| title_fullStr | Comparison of the level of cognitive processing between case-based items and non-case-based items on the Interuniversity Progress Test of Medicine in the Netherlands |
| title_full_unstemmed | Comparison of the level of cognitive processing between case-based items and non-case-based items on the Interuniversity Progress Test of Medicine in the Netherlands |
| title_short | Comparison of the level of cognitive processing between case-based items and non-case-based items on the Interuniversity Progress Test of Medicine in the Netherlands |
| title_sort | comparison of the level of cognitive processing between case based items and non case based items on the interuniversity progress test of medicine in the netherlands |
| topic | educational assessment educational measurement medical education progress test netherlands |
| url | http://www.jeehp.org/upload/jeehp-15-28.pdf |
| work_keys_str_mv | AT darioceciliofernandes comparisonofthelevelofcognitiveprocessingbetweencasebaseditemsandnoncasebaseditemsontheinteruniversityprogresstestofmedicineinthenetherlands AT wouterkerdijk comparisonofthelevelofcognitiveprocessingbetweencasebaseditemsandnoncasebaseditemsontheinteruniversityprogresstestofmedicineinthenetherlands AT andreasjohannesbremers comparisonofthelevelofcognitiveprocessingbetweencasebaseditemsandnoncasebaseditemsontheinteruniversityprogresstestofmedicineinthenetherlands AT wytzeaalders comparisonofthelevelofcognitiveprocessingbetweencasebaseditemsandnoncasebaseditemsontheinteruniversityprogresstestofmedicineinthenetherlands AT reneantontio comparisonofthelevelofcognitiveprocessingbetweencasebaseditemsandnoncasebaseditemsontheinteruniversityprogresstestofmedicineinthenetherlands |