Patients don’t come with multiple choice options: essay-based assessment in UME

Curricular revision efforts have resulted in learner-centered programs that value content integration and active learning. Yet, less attention has been placed on assessment methods that are learner-centered and promote assessment for learning. The use of context rich short answer question (CR-SAQ) e...

Full description

Bibliographic Details
Main Authors: Jeffrey B. Bird, Doreen M. Olvet, Joanne M. Willey, Judith Brenner
Format: Article
Language:English
Published: Taylor & Francis Group 2019-01-01
Series:Medical Education Online
Subjects:
Online Access:http://dx.doi.org/10.1080/10872981.2019.1649959
_version_ 1818191638046965760
author Jeffrey B. Bird
Doreen M. Olvet
Joanne M. Willey
Judith Brenner
author_facet Jeffrey B. Bird
Doreen M. Olvet
Joanne M. Willey
Judith Brenner
author_sort Jeffrey B. Bird
collection DOAJ
description Curricular revision efforts have resulted in learner-centered programs that value content integration and active learning. Yet, less attention has been placed on assessment methods that are learner-centered and promote assessment for learning. The use of context rich short answer question (CR-SAQ) exams in the preclinical years of medical school was evaluated to determine if this format aligns with the criteria for assessment for learning. Medical students and preclinical faculty members were sent a survey comprised of closed and open-ended questions about their experience using CR-SAQ exams. Data were analyzed using a mixed-method design. Open-ended responses were evaluated using thematic analysis within the framework of criteria for assessment for learning. A total of 274 students (94%) and 24 faculty (75%) completed the survey. Fifty four percent of students reported preferring a CR-SAQ exam format over multiple choice questions (MCQ) format. Quantitative data and qualitative comments by students supported that CR-SAQ exams aligned with criteria for assessment for learning, including acceptability, authenticity, educational effect, and the cueing effect. Student concerns included preparation for USMLE Step 1 exam, as well as the validity and reproducibility of CR-SAQ assessments. Faculty largely agreed with the benefits of the CR-SAQ, but were concerned about feasibility, acceptability and reproducibility. The CR-SAQ exam format assessment strategy supports assessment for learning in an undergraduate medical education setting. Both benefits and drawbacks of this method are presented, however students and faculty describe a broader impact that this assessment method has on their development as a physician.
first_indexed 2024-12-12T00:17:47Z
format Article
id doaj.art-dd671c7675c346439731b7ab44101ba8
institution Directory Open Access Journal
issn 1087-2981
language English
last_indexed 2024-12-12T00:17:47Z
publishDate 2019-01-01
publisher Taylor & Francis Group
record_format Article
series Medical Education Online
spelling doaj.art-dd671c7675c346439731b7ab44101ba82022-12-22T00:44:49ZengTaylor & Francis GroupMedical Education Online1087-29812019-01-0124110.1080/10872981.2019.16499591649959Patients don’t come with multiple choice options: essay-based assessment in UMEJeffrey B. Bird0Doreen M. Olvet1Joanne M. Willey2Judith Brenner3Donald and Barbara Zucker School of Medicine at Hofstra/NorthwellDonald and Barbara Zucker School of Medicine at Hofstra/NorthwellDonald and Barbara Zucker School of Medicine at Hofstra/NorthwellZucker School of Medicine at Hofstra/NorthwellCurricular revision efforts have resulted in learner-centered programs that value content integration and active learning. Yet, less attention has been placed on assessment methods that are learner-centered and promote assessment for learning. The use of context rich short answer question (CR-SAQ) exams in the preclinical years of medical school was evaluated to determine if this format aligns with the criteria for assessment for learning. Medical students and preclinical faculty members were sent a survey comprised of closed and open-ended questions about their experience using CR-SAQ exams. Data were analyzed using a mixed-method design. Open-ended responses were evaluated using thematic analysis within the framework of criteria for assessment for learning. A total of 274 students (94%) and 24 faculty (75%) completed the survey. Fifty four percent of students reported preferring a CR-SAQ exam format over multiple choice questions (MCQ) format. Quantitative data and qualitative comments by students supported that CR-SAQ exams aligned with criteria for assessment for learning, including acceptability, authenticity, educational effect, and the cueing effect. Student concerns included preparation for USMLE Step 1 exam, as well as the validity and reproducibility of CR-SAQ assessments. Faculty largely agreed with the benefits of the CR-SAQ, but were concerned about feasibility, acceptability and reproducibility. The CR-SAQ exam format assessment strategy supports assessment for learning in an undergraduate medical education setting. Both benefits and drawbacks of this method are presented, however students and faculty describe a broader impact that this assessment method has on their development as a physician.http://dx.doi.org/10.1080/10872981.2019.1649959assessmentintegrated curriculumundergraduate medical education
spellingShingle Jeffrey B. Bird
Doreen M. Olvet
Joanne M. Willey
Judith Brenner
Patients don’t come with multiple choice options: essay-based assessment in UME
Medical Education Online
assessment
integrated curriculum
undergraduate medical education
title Patients don’t come with multiple choice options: essay-based assessment in UME
title_full Patients don’t come with multiple choice options: essay-based assessment in UME
title_fullStr Patients don’t come with multiple choice options: essay-based assessment in UME
title_full_unstemmed Patients don’t come with multiple choice options: essay-based assessment in UME
title_short Patients don’t come with multiple choice options: essay-based assessment in UME
title_sort patients don t come with multiple choice options essay based assessment in ume
topic assessment
integrated curriculum
undergraduate medical education
url http://dx.doi.org/10.1080/10872981.2019.1649959
work_keys_str_mv AT jeffreybbird patientsdontcomewithmultiplechoiceoptionsessaybasedassessmentinume
AT doreenmolvet patientsdontcomewithmultiplechoiceoptionsessaybasedassessmentinume
AT joannemwilley patientsdontcomewithmultiplechoiceoptionsessaybasedassessmentinume
AT judithbrenner patientsdontcomewithmultiplechoiceoptionsessaybasedassessmentinume