Changing the culture of assessment: the dominance of the summative assessment paradigm

Abstract Background Despite growing evidence of the benefits of including assessment for learning strategies within programmes of assessment, practical implementation of these approaches is often problematical. Organisational culture change is often hindered by personal and collective beliefs which...

Full description

Bibliographic Details
Main Authors: Christopher J. Harrison, Karen D. Könings, Lambert W. T. Schuwirth, Valerie Wass, Cees P. M. van der Vleuten
Format: Article
Language:English
Published: BMC 2017-04-01
Series:BMC Medical Education
Subjects:
Online Access:http://link.springer.com/article/10.1186/s12909-017-0912-5
_version_ 1818253923861921792
author Christopher J. Harrison
Karen D. Könings
Lambert W. T. Schuwirth
Valerie Wass
Cees P. M. van der Vleuten
author_facet Christopher J. Harrison
Karen D. Könings
Lambert W. T. Schuwirth
Valerie Wass
Cees P. M. van der Vleuten
author_sort Christopher J. Harrison
collection DOAJ
description Abstract Background Despite growing evidence of the benefits of including assessment for learning strategies within programmes of assessment, practical implementation of these approaches is often problematical. Organisational culture change is often hindered by personal and collective beliefs which encourage adherence to the existing organisational paradigm. We aimed to explore how these beliefs influenced proposals to redesign a summative assessment culture in order to improve students’ use of assessment-related feedback. Methods Using the principles of participatory design, a mixed group comprising medical students, clinical teachers and senior faculty members was challenged to develop radical solutions to improve the use of post-assessment feedback. Follow-up interviews were conducted with individual members of the group to explore their personal beliefs about the proposed redesign. Data were analysed using a socio-cultural lens. Results Proposed changes were dominated by a shared belief in the primacy of the summative assessment paradigm, which prevented radical redesign solutions from being accepted by group members. Participants’ prior assessment experiences strongly influenced proposals for change. As participants had largely only experienced a summative assessment culture, they found it difficult to conceptualise radical change in the assessment culture. Although all group members participated, students were less successful at persuading the group to adopt their ideas. Faculty members and clinical teachers often used indirect techniques to close down discussions. The strength of individual beliefs became more apparent in the follow-up interviews. Conclusions Naïve epistemologies and prior personal experiences were influential in the assessment redesign but were usually not expressed explicitly in a group setting, perhaps because of cultural conventions of politeness. In order to successfully implement a change in assessment culture, firmly-held intuitive beliefs about summative assessment will need to be clearly understood as a first step.
first_indexed 2024-12-12T16:47:47Z
format Article
id doaj.art-9a606687e2694903b90da404c7a8a2dd
institution Directory Open Access Journal
issn 1472-6920
language English
last_indexed 2024-12-12T16:47:47Z
publishDate 2017-04-01
publisher BMC
record_format Article
series BMC Medical Education
spelling doaj.art-9a606687e2694903b90da404c7a8a2dd2022-12-22T00:18:26ZengBMCBMC Medical Education1472-69202017-04-0117111410.1186/s12909-017-0912-5Changing the culture of assessment: the dominance of the summative assessment paradigmChristopher J. Harrison0Karen D. Könings1Lambert W. T. Schuwirth2Valerie Wass3Cees P. M. van der Vleuten4Keele University School of MedicineFaculty of Health, Medicine and Life Sciences, Maastricht University of MaastrichtFlinders Medical SchoolKeele University School of MedicineFaculty of Health, Medicine and Life Sciences, Maastricht University of MaastrichtAbstract Background Despite growing evidence of the benefits of including assessment for learning strategies within programmes of assessment, practical implementation of these approaches is often problematical. Organisational culture change is often hindered by personal and collective beliefs which encourage adherence to the existing organisational paradigm. We aimed to explore how these beliefs influenced proposals to redesign a summative assessment culture in order to improve students’ use of assessment-related feedback. Methods Using the principles of participatory design, a mixed group comprising medical students, clinical teachers and senior faculty members was challenged to develop radical solutions to improve the use of post-assessment feedback. Follow-up interviews were conducted with individual members of the group to explore their personal beliefs about the proposed redesign. Data were analysed using a socio-cultural lens. Results Proposed changes were dominated by a shared belief in the primacy of the summative assessment paradigm, which prevented radical redesign solutions from being accepted by group members. Participants’ prior assessment experiences strongly influenced proposals for change. As participants had largely only experienced a summative assessment culture, they found it difficult to conceptualise radical change in the assessment culture. Although all group members participated, students were less successful at persuading the group to adopt their ideas. Faculty members and clinical teachers often used indirect techniques to close down discussions. The strength of individual beliefs became more apparent in the follow-up interviews. Conclusions Naïve epistemologies and prior personal experiences were influential in the assessment redesign but were usually not expressed explicitly in a group setting, perhaps because of cultural conventions of politeness. In order to successfully implement a change in assessment culture, firmly-held intuitive beliefs about summative assessment will need to be clearly understood as a first step.http://link.springer.com/article/10.1186/s12909-017-0912-5FeedbackSummative assessmentProgrammatic assessment
spellingShingle Christopher J. Harrison
Karen D. Könings
Lambert W. T. Schuwirth
Valerie Wass
Cees P. M. van der Vleuten
Changing the culture of assessment: the dominance of the summative assessment paradigm
BMC Medical Education
Feedback
Summative assessment
Programmatic assessment
title Changing the culture of assessment: the dominance of the summative assessment paradigm
title_full Changing the culture of assessment: the dominance of the summative assessment paradigm
title_fullStr Changing the culture of assessment: the dominance of the summative assessment paradigm
title_full_unstemmed Changing the culture of assessment: the dominance of the summative assessment paradigm
title_short Changing the culture of assessment: the dominance of the summative assessment paradigm
title_sort changing the culture of assessment the dominance of the summative assessment paradigm
topic Feedback
Summative assessment
Programmatic assessment
url http://link.springer.com/article/10.1186/s12909-017-0912-5
work_keys_str_mv AT christopherjharrison changingthecultureofassessmentthedominanceofthesummativeassessmentparadigm
AT karendkonings changingthecultureofassessmentthedominanceofthesummativeassessmentparadigm
AT lambertwtschuwirth changingthecultureofassessmentthedominanceofthesummativeassessmentparadigm
AT valeriewass changingthecultureofassessmentthedominanceofthesummativeassessmentparadigm
AT ceespmvandervleuten changingthecultureofassessmentthedominanceofthesummativeassessmentparadigm