Locally adapting generic rubrics for the implementation of outcome-based medical education: a mixed-methods approach
Abstract Background Rubrics are frequently used to assess competencies in outcome-based medical education (OBE). The implementation of assessment systems using rubrics is usually realised through years of involvement in projects with various stakeholders. However, for countries or specialities new t...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
BMC
2022-04-01
|
| Series: | BMC Medical Education |
| Subjects: | |
| Online Access: | https://doi.org/10.1186/s12909-022-03352-4 |
| _version_ | 1818050975159549952 |
|---|---|
| author | Takeshi Kondo Hiroshi Nishigori Cees van der Vleuten |
| author_facet | Takeshi Kondo Hiroshi Nishigori Cees van der Vleuten |
| author_sort | Takeshi Kondo |
| collection | DOAJ |
| description | Abstract Background Rubrics are frequently used to assess competencies in outcome-based medical education (OBE). The implementation of assessment systems using rubrics is usually realised through years of involvement in projects with various stakeholders. However, for countries or specialities new to OBE, faster and more simplified processes are required. In March 2019, Japan introduced nine competencies and generic rubrics of competencies for medical residents. We explored the local adaptation of these generic rubrics and its consequences for assessors. Methods The study followed three steps. First, we locally adapted the generic rubrics. This was followed by conducting mixed-method research to explore the effect of the local adaptation. In step two, we examined the correlations between the scores in the locally adapted assessment sheets for supervising doctors and generic rubrics. In step three, we conducted interviews with supervising doctors. The study was conducted in the General Internal Medicine Department of Nagoya University, Japan. In the first step, doctors in the Medical Education Center and other medical departments, clerks, and residents participated. Supervising doctors in the General Internal Medicine Department participated in the second and third steps. Results A locally adapted assessment system was developed and implemented in seven months. The scores of the generic rubrics and the adapted assessment tool completed by the supervising doctors showed good correlations in some items as opposed to others, assessed mainly with other tools. Participant interviews revealed that local adaptation decreased their cognitive load leading to consistent ratings, increased writing of comments, and promoting reflection on instruction. Conclusions This adaptation process is a feasible way to begin the implementation of OBE. Local adaptation has advantages over direct use of generic rubrics. |
| first_indexed | 2024-12-10T11:02:00Z |
| format | Article |
| id | doaj.art-2922e778db9b406ea68d1d327b138ce5 |
| institution | Directory Open Access Journal |
| issn | 1472-6920 |
| language | English |
| last_indexed | 2024-12-10T11:02:00Z |
| publishDate | 2022-04-01 |
| publisher | BMC |
| record_format | Article |
| series | BMC Medical Education |
| spelling | doaj.art-2922e778db9b406ea68d1d327b138ce52022-12-22T01:51:39ZengBMCBMC Medical Education1472-69202022-04-0122111010.1186/s12909-022-03352-4Locally adapting generic rubrics for the implementation of outcome-based medical education: a mixed-methods approachTakeshi Kondo0Hiroshi Nishigori1Cees van der Vleuten2Center for Postgraduate Clinical Training and Career Development, Nagoya University HospitalCenter for Postgraduate Clinical Training and Career Development, Nagoya University HospitalSchool of Health Professions Education, Department of Educational Development and Research, Maastricht UniversityAbstract Background Rubrics are frequently used to assess competencies in outcome-based medical education (OBE). The implementation of assessment systems using rubrics is usually realised through years of involvement in projects with various stakeholders. However, for countries or specialities new to OBE, faster and more simplified processes are required. In March 2019, Japan introduced nine competencies and generic rubrics of competencies for medical residents. We explored the local adaptation of these generic rubrics and its consequences for assessors. Methods The study followed three steps. First, we locally adapted the generic rubrics. This was followed by conducting mixed-method research to explore the effect of the local adaptation. In step two, we examined the correlations between the scores in the locally adapted assessment sheets for supervising doctors and generic rubrics. In step three, we conducted interviews with supervising doctors. The study was conducted in the General Internal Medicine Department of Nagoya University, Japan. In the first step, doctors in the Medical Education Center and other medical departments, clerks, and residents participated. Supervising doctors in the General Internal Medicine Department participated in the second and third steps. Results A locally adapted assessment system was developed and implemented in seven months. The scores of the generic rubrics and the adapted assessment tool completed by the supervising doctors showed good correlations in some items as opposed to others, assessed mainly with other tools. Participant interviews revealed that local adaptation decreased their cognitive load leading to consistent ratings, increased writing of comments, and promoting reflection on instruction. Conclusions This adaptation process is a feasible way to begin the implementation of OBE. Local adaptation has advantages over direct use of generic rubrics.https://doi.org/10.1186/s12909-022-03352-4Local adaptation of rubricsOutcome-based educationPostgraduate education |
| spellingShingle | Takeshi Kondo Hiroshi Nishigori Cees van der Vleuten Locally adapting generic rubrics for the implementation of outcome-based medical education: a mixed-methods approach BMC Medical Education Local adaptation of rubrics Outcome-based education Postgraduate education |
| title | Locally adapting generic rubrics for the implementation of outcome-based medical education: a mixed-methods approach |
| title_full | Locally adapting generic rubrics for the implementation of outcome-based medical education: a mixed-methods approach |
| title_fullStr | Locally adapting generic rubrics for the implementation of outcome-based medical education: a mixed-methods approach |
| title_full_unstemmed | Locally adapting generic rubrics for the implementation of outcome-based medical education: a mixed-methods approach |
| title_short | Locally adapting generic rubrics for the implementation of outcome-based medical education: a mixed-methods approach |
| title_sort | locally adapting generic rubrics for the implementation of outcome based medical education a mixed methods approach |
| topic | Local adaptation of rubrics Outcome-based education Postgraduate education |
| url | https://doi.org/10.1186/s12909-022-03352-4 |
| work_keys_str_mv | AT takeshikondo locallyadaptinggenericrubricsfortheimplementationofoutcomebasedmedicaleducationamixedmethodsapproach AT hiroshinishigori locallyadaptinggenericrubricsfortheimplementationofoutcomebasedmedicaleducationamixedmethodsapproach AT ceesvandervleuten locallyadaptinggenericrubricsfortheimplementationofoutcomebasedmedicaleducationamixedmethodsapproach |