Longitudinal assessment of competency development at The Ohio State University using the competency-based veterinary education (CBVE) model
With the development of the American Association of Veterinary Medical Colleges' Competency-Based Veterinary Education (CBVE) model, veterinary schools are reorganizing curricula and assessment guidelines, especially within the clinical rotation training elements. Specifically, programs are uti...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Frontiers Media S.A.
2022-10-01
|
| Series: | Frontiers in Veterinary Science |
| Subjects: | |
| Online Access: | https://www.frontiersin.org/articles/10.3389/fvets.2022.1019305/full |
| _version_ | 1797985914082820096 |
|---|---|
| author | Emma K. Read Connor Maxey Kent G. Hecker Kent G. Hecker |
| author_facet | Emma K. Read Connor Maxey Kent G. Hecker Kent G. Hecker |
| author_sort | Emma K. Read |
| collection | DOAJ |
| description | With the development of the American Association of Veterinary Medical Colleges' Competency-Based Veterinary Education (CBVE) model, veterinary schools are reorganizing curricula and assessment guidelines, especially within the clinical rotation training elements. Specifically, programs are utilizing both competencies and entrustable professional activities (EPAs) as opportunities for gathering information about student development within and across clinical rotations. However, what evidence exists that use of the central tenets of the CBVE model (competency framework, milestones and EPAs) improves our assessment practices and captures reliable and valid data to track competency development of students as they progress through their clinical year? Here, we report on validity evidence to support the use of scores from in-training evaluation report forms (ITERs) and workplace-based assessments of EPAs to evaluate competency progression within and across domains described in the CBVE, during the final year clinical training period of The Ohio State University's College of Veterinary Medicine (OSU-CVM) program. The ITER, used at the conclusion of each rotation, was modified to include the CBVE competencies that were assessed by identifying the stage of student development on a series of descriptive milestones (from pre-novice to competent). Workplace based assessments containing entrustment scales were used to assess EPAs from the CBVE model within each clinical rotation. Competency progression and entrustment scores were evaluated on each of the 31 rotations offered and high-stakes decisions regarding student performance were determined by a collective review of all the ITERs and EPAs recorded for each learner across each semester and the entire year. Results from the class of 2021, collected on approximately 190 students from 31 rotations, are reported with more than 55 299 total competency assessments combined with milestone placement and 2799 complete EPAs. Approximately 10% of the class was identified for remediation and received additional coaching support. Data collected longitudinally through the ITER on milestones provides initial validity evidence to support using the scores in higher stakes contexts such as identifying students for remediation and for determining whether students have met the necessary requirements to successfully complete the program. Data collected on entrustment scores did not, however, support such decision making. Implications are discussed. |
| first_indexed | 2024-04-11T07:25:23Z |
| format | Article |
| id | doaj.art-626d946958654390bc983f5f0abd4df5 |
| institution | Directory Open Access Journal |
| issn | 2297-1769 |
| language | English |
| last_indexed | 2024-04-11T07:25:23Z |
| publishDate | 2022-10-01 |
| publisher | Frontiers Media S.A. |
| record_format | Article |
| series | Frontiers in Veterinary Science |
| spelling | doaj.art-626d946958654390bc983f5f0abd4df52022-12-22T04:37:05ZengFrontiers Media S.A.Frontiers in Veterinary Science2297-17692022-10-01910.3389/fvets.2022.10193051019305Longitudinal assessment of competency development at The Ohio State University using the competency-based veterinary education (CBVE) modelEmma K. Read0Connor Maxey1Kent G. Hecker2Kent G. Hecker3College of Veterinary Medicine, The Ohio State University, Columbus, OH, United StatesFaculty of Veterinary Medicine, University of Calgary, Calgary, AB, CanadaFaculty of Veterinary Medicine, University of Calgary, Calgary, AB, CanadaInternational Council for Veterinary Assessment, Bismarck, ND, United StatesWith the development of the American Association of Veterinary Medical Colleges' Competency-Based Veterinary Education (CBVE) model, veterinary schools are reorganizing curricula and assessment guidelines, especially within the clinical rotation training elements. Specifically, programs are utilizing both competencies and entrustable professional activities (EPAs) as opportunities for gathering information about student development within and across clinical rotations. However, what evidence exists that use of the central tenets of the CBVE model (competency framework, milestones and EPAs) improves our assessment practices and captures reliable and valid data to track competency development of students as they progress through their clinical year? Here, we report on validity evidence to support the use of scores from in-training evaluation report forms (ITERs) and workplace-based assessments of EPAs to evaluate competency progression within and across domains described in the CBVE, during the final year clinical training period of The Ohio State University's College of Veterinary Medicine (OSU-CVM) program. The ITER, used at the conclusion of each rotation, was modified to include the CBVE competencies that were assessed by identifying the stage of student development on a series of descriptive milestones (from pre-novice to competent). Workplace based assessments containing entrustment scales were used to assess EPAs from the CBVE model within each clinical rotation. Competency progression and entrustment scores were evaluated on each of the 31 rotations offered and high-stakes decisions regarding student performance were determined by a collective review of all the ITERs and EPAs recorded for each learner across each semester and the entire year. Results from the class of 2021, collected on approximately 190 students from 31 rotations, are reported with more than 55 299 total competency assessments combined with milestone placement and 2799 complete EPAs. Approximately 10% of the class was identified for remediation and received additional coaching support. Data collected longitudinally through the ITER on milestones provides initial validity evidence to support using the scores in higher stakes contexts such as identifying students for remediation and for determining whether students have met the necessary requirements to successfully complete the program. Data collected on entrustment scores did not, however, support such decision making. Implications are discussed.https://www.frontiersin.org/articles/10.3389/fvets.2022.1019305/fulllongitudinal assessmentITERin-training evaluation reportEPAentrustable professional activityentrustment |
| spellingShingle | Emma K. Read Connor Maxey Kent G. Hecker Kent G. Hecker Longitudinal assessment of competency development at The Ohio State University using the competency-based veterinary education (CBVE) model Frontiers in Veterinary Science longitudinal assessment ITER in-training evaluation report EPA entrustable professional activity entrustment |
| title | Longitudinal assessment of competency development at The Ohio State University using the competency-based veterinary education (CBVE) model |
| title_full | Longitudinal assessment of competency development at The Ohio State University using the competency-based veterinary education (CBVE) model |
| title_fullStr | Longitudinal assessment of competency development at The Ohio State University using the competency-based veterinary education (CBVE) model |
| title_full_unstemmed | Longitudinal assessment of competency development at The Ohio State University using the competency-based veterinary education (CBVE) model |
| title_short | Longitudinal assessment of competency development at The Ohio State University using the competency-based veterinary education (CBVE) model |
| title_sort | longitudinal assessment of competency development at the ohio state university using the competency based veterinary education cbve model |
| topic | longitudinal assessment ITER in-training evaluation report EPA entrustable professional activity entrustment |
| url | https://www.frontiersin.org/articles/10.3389/fvets.2022.1019305/full |
| work_keys_str_mv | AT emmakread longitudinalassessmentofcompetencydevelopmentattheohiostateuniversityusingthecompetencybasedveterinaryeducationcbvemodel AT connormaxey longitudinalassessmentofcompetencydevelopmentattheohiostateuniversityusingthecompetencybasedveterinaryeducationcbvemodel AT kentghecker longitudinalassessmentofcompetencydevelopmentattheohiostateuniversityusingthecompetencybasedveterinaryeducationcbvemodel AT kentghecker longitudinalassessmentofcompetencydevelopmentattheohiostateuniversityusingthecompetencybasedveterinaryeducationcbvemodel |