Development of a shared item repository for progress testing in veterinary education
IntroductionProgress testing in education is an assessment principle for the measurement of students’ progress over time, e.g., from start to graduation. Progress testing offers valid longitudinal formative measurement of the growth in the cognitive skills of the individual students within the subje...
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Frontiers Media S.A.
2023-11-01
|
| Series: | Frontiers in Veterinary Science |
| Subjects: | |
| Online Access: | https://www.frontiersin.org/articles/10.3389/fvets.2023.1296514/full |
| _version_ | 1797641141228666880 |
|---|---|
| author | Elisabeth Schaper Theo van Haeften Jakob Wandall Jakob Wandall Antti Iivanainen Johanna Penell Charles McLean Press Pierre Lekeux Peter Holm |
| author_facet | Elisabeth Schaper Theo van Haeften Jakob Wandall Jakob Wandall Antti Iivanainen Johanna Penell Charles McLean Press Pierre Lekeux Peter Holm |
| author_sort | Elisabeth Schaper |
| collection | DOAJ |
| description | IntroductionProgress testing in education is an assessment principle for the measurement of students’ progress over time, e.g., from start to graduation. Progress testing offers valid longitudinal formative measurement of the growth in the cognitive skills of the individual students within the subjects of the test as well as a tool for educators to monitor potential educational gaps and mismatches within the curriculum in relation to the basic veterinary learning outcomes.MethodsSix veterinary educational establishments in Denmark, Finland, Germany (Hannover), the Netherlands, Norway, and Sweden established in cooperation with the European Association of Establishments for Veterinary Education (EAEVE) a common veterinary item repository that can be used for progress testing in European Veterinary Education Establishments (VEEs), linear as well as computer adaptive, covering the EAEVE veterinary subjects and theoretical “Day One Competencies.” First, a blueprint was created, suitable item formats were identified, and a quality assurance process for reviewing and approving items was established. The items were trialed to create a database of validated and calibrated items, and the responses were subsequently psychometrically analyzed according to Modern Test Theory.ResultsIn total, 1,836 items were submitted of which 1,342 were approved by the reviewers for trial testing. 1,119 students from all study years and all partners VEEs participated in one or more of six item trials, and 1,948 responses were collected. Responses were analyzed using Rasch Modeling (analysis of item-fit, differential item function, item-response characteristics). A total of 821 calibrated items of various difficulty levels matching the veterinary students’ abilities and covering the veterinary knowledge domains have been banked.DiscussionThe item bank is now ready to be used for formative progress testing in European veterinary education. This paper presents and discusses possible pitfalls, problems, and solutions when establishing an international veterinary progress test. |
| first_indexed | 2024-03-11T13:41:18Z |
| format | Article |
| id | doaj.art-5b915940f1864b6ab51a42396f11b7b3 |
| institution | Directory Open Access Journal |
| issn | 2297-1769 |
| language | English |
| last_indexed | 2024-03-11T13:41:18Z |
| publishDate | 2023-11-01 |
| publisher | Frontiers Media S.A. |
| record_format | Article |
| series | Frontiers in Veterinary Science |
| spelling | doaj.art-5b915940f1864b6ab51a42396f11b7b32023-11-02T11:44:25ZengFrontiers Media S.A.Frontiers in Veterinary Science2297-17692023-11-011010.3389/fvets.2023.12965141296514Development of a shared item repository for progress testing in veterinary educationElisabeth Schaper0Theo van Haeften1Jakob Wandall2Jakob Wandall3Antti Iivanainen4Johanna Penell5Charles McLean Press6Pierre Lekeux7Peter Holm8Centre for E-learning, Didactics and Educational Research, University of Veterinary Medicine Hannover, Foundation, Hannover, GermanyDepartment of Biomolecular Health Sciences, Faculty of Veterinary Medicine & Centre for Academic Teaching and Learning, Utrecht University, Utrecht, NetherlandsNordicMetrics Aps, Copenhagen, DenmarkDepartment of Veterinary and Animal Sciences, Faculty of Health and Medical Sciences, University of Copenhagen, Frederiksberg, DenmarkDepartment of Veterinary Biosciences, Faculty of Veterinary Medicine, University of Helsinki, Helsinki, FinlandDepartment of Clinical Sciences, Faculty of Veterinary Medicine and Animal Science, Swedish University of Agricultural Sciences, Uppsala, SwedenDepartment of Preclinical Sciences and Pathology, Faculty of Veterinary Medicine, Norwegian University of Life Sciences, Aas, NorwayEuropean Association of Establishments for Veterinary Education (EAEVE), Vienna, AustriaDepartment of Veterinary and Animal Sciences, Faculty of Health and Medical Sciences, University of Copenhagen, Frederiksberg, DenmarkIntroductionProgress testing in education is an assessment principle for the measurement of students’ progress over time, e.g., from start to graduation. Progress testing offers valid longitudinal formative measurement of the growth in the cognitive skills of the individual students within the subjects of the test as well as a tool for educators to monitor potential educational gaps and mismatches within the curriculum in relation to the basic veterinary learning outcomes.MethodsSix veterinary educational establishments in Denmark, Finland, Germany (Hannover), the Netherlands, Norway, and Sweden established in cooperation with the European Association of Establishments for Veterinary Education (EAEVE) a common veterinary item repository that can be used for progress testing in European Veterinary Education Establishments (VEEs), linear as well as computer adaptive, covering the EAEVE veterinary subjects and theoretical “Day One Competencies.” First, a blueprint was created, suitable item formats were identified, and a quality assurance process for reviewing and approving items was established. The items were trialed to create a database of validated and calibrated items, and the responses were subsequently psychometrically analyzed according to Modern Test Theory.ResultsIn total, 1,836 items were submitted of which 1,342 were approved by the reviewers for trial testing. 1,119 students from all study years and all partners VEEs participated in one or more of six item trials, and 1,948 responses were collected. Responses were analyzed using Rasch Modeling (analysis of item-fit, differential item function, item-response characteristics). A total of 821 calibrated items of various difficulty levels matching the veterinary students’ abilities and covering the veterinary knowledge domains have been banked.DiscussionThe item bank is now ready to be used for formative progress testing in European veterinary education. This paper presents and discusses possible pitfalls, problems, and solutions when establishing an international veterinary progress test.https://www.frontiersin.org/articles/10.3389/fvets.2023.1296514/fullProgress testingEuropean veterinary educationveterinary item repositoryquality assuranceitem writingday one competencies |
| spellingShingle | Elisabeth Schaper Theo van Haeften Jakob Wandall Jakob Wandall Antti Iivanainen Johanna Penell Charles McLean Press Pierre Lekeux Peter Holm Development of a shared item repository for progress testing in veterinary education Frontiers in Veterinary Science Progress testing European veterinary education veterinary item repository quality assurance item writing day one competencies |
| title | Development of a shared item repository for progress testing in veterinary education |
| title_full | Development of a shared item repository for progress testing in veterinary education |
| title_fullStr | Development of a shared item repository for progress testing in veterinary education |
| title_full_unstemmed | Development of a shared item repository for progress testing in veterinary education |
| title_short | Development of a shared item repository for progress testing in veterinary education |
| title_sort | development of a shared item repository for progress testing in veterinary education |
| topic | Progress testing European veterinary education veterinary item repository quality assurance item writing day one competencies |
| url | https://www.frontiersin.org/articles/10.3389/fvets.2023.1296514/full |
| work_keys_str_mv | AT elisabethschaper developmentofashareditemrepositoryforprogresstestinginveterinaryeducation AT theovanhaeften developmentofashareditemrepositoryforprogresstestinginveterinaryeducation AT jakobwandall developmentofashareditemrepositoryforprogresstestinginveterinaryeducation AT jakobwandall developmentofashareditemrepositoryforprogresstestinginveterinaryeducation AT anttiiivanainen developmentofashareditemrepositoryforprogresstestinginveterinaryeducation AT johannapenell developmentofashareditemrepositoryforprogresstestinginveterinaryeducation AT charlesmcleanpress developmentofashareditemrepositoryforprogresstestinginveterinaryeducation AT pierrelekeux developmentofashareditemrepositoryforprogresstestinginveterinaryeducation AT peterholm developmentofashareditemrepositoryforprogresstestinginveterinaryeducation |