Using the multiple mini interview as an assessment strategy within the first year of a health professions curriculum
Abstract Background The multiple mini-interview (MMI) is a common assessment strategy used in student selection. The MMI as an assessment strategy within a health professions curriculum, however, has not been previously studied. This study describes the integration of a 5-station MMI as part of an e...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
BMC
2018-05-01
|
| Series: | BMC Medical Education |
| Subjects: | |
| Online Access: | http://link.springer.com/article/10.1186/s12909-018-1203-5 |
| _version_ | 1818244066202091520 |
|---|---|
| author | Michael D. Wolcott Jacqueline M. Zeeman Wendy C. Cox Jacqueline E. McLaughlin |
| author_facet | Michael D. Wolcott Jacqueline M. Zeeman Wendy C. Cox Jacqueline E. McLaughlin |
| author_sort | Michael D. Wolcott |
| collection | DOAJ |
| description | Abstract Background The multiple mini-interview (MMI) is a common assessment strategy used in student selection. The MMI as an assessment strategy within a health professions curriculum, however, has not been previously studied. This study describes the integration of a 5-station MMI as part of an end-of-year capstone following the first year of a health professions curriculum. The goal of the capstone MMI was to assess professional competencies of students and to offer formative feedback to prepare students for their upcoming clinical practice experiences. The purpose of this study was to evaluate the psychometric properties of an MMI integrated into a health professions curriculum. Methods Five capstone MMI stations were designed to each evaluate a single construct assessed by one rater. A principal component analysis (PCA) was used to evaluate the structure of the model and its ability to distinguish 5 separate constructs. A Multifaceted Rasch Measurement (MFRM) model assessed student performance and estimated the sources of measurement error attributed to 3 facets: student ability, rater stringency, and station difficulty. At the conclusion, students were surveyed about the capstone MMI experience. Results The PCA confirmed the MMI reliably assessed 5 unique constructs and performance on each station was not strongly correlated with one another. The 3-facet MFRM analysis explained 58.79% of the total variance in student scores. Specifically, 29.98% of the variance reflected student ability, 20.25% reflected rater stringency, and 8.56% reflected station difficulty. Overall, the data demonstrated an acceptable fit to the MFRM model. The majority of students agreed the MMI allowed them to effectively demonstrate their communication (80.82%), critical thinking (78.77%), and collaboration skills (70.55%). Conclusions The MMI can be a valuable assessment strategy of professional competence within a health professions curriculum. These findings suggest the MMI is well-received by students and can produce reliable results. Future research should explore the impact of using the MMI as a strategy to monitor longitudinal competency development and inform feedback approaches. |
| first_indexed | 2024-12-12T14:11:06Z |
| format | Article |
| id | doaj.art-9d3fb328e18141e4bddf710ddd1f20bb |
| institution | Directory Open Access Journal |
| issn | 1472-6920 |
| language | English |
| last_indexed | 2024-12-12T14:11:06Z |
| publishDate | 2018-05-01 |
| publisher | BMC |
| record_format | Article |
| series | BMC Medical Education |
| spelling | doaj.art-9d3fb328e18141e4bddf710ddd1f20bb2022-12-22T00:22:06ZengBMCBMC Medical Education1472-69202018-05-011811910.1186/s12909-018-1203-5Using the multiple mini interview as an assessment strategy within the first year of a health professions curriculumMichael D. Wolcott0Jacqueline M. Zeeman1Wendy C. Cox2Jacqueline E. McLaughlin3UNC Eshelman School of Pharmacy, University of North CarolinaUNC Eshelman School of Pharmacy, University of North CarolinaUNC Eshelman School of Pharmacy, University of North CarolinaUNC Eshelman School of Pharmacy, University of North CarolinaAbstract Background The multiple mini-interview (MMI) is a common assessment strategy used in student selection. The MMI as an assessment strategy within a health professions curriculum, however, has not been previously studied. This study describes the integration of a 5-station MMI as part of an end-of-year capstone following the first year of a health professions curriculum. The goal of the capstone MMI was to assess professional competencies of students and to offer formative feedback to prepare students for their upcoming clinical practice experiences. The purpose of this study was to evaluate the psychometric properties of an MMI integrated into a health professions curriculum. Methods Five capstone MMI stations were designed to each evaluate a single construct assessed by one rater. A principal component analysis (PCA) was used to evaluate the structure of the model and its ability to distinguish 5 separate constructs. A Multifaceted Rasch Measurement (MFRM) model assessed student performance and estimated the sources of measurement error attributed to 3 facets: student ability, rater stringency, and station difficulty. At the conclusion, students were surveyed about the capstone MMI experience. Results The PCA confirmed the MMI reliably assessed 5 unique constructs and performance on each station was not strongly correlated with one another. The 3-facet MFRM analysis explained 58.79% of the total variance in student scores. Specifically, 29.98% of the variance reflected student ability, 20.25% reflected rater stringency, and 8.56% reflected station difficulty. Overall, the data demonstrated an acceptable fit to the MFRM model. The majority of students agreed the MMI allowed them to effectively demonstrate their communication (80.82%), critical thinking (78.77%), and collaboration skills (70.55%). Conclusions The MMI can be a valuable assessment strategy of professional competence within a health professions curriculum. These findings suggest the MMI is well-received by students and can produce reliable results. Future research should explore the impact of using the MMI as a strategy to monitor longitudinal competency development and inform feedback approaches.http://link.springer.com/article/10.1186/s12909-018-1203-5Multiple mini interviewCapstoneCompetency based medical educationNonacademicProfessional competence |
| spellingShingle | Michael D. Wolcott Jacqueline M. Zeeman Wendy C. Cox Jacqueline E. McLaughlin Using the multiple mini interview as an assessment strategy within the first year of a health professions curriculum BMC Medical Education Multiple mini interview Capstone Competency based medical education Nonacademic Professional competence |
| title | Using the multiple mini interview as an assessment strategy within the first year of a health professions curriculum |
| title_full | Using the multiple mini interview as an assessment strategy within the first year of a health professions curriculum |
| title_fullStr | Using the multiple mini interview as an assessment strategy within the first year of a health professions curriculum |
| title_full_unstemmed | Using the multiple mini interview as an assessment strategy within the first year of a health professions curriculum |
| title_short | Using the multiple mini interview as an assessment strategy within the first year of a health professions curriculum |
| title_sort | using the multiple mini interview as an assessment strategy within the first year of a health professions curriculum |
| topic | Multiple mini interview Capstone Competency based medical education Nonacademic Professional competence |
| url | http://link.springer.com/article/10.1186/s12909-018-1203-5 |
| work_keys_str_mv | AT michaeldwolcott usingthemultipleminiinterviewasanassessmentstrategywithinthefirstyearofahealthprofessionscurriculum AT jacquelinemzeeman usingthemultipleminiinterviewasanassessmentstrategywithinthefirstyearofahealthprofessionscurriculum AT wendyccox usingthemultipleminiinterviewasanassessmentstrategywithinthefirstyearofahealthprofessionscurriculum AT jacquelineemclaughlin usingthemultipleminiinterviewasanassessmentstrategywithinthefirstyearofahealthprofessionscurriculum |