142 Validation of the Mentoring Competency Assessment to evaluate the mentorship skills and competencies of mentees
OBJECTIVES/GOALS: The purpose of this study was to assess if the Mentoring Competency Assessment (MCA) could be used to capture mentee gains in mentorship skills and how the mentorship competencies may vary structurally for mentees compared to mentors, while the original MCA was shown to be a valida...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Cambridge University Press
2024-04-01
|
| Series: | Journal of Clinical and Translational Science |
| Online Access: | https://www.cambridge.org/core/product/identifier/S2059866124001389/type/journal_article |
| _version_ | 1827296106018504704 |
|---|---|
| author | So Hee Hyun Jenna Griebel Rogers Jonathan Orsini |
| author_facet | So Hee Hyun Jenna Griebel Rogers Jonathan Orsini |
| author_sort | So Hee Hyun |
| collection | DOAJ |
| description | OBJECTIVES/GOALS: The purpose of this study was to assess if the Mentoring Competency Assessment (MCA) could be used to capture mentee gains in mentorship skills and how the mentorship competencies may vary structurally for mentees compared to mentors, while the original MCA was shown to be a validated measure to assess mentor skills. METHODS/STUDY POPULATION: The mentee training survey data were collected nationally from 2015 to 2022. The survey data set included 401 respondents who consented to participate after 59 mentee training events hosted by 34 institutions/organizations who participated in face-to-face and online training as well as completed the Mentoring Competency Assessment (MCA) in their surveys. We conducted principal component analysis (PCA) with varimax rotation to investigate the internal structure of the MCA and Hatcher’s criteria were applied. After a team of mentoring experts independently interpreted the PCA results and reached a consensus on the interpretations of the components, factor analysis and internal consistency reliability analysis were applied to assess the construct validity and the reliability. RESULTS/ANTICIPATED RESULTS: There were significant component loadings of the eight components with varimax rotation and 22 of the total 26 items were loaded into components. Four items, (5) pursuing strategies to improve communication, (6) coordinating with other mentors, (11) developing strategies to meet goals, and (23) setting career goals, were excluded from the factor analysis and Cronbach’s alpha analysis since these items were not significantly loaded into any components. The eight-component structure was validated (χ2=313.209, p<.001, RMSEA=.083, CFI=.907, TLI=.881, SRMR=.073) and the hypothesized model of the eight components resulted in an acceptable fit to the data with standardized factor loadings ranging from 0.58 to 0.93. The alpha coefficient is from 0.58 to 0.90, suggesting the items have high internal consistency. DISCUSSION/SIGNIFICANCE: Based upon the findings we recommend that the full revised MCA for mentees is used to capture mentees’ mentorship skill gains even if not all of the competency modules are used in the training. The development and validation of measures such as the MCA are important as we move toward the use of common measures across programs such as the CTSAs. |
| first_indexed | 2024-04-24T14:32:15Z |
| format | Article |
| id | doaj.art-9c753f70632a4fcc8eb8a3db5428df35 |
| institution | Directory Open Access Journal |
| issn | 2059-8661 |
| language | English |
| last_indexed | 2024-04-24T14:32:15Z |
| publishDate | 2024-04-01 |
| publisher | Cambridge University Press |
| record_format | Article |
| series | Journal of Clinical and Translational Science |
| spelling | doaj.art-9c753f70632a4fcc8eb8a3db5428df352024-04-03T02:00:21ZengCambridge University PressJournal of Clinical and Translational Science2059-86612024-04-018424210.1017/cts.2024.138142 Validation of the Mentoring Competency Assessment to evaluate the mentorship skills and competencies of menteesSo Hee Hyun0Jenna Griebel Rogers1Jonathan Orsini2University of Wisconsin-MadisonUniversity of Wisconsin-MadisonUniversity of FloridaOBJECTIVES/GOALS: The purpose of this study was to assess if the Mentoring Competency Assessment (MCA) could be used to capture mentee gains in mentorship skills and how the mentorship competencies may vary structurally for mentees compared to mentors, while the original MCA was shown to be a validated measure to assess mentor skills. METHODS/STUDY POPULATION: The mentee training survey data were collected nationally from 2015 to 2022. The survey data set included 401 respondents who consented to participate after 59 mentee training events hosted by 34 institutions/organizations who participated in face-to-face and online training as well as completed the Mentoring Competency Assessment (MCA) in their surveys. We conducted principal component analysis (PCA) with varimax rotation to investigate the internal structure of the MCA and Hatcher’s criteria were applied. After a team of mentoring experts independently interpreted the PCA results and reached a consensus on the interpretations of the components, factor analysis and internal consistency reliability analysis were applied to assess the construct validity and the reliability. RESULTS/ANTICIPATED RESULTS: There were significant component loadings of the eight components with varimax rotation and 22 of the total 26 items were loaded into components. Four items, (5) pursuing strategies to improve communication, (6) coordinating with other mentors, (11) developing strategies to meet goals, and (23) setting career goals, were excluded from the factor analysis and Cronbach’s alpha analysis since these items were not significantly loaded into any components. The eight-component structure was validated (χ2=313.209, p<.001, RMSEA=.083, CFI=.907, TLI=.881, SRMR=.073) and the hypothesized model of the eight components resulted in an acceptable fit to the data with standardized factor loadings ranging from 0.58 to 0.93. The alpha coefficient is from 0.58 to 0.90, suggesting the items have high internal consistency. DISCUSSION/SIGNIFICANCE: Based upon the findings we recommend that the full revised MCA for mentees is used to capture mentees’ mentorship skill gains even if not all of the competency modules are used in the training. The development and validation of measures such as the MCA are important as we move toward the use of common measures across programs such as the CTSAs.https://www.cambridge.org/core/product/identifier/S2059866124001389/type/journal_article |
| spellingShingle | So Hee Hyun Jenna Griebel Rogers Jonathan Orsini 142 Validation of the Mentoring Competency Assessment to evaluate the mentorship skills and competencies of mentees Journal of Clinical and Translational Science |
| title | 142 Validation of the Mentoring Competency Assessment to evaluate the mentorship skills and competencies of mentees |
| title_full | 142 Validation of the Mentoring Competency Assessment to evaluate the mentorship skills and competencies of mentees |
| title_fullStr | 142 Validation of the Mentoring Competency Assessment to evaluate the mentorship skills and competencies of mentees |
| title_full_unstemmed | 142 Validation of the Mentoring Competency Assessment to evaluate the mentorship skills and competencies of mentees |
| title_short | 142 Validation of the Mentoring Competency Assessment to evaluate the mentorship skills and competencies of mentees |
| title_sort | 142 validation of the mentoring competency assessment to evaluate the mentorship skills and competencies of mentees |
| url | https://www.cambridge.org/core/product/identifier/S2059866124001389/type/journal_article |
| work_keys_str_mv | AT soheehyun 142validationofthementoringcompetencyassessmenttoevaluatethementorshipskillsandcompetenciesofmentees AT jennagriebelrogers 142validationofthementoringcompetencyassessmenttoevaluatethementorshipskillsandcompetenciesofmentees AT jonathanorsini 142validationofthementoringcompetencyassessmenttoevaluatethementorshipskillsandcompetenciesofmentees |