4051 Assessing outcomes of Miami CTSI’s Mentored Career Development KL2 Program: Using bibliometric and network visualization approaches to complement traditional outcome metrics
OBJECTIVES/GOALS: The goal of this project was to assess the scientific impact of Miami CTSI’s Mentored Career Development (KL2) Program using bibliometric tools and network visualization in addition to the traditional metrics used to provide a comprehensive evaluation. METHODS/STUDY POPULATION: Sch...
| Main Authors: | , , , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Cambridge University Press
2020-06-01
|
| Series: | Journal of Clinical and Translational Science |
| Online Access: | https://www.cambridge.org/core/product/identifier/S2059866120002307/type/journal_article |
| _version_ | 1811155085718192128 |
|---|---|
| author | Rosalina Das Jessica Diaz Patricia Avissar Tatjana Rundek Gwendolyn B. Scott Alessia Fornoni Jonelle E. Wright Sheela Dominguez Barry S. Issenberg Ralph L. Sacco |
| author_facet | Rosalina Das Jessica Diaz Patricia Avissar Tatjana Rundek Gwendolyn B. Scott Alessia Fornoni Jonelle E. Wright Sheela Dominguez Barry S. Issenberg Ralph L. Sacco |
| author_sort | Rosalina Das |
| collection | DOAJ |
| description | OBJECTIVES/GOALS: The goal of this project was to assess the scientific impact of Miami CTSI’s Mentored Career Development (KL2) Program using bibliometric tools and network visualization in addition to the traditional metrics used to provide a comprehensive evaluation. METHODS/STUDY POPULATION: Scholarly productivity of KL2 scholars were tracked using REDCap. For bibliometric data analysis and visualization, publications were queried using iCite (NIH Office of Portfolio Analysis) and Web of Science database. A total of 173 publications produced by eight KL2 scholars from 2013-2018 were analyzed and categorized into pre-award, during award, and post-award periods. iCite was used to assess scientific influence and translation. Scientific networks and collaboration were visualized using VOSviewer (Centre for Science and Technology Studies, Leiden University). CTSA Common Metrics were tracked using the Results Based Accountability framework. RESULTS/ANTICIPATED RESULTS: Albeit of modest size, the Miami CTSI’s KL2 Program had significant scientific productivity and impact in its first five years. Our KL2 scholars’ publications were cited twice as frequently as other papers in their fields. Further, 48% of publications post KL2 award were above the NIH 50th percentile and had higher citation impact compared to the average NIH-funded paper; 11% were in the top 10% NIH citation ranking. In contrast, only 20% of the publications pre-KL2 award were above the NIH 50th percentile. The program also promoted research collaboration; network visualizations indicate larger co-authorship and organization networks of KL2 scholars post-award. DISCUSSION/SIGNIFICANCE OF IMPACT: Bibliometric and data visualization approaches helped us better identify trends and gauge effectiveness of the KL2 program. These findings provided useful insight into the scientific influence and impact of our scholars’ work. |
| first_indexed | 2024-04-10T04:28:15Z |
| format | Article |
| id | doaj.art-3312abbcf9df4d95b2a87ff2c84015fe |
| institution | Directory Open Access Journal |
| issn | 2059-8661 |
| language | English |
| last_indexed | 2024-04-10T04:28:15Z |
| publishDate | 2020-06-01 |
| publisher | Cambridge University Press |
| record_format | Article |
| series | Journal of Clinical and Translational Science |
| spelling | doaj.art-3312abbcf9df4d95b2a87ff2c84015fe2023-03-10T08:51:35ZengCambridge University PressJournal of Clinical and Translational Science2059-86612020-06-014707010.1017/cts.2020.2304051 Assessing outcomes of Miami CTSI’s Mentored Career Development KL2 Program: Using bibliometric and network visualization approaches to complement traditional outcome metricsRosalina Das0Jessica Diaz1Patricia Avissar2Tatjana Rundek3Gwendolyn B. Scott4Alessia Fornoni5Jonelle E. Wright6Sheela Dominguez7Barry S. Issenberg8Ralph L. Sacco9University of Miami Clinical and Translational Science InstituteUniversity of MiamiUniversity of MiamiUniversity of MiamiUniversity of MiamiUniversity of MiamiUniversity of MiamiUniversity of Miami Clinical and Translational Science InstituteUniversity of MiamiUniversity of MiamiOBJECTIVES/GOALS: The goal of this project was to assess the scientific impact of Miami CTSI’s Mentored Career Development (KL2) Program using bibliometric tools and network visualization in addition to the traditional metrics used to provide a comprehensive evaluation. METHODS/STUDY POPULATION: Scholarly productivity of KL2 scholars were tracked using REDCap. For bibliometric data analysis and visualization, publications were queried using iCite (NIH Office of Portfolio Analysis) and Web of Science database. A total of 173 publications produced by eight KL2 scholars from 2013-2018 were analyzed and categorized into pre-award, during award, and post-award periods. iCite was used to assess scientific influence and translation. Scientific networks and collaboration were visualized using VOSviewer (Centre for Science and Technology Studies, Leiden University). CTSA Common Metrics were tracked using the Results Based Accountability framework. RESULTS/ANTICIPATED RESULTS: Albeit of modest size, the Miami CTSI’s KL2 Program had significant scientific productivity and impact in its first five years. Our KL2 scholars’ publications were cited twice as frequently as other papers in their fields. Further, 48% of publications post KL2 award were above the NIH 50th percentile and had higher citation impact compared to the average NIH-funded paper; 11% were in the top 10% NIH citation ranking. In contrast, only 20% of the publications pre-KL2 award were above the NIH 50th percentile. The program also promoted research collaboration; network visualizations indicate larger co-authorship and organization networks of KL2 scholars post-award. DISCUSSION/SIGNIFICANCE OF IMPACT: Bibliometric and data visualization approaches helped us better identify trends and gauge effectiveness of the KL2 program. These findings provided useful insight into the scientific influence and impact of our scholars’ work.https://www.cambridge.org/core/product/identifier/S2059866120002307/type/journal_article |
| spellingShingle | Rosalina Das Jessica Diaz Patricia Avissar Tatjana Rundek Gwendolyn B. Scott Alessia Fornoni Jonelle E. Wright Sheela Dominguez Barry S. Issenberg Ralph L. Sacco 4051 Assessing outcomes of Miami CTSI’s Mentored Career Development KL2 Program: Using bibliometric and network visualization approaches to complement traditional outcome metrics Journal of Clinical and Translational Science |
| title | 4051 Assessing outcomes of Miami CTSI’s Mentored Career Development KL2 Program: Using bibliometric and network visualization approaches to complement traditional outcome metrics |
| title_full | 4051 Assessing outcomes of Miami CTSI’s Mentored Career Development KL2 Program: Using bibliometric and network visualization approaches to complement traditional outcome metrics |
| title_fullStr | 4051 Assessing outcomes of Miami CTSI’s Mentored Career Development KL2 Program: Using bibliometric and network visualization approaches to complement traditional outcome metrics |
| title_full_unstemmed | 4051 Assessing outcomes of Miami CTSI’s Mentored Career Development KL2 Program: Using bibliometric and network visualization approaches to complement traditional outcome metrics |
| title_short | 4051 Assessing outcomes of Miami CTSI’s Mentored Career Development KL2 Program: Using bibliometric and network visualization approaches to complement traditional outcome metrics |
| title_sort | 4051 assessing outcomes of miami ctsi s mentored career development kl2 program using bibliometric and network visualization approaches to complement traditional outcome metrics |
| url | https://www.cambridge.org/core/product/identifier/S2059866120002307/type/journal_article |
| work_keys_str_mv | AT rosalinadas 4051assessingoutcomesofmiamictsismentoredcareerdevelopmentkl2programusingbibliometricandnetworkvisualizationapproachestocomplementtraditionaloutcomemetrics AT jessicadiaz 4051assessingoutcomesofmiamictsismentoredcareerdevelopmentkl2programusingbibliometricandnetworkvisualizationapproachestocomplementtraditionaloutcomemetrics AT patriciaavissar 4051assessingoutcomesofmiamictsismentoredcareerdevelopmentkl2programusingbibliometricandnetworkvisualizationapproachestocomplementtraditionaloutcomemetrics AT tatjanarundek 4051assessingoutcomesofmiamictsismentoredcareerdevelopmentkl2programusingbibliometricandnetworkvisualizationapproachestocomplementtraditionaloutcomemetrics AT gwendolynbscott 4051assessingoutcomesofmiamictsismentoredcareerdevelopmentkl2programusingbibliometricandnetworkvisualizationapproachestocomplementtraditionaloutcomemetrics AT alessiafornoni 4051assessingoutcomesofmiamictsismentoredcareerdevelopmentkl2programusingbibliometricandnetworkvisualizationapproachestocomplementtraditionaloutcomemetrics AT jonelleewright 4051assessingoutcomesofmiamictsismentoredcareerdevelopmentkl2programusingbibliometricandnetworkvisualizationapproachestocomplementtraditionaloutcomemetrics AT sheeladominguez 4051assessingoutcomesofmiamictsismentoredcareerdevelopmentkl2programusingbibliometricandnetworkvisualizationapproachestocomplementtraditionaloutcomemetrics AT barrysissenberg 4051assessingoutcomesofmiamictsismentoredcareerdevelopmentkl2programusingbibliometricandnetworkvisualizationapproachestocomplementtraditionaloutcomemetrics AT ralphlsacco 4051assessingoutcomesofmiamictsismentoredcareerdevelopmentkl2programusingbibliometricandnetworkvisualizationapproachestocomplementtraditionaloutcomemetrics |