Using the payback framework to evaluate the outcomes of pilot projects supported by the Georgia Clinical and Translational Science Alliance
Abstract Introduction: The Clinical and Translational Science Awards (CTSA) program of the National Center for Advancing Translational Sciences (NCATS) seeks to improve population health by accelerating the translation of scientific discoveries in the laboratory and clinic into practices for the c...
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Cambridge University Press
2021-01-01
|
| Series: | Journal of Clinical and Translational Science |
| Subjects: | |
| Online Access: | https://www.cambridge.org/core/product/identifier/S2059866120005427/type/journal_article |
| _version_ | 1827995288181145600 |
|---|---|
| author | Latrice Rollins Nicole Llewellyn Manzi Ngaiza Eric Nehl Dorothy R. Carter Jeff M. Sands |
| author_facet | Latrice Rollins Nicole Llewellyn Manzi Ngaiza Eric Nehl Dorothy R. Carter Jeff M. Sands |
| author_sort | Latrice Rollins |
| collection | DOAJ |
| description |
Abstract
Introduction:
The Clinical and Translational Science Awards (CTSA) program of the National Center for Advancing Translational Sciences (NCATS) seeks to improve population health by accelerating the translation of scientific discoveries in the laboratory and clinic into practices for the community. CTSAs achieve this goal, in part, through their pilot project programs that fund promising early career investigators and innovative early-stage research projects across the translational research spectrum. However, there have been few reports on individual pilot projects and their impacts on the investigators who receive them and no studies on the long-term impact and outcomes of pilot projects.
Methods:
The Georgia CTSA funded 183 pilot projects from 2007 to 2015. We used a structured evaluation framework, the payback framework, to document the outcomes of 16 purposefully-selected pilot projects supported by the Georgia CTSA. We used a case study approach including bibliometric analyses of publications associated with the selected projects, document review, and investigator interviews.
Results:
These pilot projects had positive impact based on outcomes in five “payback categories”: (1) knowledge; (2) research targeting, capacity building, and absorption; (3) policy and product development; (4) health benefits; and (5) broader economic benefits.
Conclusions:
Results could inform our understanding of the diversity and breadth of outcomes resulting from Georgia CTSA-supported research and provide a framework for evaluating long-term pilot project outcomes across CTSAs.
|
| first_indexed | 2024-04-10T04:53:08Z |
| format | Article |
| id | doaj.art-e6f7bf2712744a318e12bd89efd26766 |
| institution | Directory Open Access Journal |
| issn | 2059-8661 |
| language | English |
| last_indexed | 2024-04-10T04:53:08Z |
| publishDate | 2021-01-01 |
| publisher | Cambridge University Press |
| record_format | Article |
| series | Journal of Clinical and Translational Science |
| spelling | doaj.art-e6f7bf2712744a318e12bd89efd267662023-03-09T12:31:03ZengCambridge University PressJournal of Clinical and Translational Science2059-86612021-01-01510.1017/cts.2020.542Using the payback framework to evaluate the outcomes of pilot projects supported by the Georgia Clinical and Translational Science AllianceLatrice Rollins0https://orcid.org/0000-0003-0281-9653Nicole Llewellyn1Manzi Ngaiza2Eric Nehl3Dorothy R. Carter4Jeff M. Sands5https://orcid.org/0000-0001-9822-0607Prevention Research Center, Morehouse School of Medicine, Atlanta, GA, USAGeorgia Clinical & Translational Science Alliance, Emory University School of Medicine, Atlanta, GA, USAPrevention Research Center, Morehouse School of Medicine, Atlanta, GA, USAGeorgia Clinical & Translational Science Alliance, Emory University School of Medicine, Atlanta, GA, USADepartment of Psychology, University of Georgia, Athens, GA, USAGeorgia Clinical & Translational Science Alliance, Emory University School of Medicine, Atlanta, GA, USA Abstract Introduction: The Clinical and Translational Science Awards (CTSA) program of the National Center for Advancing Translational Sciences (NCATS) seeks to improve population health by accelerating the translation of scientific discoveries in the laboratory and clinic into practices for the community. CTSAs achieve this goal, in part, through their pilot project programs that fund promising early career investigators and innovative early-stage research projects across the translational research spectrum. However, there have been few reports on individual pilot projects and their impacts on the investigators who receive them and no studies on the long-term impact and outcomes of pilot projects. Methods: The Georgia CTSA funded 183 pilot projects from 2007 to 2015. We used a structured evaluation framework, the payback framework, to document the outcomes of 16 purposefully-selected pilot projects supported by the Georgia CTSA. We used a case study approach including bibliometric analyses of publications associated with the selected projects, document review, and investigator interviews. Results: These pilot projects had positive impact based on outcomes in five “payback categories”: (1) knowledge; (2) research targeting, capacity building, and absorption; (3) policy and product development; (4) health benefits; and (5) broader economic benefits. Conclusions: Results could inform our understanding of the diversity and breadth of outcomes resulting from Georgia CTSA-supported research and provide a framework for evaluating long-term pilot project outcomes across CTSAs. https://www.cambridge.org/core/product/identifier/S2059866120005427/type/journal_articlePilot project programresearch paybackevaluationcase studiesCTSA program |
| spellingShingle | Latrice Rollins Nicole Llewellyn Manzi Ngaiza Eric Nehl Dorothy R. Carter Jeff M. Sands Using the payback framework to evaluate the outcomes of pilot projects supported by the Georgia Clinical and Translational Science Alliance Journal of Clinical and Translational Science Pilot project program research payback evaluation case studies CTSA program |
| title | Using the payback framework to evaluate the outcomes of pilot projects supported by the Georgia Clinical and Translational Science Alliance |
| title_full | Using the payback framework to evaluate the outcomes of pilot projects supported by the Georgia Clinical and Translational Science Alliance |
| title_fullStr | Using the payback framework to evaluate the outcomes of pilot projects supported by the Georgia Clinical and Translational Science Alliance |
| title_full_unstemmed | Using the payback framework to evaluate the outcomes of pilot projects supported by the Georgia Clinical and Translational Science Alliance |
| title_short | Using the payback framework to evaluate the outcomes of pilot projects supported by the Georgia Clinical and Translational Science Alliance |
| title_sort | using the payback framework to evaluate the outcomes of pilot projects supported by the georgia clinical and translational science alliance |
| topic | Pilot project program research payback evaluation case studies CTSA program |
| url | https://www.cambridge.org/core/product/identifier/S2059866120005427/type/journal_article |
| work_keys_str_mv | AT latricerollins usingthepaybackframeworktoevaluatetheoutcomesofpilotprojectssupportedbythegeorgiaclinicalandtranslationalsciencealliance AT nicolellewellyn usingthepaybackframeworktoevaluatetheoutcomesofpilotprojectssupportedbythegeorgiaclinicalandtranslationalsciencealliance AT manzingaiza usingthepaybackframeworktoevaluatetheoutcomesofpilotprojectssupportedbythegeorgiaclinicalandtranslationalsciencealliance AT ericnehl usingthepaybackframeworktoevaluatetheoutcomesofpilotprojectssupportedbythegeorgiaclinicalandtranslationalsciencealliance AT dorothyrcarter usingthepaybackframeworktoevaluatetheoutcomesofpilotprojectssupportedbythegeorgiaclinicalandtranslationalsciencealliance AT jeffmsands usingthepaybackframeworktoevaluatetheoutcomesofpilotprojectssupportedbythegeorgiaclinicalandtranslationalsciencealliance |