142 Using evaluation methods to improve evaluation processes: Creation and implementation of a new continuous improvement process at Duke Univ. Clinical and Translational Science Institute (CTSI)
OBJECTIVES/GOALS: (1) Assess challenges with our current continuous improvement processes via stakeholders. (2) Implement a revised continuous improvement process. (3) Evaluate the revised processes to assess implementation and use for strategic improvement. (4) Implement analysis mechanisms for new...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Cambridge University Press
2023-04-01
|
| Series: | Journal of Clinical and Translational Science |
| Online Access: | https://www.cambridge.org/core/product/identifier/S2059866123002248/type/journal_article |
| _version_ | 1827960779459002368 |
|---|---|
| author | Jessica Sperling Stella Quenstedt Joe McClernon |
| author_facet | Jessica Sperling Stella Quenstedt Joe McClernon |
| author_sort | Jessica Sperling |
| collection | DOAJ |
| description | OBJECTIVES/GOALS: (1) Assess challenges with our current continuous improvement processes via stakeholders. (2) Implement a revised continuous improvement process. (3) Evaluate the revised processes to assess implementation and use for strategic improvement. (4) Implement analysis mechanisms for new process to assess trends across the CTSI. METHODS/STUDY POPULATION: We used a mixed-methods, multi-phased, stakeholder-engaged approach with different processes per objective. Obj. 1: We implemented focus groups, surveys, and listening sessions incorporating two populations: both teams required to participate in reporting process, and CTSI leadership. Obj. 2: We utilized data from Obj. 1 processes to develop a revised continuous improvement process. Obj. 3: We integrated qualitative feedback processes onto the structure of continuous improvement processes, and we implemented a survey to assess use and value for the new process. Obj. 4: We developed a qualitative coding schema to assess key trends across teams and over time. RESULTS/ANTICIPATED RESULTS: Obj. 1: Numerous challenges in metrics format and process, including significant limitations in data use to inform decision-making and appropriately assess impact. Obj. 2: Resultant changes to continuous improvement processes, including a restructured reporting format and use-oriented approach that enhanced organizational integration; changes included added focus on facilitators of success, challenge, and key opportunities to better inform decision-making. Obj. 3: The majority of teams experienced the new quarterly process as a better tool for program monitoring and communicating program needs to leadership, but that fuller integration into vertical communication is needed. Obj. 4: Implementation of new analysis process enabling examination of trends and themes across diverse teams within the CTSI. DISCUSSION/SIGNIFICANCE: This work has particular relevance within ACTS given our focus on a clinical and translational research enterprise, the complexity in evaluating the diverse work of translation research entities, and limitations in a commonly-used metrics-monitoring approach. Our focus on improving translational processes advances translational science. |
| first_indexed | 2024-04-09T16:15:02Z |
| format | Article |
| id | doaj.art-c637d541141d4a48940b8d0df3357df1 |
| institution | Directory Open Access Journal |
| issn | 2059-8661 |
| language | English |
| last_indexed | 2024-04-09T16:15:02Z |
| publishDate | 2023-04-01 |
| publisher | Cambridge University Press |
| record_format | Article |
| series | Journal of Clinical and Translational Science |
| spelling | doaj.art-c637d541141d4a48940b8d0df3357df12023-04-24T05:55:57ZengCambridge University PressJournal of Clinical and Translational Science2059-86612023-04-017434310.1017/cts.2023.224142 Using evaluation methods to improve evaluation processes: Creation and implementation of a new continuous improvement process at Duke Univ. Clinical and Translational Science Institute (CTSI)Jessica Sperling0Stella Quenstedt1Joe McClernon2Duke UniversityDuke UniversityDuke UniversityOBJECTIVES/GOALS: (1) Assess challenges with our current continuous improvement processes via stakeholders. (2) Implement a revised continuous improvement process. (3) Evaluate the revised processes to assess implementation and use for strategic improvement. (4) Implement analysis mechanisms for new process to assess trends across the CTSI. METHODS/STUDY POPULATION: We used a mixed-methods, multi-phased, stakeholder-engaged approach with different processes per objective. Obj. 1: We implemented focus groups, surveys, and listening sessions incorporating two populations: both teams required to participate in reporting process, and CTSI leadership. Obj. 2: We utilized data from Obj. 1 processes to develop a revised continuous improvement process. Obj. 3: We integrated qualitative feedback processes onto the structure of continuous improvement processes, and we implemented a survey to assess use and value for the new process. Obj. 4: We developed a qualitative coding schema to assess key trends across teams and over time. RESULTS/ANTICIPATED RESULTS: Obj. 1: Numerous challenges in metrics format and process, including significant limitations in data use to inform decision-making and appropriately assess impact. Obj. 2: Resultant changes to continuous improvement processes, including a restructured reporting format and use-oriented approach that enhanced organizational integration; changes included added focus on facilitators of success, challenge, and key opportunities to better inform decision-making. Obj. 3: The majority of teams experienced the new quarterly process as a better tool for program monitoring and communicating program needs to leadership, but that fuller integration into vertical communication is needed. Obj. 4: Implementation of new analysis process enabling examination of trends and themes across diverse teams within the CTSI. DISCUSSION/SIGNIFICANCE: This work has particular relevance within ACTS given our focus on a clinical and translational research enterprise, the complexity in evaluating the diverse work of translation research entities, and limitations in a commonly-used metrics-monitoring approach. Our focus on improving translational processes advances translational science.https://www.cambridge.org/core/product/identifier/S2059866123002248/type/journal_article |
| spellingShingle | Jessica Sperling Stella Quenstedt Joe McClernon 142 Using evaluation methods to improve evaluation processes: Creation and implementation of a new continuous improvement process at Duke Univ. Clinical and Translational Science Institute (CTSI) Journal of Clinical and Translational Science |
| title | 142 Using evaluation methods to improve evaluation processes: Creation and implementation of a new continuous improvement process at Duke Univ. Clinical and Translational Science Institute (CTSI) |
| title_full | 142 Using evaluation methods to improve evaluation processes: Creation and implementation of a new continuous improvement process at Duke Univ. Clinical and Translational Science Institute (CTSI) |
| title_fullStr | 142 Using evaluation methods to improve evaluation processes: Creation and implementation of a new continuous improvement process at Duke Univ. Clinical and Translational Science Institute (CTSI) |
| title_full_unstemmed | 142 Using evaluation methods to improve evaluation processes: Creation and implementation of a new continuous improvement process at Duke Univ. Clinical and Translational Science Institute (CTSI) |
| title_short | 142 Using evaluation methods to improve evaluation processes: Creation and implementation of a new continuous improvement process at Duke Univ. Clinical and Translational Science Institute (CTSI) |
| title_sort | 142 using evaluation methods to improve evaluation processes creation and implementation of a new continuous improvement process at duke univ clinical and translational science institute ctsi |
| url | https://www.cambridge.org/core/product/identifier/S2059866123002248/type/journal_article |
| work_keys_str_mv | AT jessicasperling 142usingevaluationmethodstoimproveevaluationprocessescreationandimplementationofanewcontinuousimprovementprocessatdukeunivclinicalandtranslationalscienceinstitutectsi AT stellaquenstedt 142usingevaluationmethodstoimproveevaluationprocessescreationandimplementationofanewcontinuousimprovementprocessatdukeunivclinicalandtranslationalscienceinstitutectsi AT joemcclernon 142usingevaluationmethodstoimproveevaluationprocessescreationandimplementationofanewcontinuousimprovementprocessatdukeunivclinicalandtranslationalscienceinstitutectsi |