Toolkit and distance coaching strategies: a mixed methods evaluation of a trial to implement care coordination quality improvement projects in primary care

Abstract Background Care coordination tools and toolkits can be challenging to implement. Practice facilitation, an active but expensive strategy, may facilitate toolkit implementation. We evaluated the comparative effectiveness of distance coaching, a form of practice facilitation, for improving th...

Full description

Bibliographic Details
Main Authors: Lauren S. Penney, Purnima S. Bharath, Isomi Miake-Lye, Mei Leng, Tanya T. Olmos-Ochoa, Erin P. Finley, Neetu Chawla, Jenny M. Barnard, David A. Ganz
Format: Article
Language:English
Published: BMC 2021-08-01
Series:BMC Health Services Research
Subjects:
Online Access:https://doi.org/10.1186/s12913-021-06850-1
_version_ 1823938388335525888
author Lauren S. Penney
Purnima S. Bharath
Isomi Miake-Lye
Mei Leng
Tanya T. Olmos-Ochoa
Erin P. Finley
Neetu Chawla
Jenny M. Barnard
David A. Ganz
author_facet Lauren S. Penney
Purnima S. Bharath
Isomi Miake-Lye
Mei Leng
Tanya T. Olmos-Ochoa
Erin P. Finley
Neetu Chawla
Jenny M. Barnard
David A. Ganz
author_sort Lauren S. Penney
collection DOAJ
description Abstract Background Care coordination tools and toolkits can be challenging to implement. Practice facilitation, an active but expensive strategy, may facilitate toolkit implementation. We evaluated the comparative effectiveness of distance coaching, a form of practice facilitation, for improving the implementation of care coordination quality improvement (QI) projects. Methods We conducted a mixed methods evaluation of the Coordination Toolkit and Coaching (CTAC) initiative. Twelve matched US Veterans Health Administration primary care clinics were randomized to receive coaching and an online care coordination toolkit (“coached”; n = 6) or access to the toolkit only (“non-coached”; n = 6). We did interviews at six, 12, and 18 months. For coached sites, we‘ly collected site visit fieldnotes, prospective coach logs, retrospective coach team debriefs, and project reports. We employed matrix analysis using constructs from the Consolidated Framework for Implementation Research and a taxonomy of outcomes. We assessed each site’s project(s) using an adapted Complexity Assessment Tool for Systematic Reviews. Results Eleven sites implemented a local CTAC project. Eight sites (5 coached, 3 non-coached) used at least one tool from the toolkit. Coached sites implemented significantly more complex projects than non-coached sites (11.5 vs 7.5, 95% confidence interval 1.75–6.25, p < 0.001); engaged in more formal implementation processes (planning, engaging, reflecting and evaluating); and generally had larger, more multidisciplinary QI teams. Regardless of coaching status, sites focused on internal organizational improvement and low-intensity educational projects rather than the full suite of care coordination tools. At 12 months, half the coached and non-coached sites had clinic-wide project implementation; the remaining coached sites had implemented most of their project(s), while the remaining non-coached sites had either not implemented anything or conducted limited pilots. At 18 months, coached sites reported ongoing effort to monitor, adapt, and spread their CTAC projects, while non-coached sites did not report much continuing work. Coached sites accrued benefits like improved clinic relationships and team QI skill building that non-coached sites did not describe. Conclusions Coaching had a positive influence on QI skills of (and relationships among) coached sites’ team members, and the scope and rigor of projects. However, a 12-month project period was potentially too short to ensure full project implementation or to address cross-setting or patient-partnered initiatives. Trial registration NCT03063294 .
first_indexed 2024-12-17T02:44:42Z
format Article
id doaj.art-929ebf689bb84bf695791c3841998e23
institution Directory Open Access Journal
issn 1472-6963
language English
last_indexed 2024-12-17T02:44:42Z
publishDate 2021-08-01
publisher BMC
record_format Article
series BMC Health Services Research
spelling doaj.art-929ebf689bb84bf695791c3841998e232022-12-21T22:06:37ZengBMCBMC Health Services Research1472-69632021-08-0121111310.1186/s12913-021-06850-1Toolkit and distance coaching strategies: a mixed methods evaluation of a trial to implement care coordination quality improvement projects in primary careLauren S. Penney0Purnima S. Bharath1Isomi Miake-Lye2Mei Leng3Tanya T. Olmos-Ochoa4Erin P. Finley5Neetu Chawla6Jenny M. Barnard7David A. Ganz8Elizabeth Dole Center of Excellence for Veteran & Caregiver Research, South Texas Veterans Health Care SystemHSR&D Center for the Study of Healthcare Innovation, Implementation and Policy (CSHIIP), VA Greater Los Angeles Healthcare SystemHSR&D Center for the Study of Healthcare Innovation, Implementation and Policy (CSHIIP), VA Greater Los Angeles Healthcare SystemDavid Geffen School of Medicine, University of California at Los AngelesHSR&D Center for the Study of Healthcare Innovation, Implementation and Policy (CSHIIP), VA Greater Los Angeles Healthcare SystemElizabeth Dole Center of Excellence for Veteran & Caregiver Research, South Texas Veterans Health Care SystemHSR&D Center for the Study of Healthcare Innovation, Implementation and Policy (CSHIIP), VA Greater Los Angeles Healthcare SystemHSR&D Center for the Study of Healthcare Innovation, Implementation and Policy (CSHIIP), VA Greater Los Angeles Healthcare SystemHSR&D Center for the Study of Healthcare Innovation, Implementation and Policy (CSHIIP), VA Greater Los Angeles Healthcare SystemAbstract Background Care coordination tools and toolkits can be challenging to implement. Practice facilitation, an active but expensive strategy, may facilitate toolkit implementation. We evaluated the comparative effectiveness of distance coaching, a form of practice facilitation, for improving the implementation of care coordination quality improvement (QI) projects. Methods We conducted a mixed methods evaluation of the Coordination Toolkit and Coaching (CTAC) initiative. Twelve matched US Veterans Health Administration primary care clinics were randomized to receive coaching and an online care coordination toolkit (“coached”; n = 6) or access to the toolkit only (“non-coached”; n = 6). We did interviews at six, 12, and 18 months. For coached sites, we‘ly collected site visit fieldnotes, prospective coach logs, retrospective coach team debriefs, and project reports. We employed matrix analysis using constructs from the Consolidated Framework for Implementation Research and a taxonomy of outcomes. We assessed each site’s project(s) using an adapted Complexity Assessment Tool for Systematic Reviews. Results Eleven sites implemented a local CTAC project. Eight sites (5 coached, 3 non-coached) used at least one tool from the toolkit. Coached sites implemented significantly more complex projects than non-coached sites (11.5 vs 7.5, 95% confidence interval 1.75–6.25, p < 0.001); engaged in more formal implementation processes (planning, engaging, reflecting and evaluating); and generally had larger, more multidisciplinary QI teams. Regardless of coaching status, sites focused on internal organizational improvement and low-intensity educational projects rather than the full suite of care coordination tools. At 12 months, half the coached and non-coached sites had clinic-wide project implementation; the remaining coached sites had implemented most of their project(s), while the remaining non-coached sites had either not implemented anything or conducted limited pilots. At 18 months, coached sites reported ongoing effort to monitor, adapt, and spread their CTAC projects, while non-coached sites did not report much continuing work. Coached sites accrued benefits like improved clinic relationships and team QI skill building that non-coached sites did not describe. Conclusions Coaching had a positive influence on QI skills of (and relationships among) coached sites’ team members, and the scope and rigor of projects. However, a 12-month project period was potentially too short to ensure full project implementation or to address cross-setting or patient-partnered initiatives. Trial registration NCT03063294 .https://doi.org/10.1186/s12913-021-06850-1Quality improvementCare coordinationPrimary careExternal facilitationToolkitConsolidated framework for implementation research
spellingShingle Lauren S. Penney
Purnima S. Bharath
Isomi Miake-Lye
Mei Leng
Tanya T. Olmos-Ochoa
Erin P. Finley
Neetu Chawla
Jenny M. Barnard
David A. Ganz
Toolkit and distance coaching strategies: a mixed methods evaluation of a trial to implement care coordination quality improvement projects in primary care
BMC Health Services Research
Quality improvement
Care coordination
Primary care
External facilitation
Toolkit
Consolidated framework for implementation research
title Toolkit and distance coaching strategies: a mixed methods evaluation of a trial to implement care coordination quality improvement projects in primary care
title_full Toolkit and distance coaching strategies: a mixed methods evaluation of a trial to implement care coordination quality improvement projects in primary care
title_fullStr Toolkit and distance coaching strategies: a mixed methods evaluation of a trial to implement care coordination quality improvement projects in primary care
title_full_unstemmed Toolkit and distance coaching strategies: a mixed methods evaluation of a trial to implement care coordination quality improvement projects in primary care
title_short Toolkit and distance coaching strategies: a mixed methods evaluation of a trial to implement care coordination quality improvement projects in primary care
title_sort toolkit and distance coaching strategies a mixed methods evaluation of a trial to implement care coordination quality improvement projects in primary care
topic Quality improvement
Care coordination
Primary care
External facilitation
Toolkit
Consolidated framework for implementation research
url https://doi.org/10.1186/s12913-021-06850-1
work_keys_str_mv AT laurenspenney toolkitanddistancecoachingstrategiesamixedmethodsevaluationofatrialtoimplementcarecoordinationqualityimprovementprojectsinprimarycare
AT purnimasbharath toolkitanddistancecoachingstrategiesamixedmethodsevaluationofatrialtoimplementcarecoordinationqualityimprovementprojectsinprimarycare
AT isomimiakelye toolkitanddistancecoachingstrategiesamixedmethodsevaluationofatrialtoimplementcarecoordinationqualityimprovementprojectsinprimarycare
AT meileng toolkitanddistancecoachingstrategiesamixedmethodsevaluationofatrialtoimplementcarecoordinationqualityimprovementprojectsinprimarycare
AT tanyatolmosochoa toolkitanddistancecoachingstrategiesamixedmethodsevaluationofatrialtoimplementcarecoordinationqualityimprovementprojectsinprimarycare
AT erinpfinley toolkitanddistancecoachingstrategiesamixedmethodsevaluationofatrialtoimplementcarecoordinationqualityimprovementprojectsinprimarycare
AT neetuchawla toolkitanddistancecoachingstrategiesamixedmethodsevaluationofatrialtoimplementcarecoordinationqualityimprovementprojectsinprimarycare
AT jennymbarnard toolkitanddistancecoachingstrategiesamixedmethodsevaluationofatrialtoimplementcarecoordinationqualityimprovementprojectsinprimarycare
AT davidaganz toolkitanddistancecoachingstrategiesamixedmethodsevaluationofatrialtoimplementcarecoordinationqualityimprovementprojectsinprimarycare