Mediators of measurement-based care implementation in community mental health settings: results from a mixed-methods evaluation

Abstract Background Tailored implementation approaches are touted as superior to standardized ones with the reasoning that tailored approaches afford opportunities to select strategies to resolve determinants of the local context. However, results from implementation trials on this topic are equivoc...

Full description

Bibliographic Details
Main Authors: Cara C. Lewis, Meredith R. Boyd, C. Nathan Marti, Karen Albright
Format: Article
Language:English
Published: BMC 2022-10-01
Series:Implementation Science
Subjects:
Online Access:https://doi.org/10.1186/s13012-022-01244-1
_version_ 1811249997056835584
author Cara C. Lewis
Meredith R. Boyd
C. Nathan Marti
Karen Albright
author_facet Cara C. Lewis
Meredith R. Boyd
C. Nathan Marti
Karen Albright
author_sort Cara C. Lewis
collection DOAJ
description Abstract Background Tailored implementation approaches are touted as superior to standardized ones with the reasoning that tailored approaches afford opportunities to select strategies to resolve determinants of the local context. However, results from implementation trials on this topic are equivocal. Therefore, it is important to explore relevant contextual factors that function as determinants to evaluate if they are improved by tailoring and subsequently associated with changes in implementation outcomes (i.e., via statistical mediation) to better understand how tailoring achieves (or does not achieve) its effects. The present study examined the association between a tailored and standardized implementation approach, contextual factors that might mediate change, and a target implementation outcome in an initiative to implement measurement-based care (specifically the clinical integration of the Patient Health Questionnaire [PHQ-9] for depression) in a community mental health organization. Methods Using a cluster randomized control design, twelve community-based mental health clinics were assigned to a tailored or standardized implementation group. Clinicians completed a self-report battery assessing contextual factors that served as candidate mediators informed by the Framework for Dissemination at three time points: baseline, 5 months after active implementation support, and 10 months after sustainment monitoring. A subset of clinicians also participated in focus groups at 5 months. The routine use of the PHQ-9 (implementation outcome) was monitored during the 10-month sustainment period. Multi-level mediation analyses assessed the association between the implementation group and contextual factors and the association between contextual factors and PHQ-9 completion. Quantitative results were then elaborated by analyzing qualitative data from exemplar sites. Results Although tailored clinics outperformed standard clinics in terms of PHQ-9 completion at the end of active implementation, these group differences disappeared post sustainment monitoring. Perhaps related to this, no significant mediators emerged from our quantitative analyses. Exploratory qualitative analyses of focus group content emphasized the importance of support from colleagues, supervisors, and leadership when implementing clinical innovations in practice. Conclusions Although rates of PHQ-9 completion improved across the study, their sustained levels were roughly equivalent across groups and low overall. No mediators were established using quantitative methods; however, several partial quantitative pathways, as well as themes from the qualitative data, reveal fruitful areas for future research. Trial registration Standardized versus tailored implementation of measurement-based care for depression. ClinicalTrials.gov NCT02266134, first posted on October 16, 2014
first_indexed 2024-04-12T15:57:18Z
format Article
id doaj.art-855f45d5841546018780bb068d64372d
institution Directory Open Access Journal
issn 1748-5908
language English
last_indexed 2024-04-12T15:57:18Z
publishDate 2022-10-01
publisher BMC
record_format Article
series Implementation Science
spelling doaj.art-855f45d5841546018780bb068d64372d2022-12-22T03:26:19ZengBMCImplementation Science1748-59082022-10-0117111810.1186/s13012-022-01244-1Mediators of measurement-based care implementation in community mental health settings: results from a mixed-methods evaluationCara C. Lewis0Meredith R. Boyd1C. Nathan Marti2Karen Albright3Kaiser Permanente Washington Health Research InstituteDepartment of Psychology, University of California Los AngelesAbacist AnalyticsDivision of General Internal Medicine, University of Colorado School of MedicineAbstract Background Tailored implementation approaches are touted as superior to standardized ones with the reasoning that tailored approaches afford opportunities to select strategies to resolve determinants of the local context. However, results from implementation trials on this topic are equivocal. Therefore, it is important to explore relevant contextual factors that function as determinants to evaluate if they are improved by tailoring and subsequently associated with changes in implementation outcomes (i.e., via statistical mediation) to better understand how tailoring achieves (or does not achieve) its effects. The present study examined the association between a tailored and standardized implementation approach, contextual factors that might mediate change, and a target implementation outcome in an initiative to implement measurement-based care (specifically the clinical integration of the Patient Health Questionnaire [PHQ-9] for depression) in a community mental health organization. Methods Using a cluster randomized control design, twelve community-based mental health clinics were assigned to a tailored or standardized implementation group. Clinicians completed a self-report battery assessing contextual factors that served as candidate mediators informed by the Framework for Dissemination at three time points: baseline, 5 months after active implementation support, and 10 months after sustainment monitoring. A subset of clinicians also participated in focus groups at 5 months. The routine use of the PHQ-9 (implementation outcome) was monitored during the 10-month sustainment period. Multi-level mediation analyses assessed the association between the implementation group and contextual factors and the association between contextual factors and PHQ-9 completion. Quantitative results were then elaborated by analyzing qualitative data from exemplar sites. Results Although tailored clinics outperformed standard clinics in terms of PHQ-9 completion at the end of active implementation, these group differences disappeared post sustainment monitoring. Perhaps related to this, no significant mediators emerged from our quantitative analyses. Exploratory qualitative analyses of focus group content emphasized the importance of support from colleagues, supervisors, and leadership when implementing clinical innovations in practice. Conclusions Although rates of PHQ-9 completion improved across the study, their sustained levels were roughly equivalent across groups and low overall. No mediators were established using quantitative methods; however, several partial quantitative pathways, as well as themes from the qualitative data, reveal fruitful areas for future research. Trial registration Standardized versus tailored implementation of measurement-based care for depression. ClinicalTrials.gov NCT02266134, first posted on October 16, 2014https://doi.org/10.1186/s13012-022-01244-1Measurement-based careDepressionCommunity mental healthImplementationSustainmentMediator
spellingShingle Cara C. Lewis
Meredith R. Boyd
C. Nathan Marti
Karen Albright
Mediators of measurement-based care implementation in community mental health settings: results from a mixed-methods evaluation
Implementation Science
Measurement-based care
Depression
Community mental health
Implementation
Sustainment
Mediator
title Mediators of measurement-based care implementation in community mental health settings: results from a mixed-methods evaluation
title_full Mediators of measurement-based care implementation in community mental health settings: results from a mixed-methods evaluation
title_fullStr Mediators of measurement-based care implementation in community mental health settings: results from a mixed-methods evaluation
title_full_unstemmed Mediators of measurement-based care implementation in community mental health settings: results from a mixed-methods evaluation
title_short Mediators of measurement-based care implementation in community mental health settings: results from a mixed-methods evaluation
title_sort mediators of measurement based care implementation in community mental health settings results from a mixed methods evaluation
topic Measurement-based care
Depression
Community mental health
Implementation
Sustainment
Mediator
url https://doi.org/10.1186/s13012-022-01244-1
work_keys_str_mv AT caraclewis mediatorsofmeasurementbasedcareimplementationincommunitymentalhealthsettingsresultsfromamixedmethodsevaluation
AT meredithrboyd mediatorsofmeasurementbasedcareimplementationincommunitymentalhealthsettingsresultsfromamixedmethodsevaluation
AT cnathanmarti mediatorsofmeasurementbasedcareimplementationincommunitymentalhealthsettingsresultsfromamixedmethodsevaluation
AT karenalbright mediatorsofmeasurementbasedcareimplementationincommunitymentalhealthsettingsresultsfromamixedmethodsevaluation