Assessing provider perceptions of training: Initial evaluation of the Acceptability, Feasibility, and Appropriateness Scale
There is a well-documented gap between research and practice in the treatment of mental health problems. One promising approach to bridging this gap is training community-based providers in evidence-based practices (EBPs). However, a paucity of valid, reliable measures to assess a range of outcomes...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
SAGE Publishing
2022-04-01
|
| Series: | Implementation Research and Practice |
| Online Access: | https://doi.org/10.1177/26334895221086269 |
| _version_ | 1819047225808912384 |
|---|---|
| author | Evelyn Cho Aaron R. Lyon Siena K. Tugendrajch Brigid R. Marriott Kristin M. Hawley |
| author_facet | Evelyn Cho Aaron R. Lyon Siena K. Tugendrajch Brigid R. Marriott Kristin M. Hawley |
| author_sort | Evelyn Cho |
| collection | DOAJ |
| description | There is a well-documented gap between research and practice in the treatment of mental health problems. One promising approach to bridging this gap is training community-based providers in evidence-based practices (EBPs). However, a paucity of valid, reliable measures to assess a range of outcomes of such trainings impedes our ability to evaluate and improve training toward this end. The current study examined the factor structure of the Acceptability, Feasibility, Appropriateness Scale (AFAS), a provider-report measure that assesses three perceptual implementation outcomes of trainings that may be leading indicators of training success (i.e., acceptability, feasibility, and appropriateness). Providers who attended half-day EBP trainings for common mental health problems reported on the acceptability, feasibility, and appropriateness of these trainings using the AFAS ( N = 298). Confirmatory factor analysis indicates good fit to the hypothesized three-factor structure (RMSEA = .058, CFI = .990, TLI = .987). Acceptability, feasibility, and appropriateness were three distinct but related constructs. Cronbach's alpha ranged from .86 to .91, indicating acceptable internal consistency for the three subscales. Acceptability and feasibility, but not appropriateness, scores varied between workshops, though variability across workshops was generally limited. This initial evaluation of the AFAS is in line with recent efforts to enhance psychometric reporting practices for implementation outcome measures and provides future directions for further development and refinement of the AFAS. Plain Language Summary Clinician training in evidence-based practices is often used to increase implementation of evidence-based practices in mental health service settings. However, one barrier to evaluating the success of clinician trainings is the lack of measures that reliably and accurately assess clinician training outcomes. This study was the initial evaluation of the Acceptability, Feasibility, Appropriateness Scale (AFAS), a measure that assesses the immediate outcomes of clinician trainings. This study found some evidence supporting the AFAS reliability and its three subscales. With additional item refinement and psychometric testing, the AFAS could become a useful measure of a training's immediate impact on providers. |
| first_indexed | 2024-12-21T10:56:59Z |
| format | Article |
| id | doaj.art-f44ffc20c803465fad6bebac9f8742e8 |
| institution | Directory Open Access Journal |
| issn | 2633-4895 |
| language | English |
| last_indexed | 2024-12-21T10:56:59Z |
| publishDate | 2022-04-01 |
| publisher | SAGE Publishing |
| record_format | Article |
| series | Implementation Research and Practice |
| spelling | doaj.art-f44ffc20c803465fad6bebac9f8742e82022-12-21T19:06:29ZengSAGE PublishingImplementation Research and Practice2633-48952022-04-01310.1177/26334895221086269Assessing provider perceptions of training: Initial evaluation of the Acceptability, Feasibility, and Appropriateness ScaleEvelyn Cho0Aaron R. Lyon1Siena K. Tugendrajch2Brigid R. Marriott3Kristin M. Hawley4 , Columbia, MO, USA Psychiatry and Behavioral Sciences, , Seattle, WA, USA , Columbia, MO, USA , Columbia, MO, USA , Columbia, MO, USAThere is a well-documented gap between research and practice in the treatment of mental health problems. One promising approach to bridging this gap is training community-based providers in evidence-based practices (EBPs). However, a paucity of valid, reliable measures to assess a range of outcomes of such trainings impedes our ability to evaluate and improve training toward this end. The current study examined the factor structure of the Acceptability, Feasibility, Appropriateness Scale (AFAS), a provider-report measure that assesses three perceptual implementation outcomes of trainings that may be leading indicators of training success (i.e., acceptability, feasibility, and appropriateness). Providers who attended half-day EBP trainings for common mental health problems reported on the acceptability, feasibility, and appropriateness of these trainings using the AFAS ( N = 298). Confirmatory factor analysis indicates good fit to the hypothesized three-factor structure (RMSEA = .058, CFI = .990, TLI = .987). Acceptability, feasibility, and appropriateness were three distinct but related constructs. Cronbach's alpha ranged from .86 to .91, indicating acceptable internal consistency for the three subscales. Acceptability and feasibility, but not appropriateness, scores varied between workshops, though variability across workshops was generally limited. This initial evaluation of the AFAS is in line with recent efforts to enhance psychometric reporting practices for implementation outcome measures and provides future directions for further development and refinement of the AFAS. Plain Language Summary Clinician training in evidence-based practices is often used to increase implementation of evidence-based practices in mental health service settings. However, one barrier to evaluating the success of clinician trainings is the lack of measures that reliably and accurately assess clinician training outcomes. This study was the initial evaluation of the Acceptability, Feasibility, Appropriateness Scale (AFAS), a measure that assesses the immediate outcomes of clinician trainings. This study found some evidence supporting the AFAS reliability and its three subscales. With additional item refinement and psychometric testing, the AFAS could become a useful measure of a training's immediate impact on providers.https://doi.org/10.1177/26334895221086269 |
| spellingShingle | Evelyn Cho Aaron R. Lyon Siena K. Tugendrajch Brigid R. Marriott Kristin M. Hawley Assessing provider perceptions of training: Initial evaluation of the Acceptability, Feasibility, and Appropriateness Scale Implementation Research and Practice |
| title | Assessing provider perceptions of training: Initial evaluation of the Acceptability, Feasibility, and Appropriateness Scale |
| title_full | Assessing provider perceptions of training: Initial evaluation of the Acceptability, Feasibility, and Appropriateness Scale |
| title_fullStr | Assessing provider perceptions of training: Initial evaluation of the Acceptability, Feasibility, and Appropriateness Scale |
| title_full_unstemmed | Assessing provider perceptions of training: Initial evaluation of the Acceptability, Feasibility, and Appropriateness Scale |
| title_short | Assessing provider perceptions of training: Initial evaluation of the Acceptability, Feasibility, and Appropriateness Scale |
| title_sort | assessing provider perceptions of training initial evaluation of the acceptability feasibility and appropriateness scale |
| url | https://doi.org/10.1177/26334895221086269 |
| work_keys_str_mv | AT evelyncho assessingproviderperceptionsoftraininginitialevaluationoftheacceptabilityfeasibilityandappropriatenessscale AT aaronrlyon assessingproviderperceptionsoftraininginitialevaluationoftheacceptabilityfeasibilityandappropriatenessscale AT sienaktugendrajch assessingproviderperceptionsoftraininginitialevaluationoftheacceptabilityfeasibilityandappropriatenessscale AT brigidrmarriott assessingproviderperceptionsoftraininginitialevaluationoftheacceptabilityfeasibilityandappropriatenessscale AT kristinmhawley assessingproviderperceptionsoftraininginitialevaluationoftheacceptabilityfeasibilityandappropriatenessscale |