Perceived communication effectiveness in implementation strategies: a measurement scale
Abstract Background Communication-based activities and products (i.e., training programs, webinars) are a critical component of implementation strategies that relay information to various audiences. Audience perceptions of communication effectiveness contribute important insight into the processes a...
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
BMC
2022-04-01
|
| Series: | Implementation Science Communications |
| Subjects: | |
| Online Access: | https://doi.org/10.1186/s43058-022-00284-4 |
| _version_ | 1819210426953498624 |
|---|---|
| author | Xiaoquan Zhao Heather Toronjo Cameron C. Shaw Amy Murphy Faye S. Taxman |
| author_facet | Xiaoquan Zhao Heather Toronjo Cameron C. Shaw Amy Murphy Faye S. Taxman |
| author_sort | Xiaoquan Zhao |
| collection | DOAJ |
| description | Abstract Background Communication-based activities and products (i.e., training programs, webinars) are a critical component of implementation strategies that relay information to various audiences. Audience perceptions of communication effectiveness contribute important insight into the processes and mechanisms through which an implementation effort may succeed or fail. To advance research on this front, a psychometrically sound instrument for measuring perceived communication effectiveness (PCE) is needed. Methods An expert panel identified the theoretical foundations and conceptual domains of PCE and drafted preliminary items. Five focus groups of correctional professionals who had recently completed an implementation leadership training reviewed the items and provided feedback for refinement. Revised items were then included in a survey-based evaluation of an ongoing eLearning curriculum designed to improve the practices used by front-line probation officers in supervising individuals in the field. The factorial structure of a final 6-item scale as well as its convergent, divergent, and predictive validity was evaluated using data from the evaluation surveys (N follow-up = 358, N baseline+follow-up = 159). Results Confirmatory factor analysis of the final scale of PCE demonstrated adequate fit. PCE was strongly correlated with measures of implementation outcomes (acceptability, r = .819, p < .001; appropriateness, r = .809, p < .001; and feasibility, r = .754, p < .001), yet uncorrelated with a scale of need to evaluate (r = − .051, p = .422), demonstrating both convergent and divergent validities. The predictive validity of PCE was evidenced by significant associations between PCE and key training outcomes, including perceived staff use of evidence-based practices (β = .230, p < .05), agency climate (β = .261, p < .05), and value concordance (β = .209, p < .05), after controlling for baseline values and other confounders. Conclusions The PCE scale is psychometrically sound and can be a useful tool for gauging audience receptivity to and the potential impact of communication-based implementation activities and products. |
| first_indexed | 2024-12-23T06:11:00Z |
| format | Article |
| id | doaj.art-121a1c740cf84a5fb9433888b582fbe2 |
| institution | Directory Open Access Journal |
| issn | 2662-2211 |
| language | English |
| last_indexed | 2024-12-23T06:11:00Z |
| publishDate | 2022-04-01 |
| publisher | BMC |
| record_format | Article |
| series | Implementation Science Communications |
| spelling | doaj.art-121a1c740cf84a5fb9433888b582fbe22022-12-21T17:57:26ZengBMCImplementation Science Communications2662-22112022-04-013111310.1186/s43058-022-00284-4Perceived communication effectiveness in implementation strategies: a measurement scaleXiaoquan Zhao0Heather Toronjo1Cameron C. Shaw2Amy Murphy3Faye S. Taxman4Department of Communication, George Mason UniversityCenter for Advancing Correctional Excellence, Schar School of Policy and Government, George Mason UniversityCenter for Advancing Correctional Excellence, Schar School of Policy and Government, George Mason UniversityCenter for Advancing Correctional Excellence, Schar School of Policy and Government, George Mason UniversityCenter for Advancing Correctional Excellence, Schar School of Policy and Government, George Mason UniversityAbstract Background Communication-based activities and products (i.e., training programs, webinars) are a critical component of implementation strategies that relay information to various audiences. Audience perceptions of communication effectiveness contribute important insight into the processes and mechanisms through which an implementation effort may succeed or fail. To advance research on this front, a psychometrically sound instrument for measuring perceived communication effectiveness (PCE) is needed. Methods An expert panel identified the theoretical foundations and conceptual domains of PCE and drafted preliminary items. Five focus groups of correctional professionals who had recently completed an implementation leadership training reviewed the items and provided feedback for refinement. Revised items were then included in a survey-based evaluation of an ongoing eLearning curriculum designed to improve the practices used by front-line probation officers in supervising individuals in the field. The factorial structure of a final 6-item scale as well as its convergent, divergent, and predictive validity was evaluated using data from the evaluation surveys (N follow-up = 358, N baseline+follow-up = 159). Results Confirmatory factor analysis of the final scale of PCE demonstrated adequate fit. PCE was strongly correlated with measures of implementation outcomes (acceptability, r = .819, p < .001; appropriateness, r = .809, p < .001; and feasibility, r = .754, p < .001), yet uncorrelated with a scale of need to evaluate (r = − .051, p = .422), demonstrating both convergent and divergent validities. The predictive validity of PCE was evidenced by significant associations between PCE and key training outcomes, including perceived staff use of evidence-based practices (β = .230, p < .05), agency climate (β = .261, p < .05), and value concordance (β = .209, p < .05), after controlling for baseline values and other confounders. Conclusions The PCE scale is psychometrically sound and can be a useful tool for gauging audience receptivity to and the potential impact of communication-based implementation activities and products.https://doi.org/10.1186/s43058-022-00284-4CommunicationImplementation strategiesPerceived effectivenessMeasurement |
| spellingShingle | Xiaoquan Zhao Heather Toronjo Cameron C. Shaw Amy Murphy Faye S. Taxman Perceived communication effectiveness in implementation strategies: a measurement scale Implementation Science Communications Communication Implementation strategies Perceived effectiveness Measurement |
| title | Perceived communication effectiveness in implementation strategies: a measurement scale |
| title_full | Perceived communication effectiveness in implementation strategies: a measurement scale |
| title_fullStr | Perceived communication effectiveness in implementation strategies: a measurement scale |
| title_full_unstemmed | Perceived communication effectiveness in implementation strategies: a measurement scale |
| title_short | Perceived communication effectiveness in implementation strategies: a measurement scale |
| title_sort | perceived communication effectiveness in implementation strategies a measurement scale |
| topic | Communication Implementation strategies Perceived effectiveness Measurement |
| url | https://doi.org/10.1186/s43058-022-00284-4 |
| work_keys_str_mv | AT xiaoquanzhao perceivedcommunicationeffectivenessinimplementationstrategiesameasurementscale AT heathertoronjo perceivedcommunicationeffectivenessinimplementationstrategiesameasurementscale AT cameroncshaw perceivedcommunicationeffectivenessinimplementationstrategiesameasurementscale AT amymurphy perceivedcommunicationeffectivenessinimplementationstrategiesameasurementscale AT fayestaxman perceivedcommunicationeffectivenessinimplementationstrategiesameasurementscale |