Clinician motivational interviewing skills in ‘simulated’ and ‘real-life’ consultations differ and show predictive validity for ‘real life’ client change talk under differing integrity thresholds
Background Accurate and reliable assessment of clinician integrity in the delivery of empirically supported treatments is critical to effective research and training interventions. Assessment of clinician integrity can be performed through recording simulated (SI) or real-life (RL) consultations, ye...
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
PeerJ Inc.
2023-10-01
|
| Series: | PeerJ |
| Subjects: | |
| Online Access: | https://peerj.com/articles/14634.pdf |
| _version_ | 1797419905803354112 |
|---|---|
| author | Alison Bard Lars Forsberg Hans Wickström Ulf Emanuelson Kristen Reyher Catarina Svensson |
| author_facet | Alison Bard Lars Forsberg Hans Wickström Ulf Emanuelson Kristen Reyher Catarina Svensson |
| author_sort | Alison Bard |
| collection | DOAJ |
| description | Background Accurate and reliable assessment of clinician integrity in the delivery of empirically supported treatments is critical to effective research and training interventions. Assessment of clinician integrity can be performed through recording simulated (SI) or real-life (RL) consultations, yet research examining the equivalence of these data is in its infancy. To explore the strength of integrity assessment between SI and RL samples in Motivational Interviewing (MI) consultations, this article examines whether Motivational Interviewing Treatment Integrity (MITI) assessments differ between SI and RL consultations and reviews the predictive validity of SI and RL MI skills categorisations for RL client response language. Methods This study first compared MITI coding obtained in SI and RL consultations for 36 veterinary clinicians. Multilevel models of 10 MITI behaviour counts and four MITI global scores were run using MLwiN 3.02 to assess if a significant difference existed between SI and RL MITI data, with consultation within clinician within cohort (A and B) as nested random effects. Second, we investigated the effect of SI and RL MI skills groupings on rate of RL client response talk using three multivariable regression models. Two Poisson regression models, with random intercepts for farm and veterinarian and offset for number of minutes of the recordings, were estimated in the statistical software R using the package glmmTMB for the two response variables Change Talk and Sustain Talk. A logistic regression model, with the same random intercepts, with the response variable Proportion Change Talk was also estimated using the same package. Results Veterinary clinicians were less MI consistent in RL consultations, evidenced through significantly lower global MITI Cultivating Change Talk (p < 0.001), Partnership (p < 0.001) and Empathy (p = 0.003) measures. Despite lower objective MI skills groupings in RL consultations, ranking order of veterinary clinicians by MI skills was similar between contexts. The predictive validity of SI and RL MI skills groupings for RL client Change Talk was therefore similar, with significantly more RL client Change Talk associated with veterinarians categorised in the highest grouping (‘moderate’) in both SI (p = 0.01) and RL (p = 0.02) compared to untrained veterinarians in each respective context. Conclusions Findings suggest SI and RL data may not be interchangeable. Whilst both data offer useful insights for specific research and training purposes, differing contextual MI skills thresholds may offer a more equitable assessment of clinician RL client-facing MI integrity. Further research is needed to explore the applicability of these findings across health contexts. |
| first_indexed | 2024-03-09T06:54:55Z |
| format | Article |
| id | doaj.art-3009c1bce506415188611de3e39fcf6e |
| institution | Directory Open Access Journal |
| issn | 2167-8359 |
| language | English |
| last_indexed | 2024-03-09T06:54:55Z |
| publishDate | 2023-10-01 |
| publisher | PeerJ Inc. |
| record_format | Article |
| series | PeerJ |
| spelling | doaj.art-3009c1bce506415188611de3e39fcf6e2023-12-03T10:07:35ZengPeerJ Inc.PeerJ2167-83592023-10-0111e1463410.7717/peerj.14634Clinician motivational interviewing skills in ‘simulated’ and ‘real-life’ consultations differ and show predictive validity for ‘real life’ client change talk under differing integrity thresholdsAlison Bard0Lars Forsberg1Hans Wickström2Ulf Emanuelson3Kristen Reyher4Catarina Svensson5Bristol Veterinary School, The University of Bristol, Bristol, United KingdomMICLab AB, Stockholm, SwedenMeetMe Psykologkonsult AB, Gothenburg, SwedenDepartment of Clinical Sciences, Swedish University of Agricultural Sciences, Uppsala, SwedenBristol Veterinary School, The University of Bristol, Bristol, United KingdomDepartment of Clinical Sciences, Swedish University of Agricultural Sciences, Uppsala, SwedenBackground Accurate and reliable assessment of clinician integrity in the delivery of empirically supported treatments is critical to effective research and training interventions. Assessment of clinician integrity can be performed through recording simulated (SI) or real-life (RL) consultations, yet research examining the equivalence of these data is in its infancy. To explore the strength of integrity assessment between SI and RL samples in Motivational Interviewing (MI) consultations, this article examines whether Motivational Interviewing Treatment Integrity (MITI) assessments differ between SI and RL consultations and reviews the predictive validity of SI and RL MI skills categorisations for RL client response language. Methods This study first compared MITI coding obtained in SI and RL consultations for 36 veterinary clinicians. Multilevel models of 10 MITI behaviour counts and four MITI global scores were run using MLwiN 3.02 to assess if a significant difference existed between SI and RL MITI data, with consultation within clinician within cohort (A and B) as nested random effects. Second, we investigated the effect of SI and RL MI skills groupings on rate of RL client response talk using three multivariable regression models. Two Poisson regression models, with random intercepts for farm and veterinarian and offset for number of minutes of the recordings, were estimated in the statistical software R using the package glmmTMB for the two response variables Change Talk and Sustain Talk. A logistic regression model, with the same random intercepts, with the response variable Proportion Change Talk was also estimated using the same package. Results Veterinary clinicians were less MI consistent in RL consultations, evidenced through significantly lower global MITI Cultivating Change Talk (p < 0.001), Partnership (p < 0.001) and Empathy (p = 0.003) measures. Despite lower objective MI skills groupings in RL consultations, ranking order of veterinary clinicians by MI skills was similar between contexts. The predictive validity of SI and RL MI skills groupings for RL client Change Talk was therefore similar, with significantly more RL client Change Talk associated with veterinarians categorised in the highest grouping (‘moderate’) in both SI (p = 0.01) and RL (p = 0.02) compared to untrained veterinarians in each respective context. Conclusions Findings suggest SI and RL data may not be interchangeable. Whilst both data offer useful insights for specific research and training purposes, differing contextual MI skills thresholds may offer a more equitable assessment of clinician RL client-facing MI integrity. Further research is needed to explore the applicability of these findings across health contexts.https://peerj.com/articles/14634.pdfMotivational interviewingCommunicationSimulated clientsRole playAsessmentStandard patient |
| spellingShingle | Alison Bard Lars Forsberg Hans Wickström Ulf Emanuelson Kristen Reyher Catarina Svensson Clinician motivational interviewing skills in ‘simulated’ and ‘real-life’ consultations differ and show predictive validity for ‘real life’ client change talk under differing integrity thresholds PeerJ Motivational interviewing Communication Simulated clients Role play Asessment Standard patient |
| title | Clinician motivational interviewing skills in ‘simulated’ and ‘real-life’ consultations differ and show predictive validity for ‘real life’ client change talk under differing integrity thresholds |
| title_full | Clinician motivational interviewing skills in ‘simulated’ and ‘real-life’ consultations differ and show predictive validity for ‘real life’ client change talk under differing integrity thresholds |
| title_fullStr | Clinician motivational interviewing skills in ‘simulated’ and ‘real-life’ consultations differ and show predictive validity for ‘real life’ client change talk under differing integrity thresholds |
| title_full_unstemmed | Clinician motivational interviewing skills in ‘simulated’ and ‘real-life’ consultations differ and show predictive validity for ‘real life’ client change talk under differing integrity thresholds |
| title_short | Clinician motivational interviewing skills in ‘simulated’ and ‘real-life’ consultations differ and show predictive validity for ‘real life’ client change talk under differing integrity thresholds |
| title_sort | clinician motivational interviewing skills in simulated and real life consultations differ and show predictive validity for real life client change talk under differing integrity thresholds |
| topic | Motivational interviewing Communication Simulated clients Role play Asessment Standard patient |
| url | https://peerj.com/articles/14634.pdf |
| work_keys_str_mv | AT alisonbard clinicianmotivationalinterviewingskillsinsimulatedandreallifeconsultationsdifferandshowpredictivevalidityforreallifeclientchangetalkunderdifferingintegritythresholds AT larsforsberg clinicianmotivationalinterviewingskillsinsimulatedandreallifeconsultationsdifferandshowpredictivevalidityforreallifeclientchangetalkunderdifferingintegritythresholds AT hanswickstrom clinicianmotivationalinterviewingskillsinsimulatedandreallifeconsultationsdifferandshowpredictivevalidityforreallifeclientchangetalkunderdifferingintegritythresholds AT ulfemanuelson clinicianmotivationalinterviewingskillsinsimulatedandreallifeconsultationsdifferandshowpredictivevalidityforreallifeclientchangetalkunderdifferingintegritythresholds AT kristenreyher clinicianmotivationalinterviewingskillsinsimulatedandreallifeconsultationsdifferandshowpredictivevalidityforreallifeclientchangetalkunderdifferingintegritythresholds AT catarinasvensson clinicianmotivationalinterviewingskillsinsimulatedandreallifeconsultationsdifferandshowpredictivevalidityforreallifeclientchangetalkunderdifferingintegritythresholds |