Discrepancies between qualitative and quantitative evaluation of randomised controlled trial results: achieving clarity through mixed methods triangulation

Background<br/> Mixed methods are commonly used in health services research however data are not often integrated to explore complementarity of findings. A triangulation protocol is one approach to integrating such data. A retrospective triangulation protocol was carried out on mixed methods d...

Full description

Bibliographic Details
Main Authors: Tonkin-Crine, S, Anthierens, S, Hood, K, Yardley, L, Cals, J, Francis, N, Coenen, S, van der Velden, A, Godycki-Cwirko, M, Llor, C, Butler, C, Verheij, T, Goossens, H, Little, P, GRACE INTRO/CHAMP consortium
Format: Journal article
Published: BioMed Central 2016
_version_ 1797100250083622912
author Tonkin-Crine, S
Anthierens, S
Hood, K
Yardley, L
Cals, J
Francis, N
Coenen, S
van der Velden, A
Godycki-Cwirko, M
Llor, C
Butler, C
Verheij, T
Goossens, H
Little, P
GRACE INTRO/CHAMP consortium
author_facet Tonkin-Crine, S
Anthierens, S
Hood, K
Yardley, L
Cals, J
Francis, N
Coenen, S
van der Velden, A
Godycki-Cwirko, M
Llor, C
Butler, C
Verheij, T
Goossens, H
Little, P
GRACE INTRO/CHAMP consortium
author_sort Tonkin-Crine, S
collection OXFORD
description Background<br/> Mixed methods are commonly used in health services research however data are not often integrated to explore complementarity of findings. A triangulation protocol is one approach to integrating such data. A retrospective triangulation protocol was carried out on mixed methods data collected as part of a process evaluation of a trial. The multi-country randomised controlled trial found that a web-based training in communication skills (including use of a patient booklet) and the use of a C-reactive protein (CRP) point of care test decreased antibiotic prescribing by general practitioners (GPs) for acute cough. The process evaluation investigated GPs’ and patients’ experiences of taking part in the trial.<br/><br/> Methods<br/> Three analysts independently compared findings across four data sets: qualitative data collected view semi-structured interviews with 1) 62 patients and 2) 66 GPs and quantitative data collected via questionnaires with 3) 2886 patients and 4) 346 GPs. Pairwise comparisons were made between data sets and were categorised as agreement, partial agreement, dissonance or silence.<br/><br/> Results<br/> Three instances of dissonance occurred in thirty-nine independent findings. GPs and patients reported different views on the use of a CRP test. GPs felt the test was useful in convincing patients to accept a no-antibiotic decision, but patient data suggested this was unnecessary if a full explanation was given. While qualitative data indicated all patients were generally satisfied with their consultation, quantitative data indicated highest levels of satisfaction for those receiving a detailed explanation from their GP with a booklet giving advice on self-care. Both qualitative and quantitative data sets indicated higher patient enablement for those in the communication groups who had received a booklet.<br/><br/> Conclusions<br/> Use of CRP tests does not appear to engage patients or influence illness perceptions and its effect is more centred on changing clinician behaviour. Communication skills and the patient booklet were relevant and useful for all patients and associated with increased patient satisfaction. A triangulation protocol to integrate qualitative and quantitative data can reveal findings that need further interpretation and also highlight areas of dissonance that lead to a deeper insight than separate analyses.
first_indexed 2024-03-07T05:35:01Z
format Journal article
id oxford-uuid:e399fa71-c385-4b9e-8edc-a11a5dabd83a
institution University of Oxford
last_indexed 2024-03-07T05:35:01Z
publishDate 2016
publisher BioMed Central
record_format dspace
spelling oxford-uuid:e399fa71-c385-4b9e-8edc-a11a5dabd83a2022-03-27T10:10:12ZDiscrepancies between qualitative and quantitative evaluation of randomised controlled trial results: achieving clarity through mixed methods triangulationJournal articlehttp://purl.org/coar/resource_type/c_dcae04bcuuid:e399fa71-c385-4b9e-8edc-a11a5dabd83aSymplectic Elements at OxfordBioMed Central2016Tonkin-Crine, SAnthierens, SHood, KYardley, LCals, JFrancis, NCoenen, Svan der Velden, AGodycki-Cwirko, MLlor, CButler, CVerheij, TGoossens, HLittle, PGRACE INTRO/CHAMP consortiumBackground<br/> Mixed methods are commonly used in health services research however data are not often integrated to explore complementarity of findings. A triangulation protocol is one approach to integrating such data. A retrospective triangulation protocol was carried out on mixed methods data collected as part of a process evaluation of a trial. The multi-country randomised controlled trial found that a web-based training in communication skills (including use of a patient booklet) and the use of a C-reactive protein (CRP) point of care test decreased antibiotic prescribing by general practitioners (GPs) for acute cough. The process evaluation investigated GPs’ and patients’ experiences of taking part in the trial.<br/><br/> Methods<br/> Three analysts independently compared findings across four data sets: qualitative data collected view semi-structured interviews with 1) 62 patients and 2) 66 GPs and quantitative data collected via questionnaires with 3) 2886 patients and 4) 346 GPs. Pairwise comparisons were made between data sets and were categorised as agreement, partial agreement, dissonance or silence.<br/><br/> Results<br/> Three instances of dissonance occurred in thirty-nine independent findings. GPs and patients reported different views on the use of a CRP test. GPs felt the test was useful in convincing patients to accept a no-antibiotic decision, but patient data suggested this was unnecessary if a full explanation was given. While qualitative data indicated all patients were generally satisfied with their consultation, quantitative data indicated highest levels of satisfaction for those receiving a detailed explanation from their GP with a booklet giving advice on self-care. Both qualitative and quantitative data sets indicated higher patient enablement for those in the communication groups who had received a booklet.<br/><br/> Conclusions<br/> Use of CRP tests does not appear to engage patients or influence illness perceptions and its effect is more centred on changing clinician behaviour. Communication skills and the patient booklet were relevant and useful for all patients and associated with increased patient satisfaction. A triangulation protocol to integrate qualitative and quantitative data can reveal findings that need further interpretation and also highlight areas of dissonance that lead to a deeper insight than separate analyses.
spellingShingle Tonkin-Crine, S
Anthierens, S
Hood, K
Yardley, L
Cals, J
Francis, N
Coenen, S
van der Velden, A
Godycki-Cwirko, M
Llor, C
Butler, C
Verheij, T
Goossens, H
Little, P
GRACE INTRO/CHAMP consortium
Discrepancies between qualitative and quantitative evaluation of randomised controlled trial results: achieving clarity through mixed methods triangulation
title Discrepancies between qualitative and quantitative evaluation of randomised controlled trial results: achieving clarity through mixed methods triangulation
title_full Discrepancies between qualitative and quantitative evaluation of randomised controlled trial results: achieving clarity through mixed methods triangulation
title_fullStr Discrepancies between qualitative and quantitative evaluation of randomised controlled trial results: achieving clarity through mixed methods triangulation
title_full_unstemmed Discrepancies between qualitative and quantitative evaluation of randomised controlled trial results: achieving clarity through mixed methods triangulation
title_short Discrepancies between qualitative and quantitative evaluation of randomised controlled trial results: achieving clarity through mixed methods triangulation
title_sort discrepancies between qualitative and quantitative evaluation of randomised controlled trial results achieving clarity through mixed methods triangulation
work_keys_str_mv AT tonkincrines discrepanciesbetweenqualitativeandquantitativeevaluationofrandomisedcontrolledtrialresultsachievingclaritythroughmixedmethodstriangulation
AT anthierenss discrepanciesbetweenqualitativeandquantitativeevaluationofrandomisedcontrolledtrialresultsachievingclaritythroughmixedmethodstriangulation
AT hoodk discrepanciesbetweenqualitativeandquantitativeevaluationofrandomisedcontrolledtrialresultsachievingclaritythroughmixedmethodstriangulation
AT yardleyl discrepanciesbetweenqualitativeandquantitativeevaluationofrandomisedcontrolledtrialresultsachievingclaritythroughmixedmethodstriangulation
AT calsj discrepanciesbetweenqualitativeandquantitativeevaluationofrandomisedcontrolledtrialresultsachievingclaritythroughmixedmethodstriangulation
AT francisn discrepanciesbetweenqualitativeandquantitativeevaluationofrandomisedcontrolledtrialresultsachievingclaritythroughmixedmethodstriangulation
AT coenens discrepanciesbetweenqualitativeandquantitativeevaluationofrandomisedcontrolledtrialresultsachievingclaritythroughmixedmethodstriangulation
AT vanderveldena discrepanciesbetweenqualitativeandquantitativeevaluationofrandomisedcontrolledtrialresultsachievingclaritythroughmixedmethodstriangulation
AT godyckicwirkom discrepanciesbetweenqualitativeandquantitativeevaluationofrandomisedcontrolledtrialresultsachievingclaritythroughmixedmethodstriangulation
AT llorc discrepanciesbetweenqualitativeandquantitativeevaluationofrandomisedcontrolledtrialresultsachievingclaritythroughmixedmethodstriangulation
AT butlerc discrepanciesbetweenqualitativeandquantitativeevaluationofrandomisedcontrolledtrialresultsachievingclaritythroughmixedmethodstriangulation
AT verheijt discrepanciesbetweenqualitativeandquantitativeevaluationofrandomisedcontrolledtrialresultsachievingclaritythroughmixedmethodstriangulation
AT goossensh discrepanciesbetweenqualitativeandquantitativeevaluationofrandomisedcontrolledtrialresultsachievingclaritythroughmixedmethodstriangulation
AT littlep discrepanciesbetweenqualitativeandquantitativeevaluationofrandomisedcontrolledtrialresultsachievingclaritythroughmixedmethodstriangulation
AT graceintrochampconsortium discrepanciesbetweenqualitativeandquantitativeevaluationofrandomisedcontrolledtrialresultsachievingclaritythroughmixedmethodstriangulation