Underreporting of the active content of behavioural interventions: A systematic review and meta-analysis of randomized trials of smoking cessation interventions

Despite its importance, underreporting of the active content of experimental and comparator interventions in published literature has not been previously examined for behavioural trials. We assessed completeness and variability in reporting in 142 randomised controlled trials of behavioural interven...

Full description

Bibliographic Details
Main Authors: de Bruin, M, Black, N, Javornik, N, Veichtbaue, W, Eisma, M, Hartmann-Boyce, J, Williams, A, West, R, Michie, S, Johnston, M
Format: Journal article
Language:English
Published: Taylor and Francis 2020
_version_ 1797082364178857984
author de Bruin, M
Black, N
Javornik, N
Veichtbaue, W
Eisma, M
Hartmann-Boyce, J
Williams, A
West, R
Michie, S
Johnston, M
author_facet de Bruin, M
Black, N
Javornik, N
Veichtbaue, W
Eisma, M
Hartmann-Boyce, J
Williams, A
West, R
Michie, S
Johnston, M
author_sort de Bruin, M
collection OXFORD
description Despite its importance, underreporting of the active content of experimental and comparator interventions in published literature has not been previously examined for behavioural trials. We assessed completeness and variability in reporting in 142 randomised controlled trials of behavioural interventions for smoking cessation published between 1/1996 and 11/2015. Two coders reliably identified the potential active components of experimental and comparator interventions (activities targeting behaviours key to smoking cessation and qualifying as behaviour change techniques, BCTs) in published, and in unpublished materials obtained from study authors directly. Unpublished materials were obtained for 129/204 (63%) experimental and 93/142 (65%) comparator groups. For those, only 35% (1200/3403) of experimental and 26% (491/1891) of comparator BCTs could be identified in published materials. Reporting quality (#published BCTs/#total BCTs) varied considerably between trials and between groups within trials. Experimental (vs. comparator) interventions were better reported (B(SE) = 0.34 (0.11), p < .001). Unpublished materials were more often obtained for recent studies (B(SE) = 0.093 (0.03), p = .003) published in behavioural (vs. medical) journals (B(SE) = 1.03 (0.41), p = .012). This high variability in underreporting of active content compromises reader's ability to interpret the effects of individual trials, compare and explain intervention effects in evidence syntheses, and estimate the additional benefit of an experimental intervention in other settings.
first_indexed 2024-03-07T01:27:05Z
format Journal article
id oxford-uuid:9257ca5f-351e-4749-afdc-54111810fd0b
institution University of Oxford
language English
last_indexed 2024-03-07T01:27:05Z
publishDate 2020
publisher Taylor and Francis
record_format dspace
spelling oxford-uuid:9257ca5f-351e-4749-afdc-54111810fd0b2022-03-26T23:24:51ZUnderreporting of the active content of behavioural interventions: A systematic review and meta-analysis of randomized trials of smoking cessation interventionsJournal articlehttp://purl.org/coar/resource_type/c_dcae04bcuuid:9257ca5f-351e-4749-afdc-54111810fd0bEnglishSymplectic Elements at OxfordTaylor and Francis2020de Bruin, MBlack, NJavornik, NVeichtbaue, WEisma, MHartmann-Boyce, JWilliams, AWest, RMichie, SJohnston, MDespite its importance, underreporting of the active content of experimental and comparator interventions in published literature has not been previously examined for behavioural trials. We assessed completeness and variability in reporting in 142 randomised controlled trials of behavioural interventions for smoking cessation published between 1/1996 and 11/2015. Two coders reliably identified the potential active components of experimental and comparator interventions (activities targeting behaviours key to smoking cessation and qualifying as behaviour change techniques, BCTs) in published, and in unpublished materials obtained from study authors directly. Unpublished materials were obtained for 129/204 (63%) experimental and 93/142 (65%) comparator groups. For those, only 35% (1200/3403) of experimental and 26% (491/1891) of comparator BCTs could be identified in published materials. Reporting quality (#published BCTs/#total BCTs) varied considerably between trials and between groups within trials. Experimental (vs. comparator) interventions were better reported (B(SE) = 0.34 (0.11), p < .001). Unpublished materials were more often obtained for recent studies (B(SE) = 0.093 (0.03), p = .003) published in behavioural (vs. medical) journals (B(SE) = 1.03 (0.41), p = .012). This high variability in underreporting of active content compromises reader's ability to interpret the effects of individual trials, compare and explain intervention effects in evidence syntheses, and estimate the additional benefit of an experimental intervention in other settings.
spellingShingle de Bruin, M
Black, N
Javornik, N
Veichtbaue, W
Eisma, M
Hartmann-Boyce, J
Williams, A
West, R
Michie, S
Johnston, M
Underreporting of the active content of behavioural interventions: A systematic review and meta-analysis of randomized trials of smoking cessation interventions
title Underreporting of the active content of behavioural interventions: A systematic review and meta-analysis of randomized trials of smoking cessation interventions
title_full Underreporting of the active content of behavioural interventions: A systematic review and meta-analysis of randomized trials of smoking cessation interventions
title_fullStr Underreporting of the active content of behavioural interventions: A systematic review and meta-analysis of randomized trials of smoking cessation interventions
title_full_unstemmed Underreporting of the active content of behavioural interventions: A systematic review and meta-analysis of randomized trials of smoking cessation interventions
title_short Underreporting of the active content of behavioural interventions: A systematic review and meta-analysis of randomized trials of smoking cessation interventions
title_sort underreporting of the active content of behavioural interventions a systematic review and meta analysis of randomized trials of smoking cessation interventions
work_keys_str_mv AT debruinm underreportingoftheactivecontentofbehaviouralinterventionsasystematicreviewandmetaanalysisofrandomizedtrialsofsmokingcessationinterventions
AT blackn underreportingoftheactivecontentofbehaviouralinterventionsasystematicreviewandmetaanalysisofrandomizedtrialsofsmokingcessationinterventions
AT javornikn underreportingoftheactivecontentofbehaviouralinterventionsasystematicreviewandmetaanalysisofrandomizedtrialsofsmokingcessationinterventions
AT veichtbauew underreportingoftheactivecontentofbehaviouralinterventionsasystematicreviewandmetaanalysisofrandomizedtrialsofsmokingcessationinterventions
AT eismam underreportingoftheactivecontentofbehaviouralinterventionsasystematicreviewandmetaanalysisofrandomizedtrialsofsmokingcessationinterventions
AT hartmannboycej underreportingoftheactivecontentofbehaviouralinterventionsasystematicreviewandmetaanalysisofrandomizedtrialsofsmokingcessationinterventions
AT williamsa underreportingoftheactivecontentofbehaviouralinterventionsasystematicreviewandmetaanalysisofrandomizedtrialsofsmokingcessationinterventions
AT westr underreportingoftheactivecontentofbehaviouralinterventionsasystematicreviewandmetaanalysisofrandomizedtrialsofsmokingcessationinterventions
AT michies underreportingoftheactivecontentofbehaviouralinterventionsasystematicreviewandmetaanalysisofrandomizedtrialsofsmokingcessationinterventions
AT johnstonm underreportingoftheactivecontentofbehaviouralinterventionsasystematicreviewandmetaanalysisofrandomizedtrialsofsmokingcessationinterventions