Research Into Evidence-Based Psychological Interventions Needs a Stronger Focus on Replicability

[Background] It is a precondition for evidence-based practice that research is replicable in a wide variety of clinical settings. Current standards for identifying evidence-based psychological interventions and making recommendations for clinical practice in clinical guidelines include criteria that...

Full description

Bibliographic Details
Main Authors: Helen Niemeyer, Christine Knaevelsrud, Robbie C. M. van Aert, Thomas Ehring
Format: Article
Language:English
Published: PsychOpen GOLD/ Leibniz Institute for Psychology 2023-09-01
Series:Clinical Psychology in Europe
Subjects:
Online Access:https://doi.org/10.32872/cpe.9997
_version_ 1797320608319537152
author Helen Niemeyer
Christine Knaevelsrud
Robbie C. M. van Aert
Thomas Ehring
author_facet Helen Niemeyer
Christine Knaevelsrud
Robbie C. M. van Aert
Thomas Ehring
author_sort Helen Niemeyer
collection DOAJ
description [Background] It is a precondition for evidence-based practice that research is replicable in a wide variety of clinical settings. Current standards for identifying evidence-based psychological interventions and making recommendations for clinical practice in clinical guidelines include criteria that are relevant for replicability, but a better understanding as well refined definitions of replicability are needed enabling empirical research on this topic. Recent advances on this issue were made in the wider field of psychology and in other disciplines, which offers the opportunity to define and potentially increase replicability also in research on psychological interventions. [Method] This article proposes a research strategy for assessing, understanding, and improving replicability in research on psychological interventions. [Results/Conclusion] First, we establish a replication taxonomy ranging from direct to conceptual replication adapted to the field of research on clinical interventions, propose study characteristics that increase the trustworthiness of results, and define statistical criteria for successful replication with respect to the quantitative outcomes of the original and replication studies. Second, we propose how to establish such standards for future research, i.e., in order to design future replication studies for psychological interventions as well as to apply them when investigating which factors are causing the (non-)replicability of findings in the current literature.
first_indexed 2024-03-08T04:45:30Z
format Article
id doaj.art-24e1368e81b04040b273b799a49ee31a
institution Directory Open Access Journal
issn 2625-3410
language English
last_indexed 2024-03-08T04:45:30Z
publishDate 2023-09-01
publisher PsychOpen GOLD/ Leibniz Institute for Psychology
record_format Article
series Clinical Psychology in Europe
spelling doaj.art-24e1368e81b04040b273b799a49ee31a2024-02-08T10:52:45ZengPsychOpen GOLD/ Leibniz Institute for PsychologyClinical Psychology in Europe2625-34102023-09-015310.32872/cpe.9997cpe.9997Research Into Evidence-Based Psychological Interventions Needs a Stronger Focus on ReplicabilityHelen Niemeyer0https://orcid.org/0000-0002-7616-1885Christine Knaevelsrud1https://orcid.org/0000-0003-1342-7006Robbie C. M. van Aert2https://orcid.org/0000-0001-6187-0665Thomas Ehring3https://orcid.org/0000-0001-9502-6868Department of Clinical Psychological Intervention, Freie Universität Berlin, Berlin, GermanyDepartment of Clinical Psychological Intervention, Freie Universität Berlin, Berlin, GermanyDepartment of Methodology and Statistics, Tilburg University, Tilburg, the NetherlandsDepartment of Psychology, LMU Munich, Munich, Germany[Background] It is a precondition for evidence-based practice that research is replicable in a wide variety of clinical settings. Current standards for identifying evidence-based psychological interventions and making recommendations for clinical practice in clinical guidelines include criteria that are relevant for replicability, but a better understanding as well refined definitions of replicability are needed enabling empirical research on this topic. Recent advances on this issue were made in the wider field of psychology and in other disciplines, which offers the opportunity to define and potentially increase replicability also in research on psychological interventions. [Method] This article proposes a research strategy for assessing, understanding, and improving replicability in research on psychological interventions. [Results/Conclusion] First, we establish a replication taxonomy ranging from direct to conceptual replication adapted to the field of research on clinical interventions, propose study characteristics that increase the trustworthiness of results, and define statistical criteria for successful replication with respect to the quantitative outcomes of the original and replication studies. Second, we propose how to establish such standards for future research, i.e., in order to design future replication studies for psychological interventions as well as to apply them when investigating which factors are causing the (non-)replicability of findings in the current literature.https://doi.org/10.32872/cpe.9997replicabilityevidence-based interventionscriteria development
spellingShingle Helen Niemeyer
Christine Knaevelsrud
Robbie C. M. van Aert
Thomas Ehring
Research Into Evidence-Based Psychological Interventions Needs a Stronger Focus on Replicability
Clinical Psychology in Europe
replicability
evidence-based interventions
criteria development
title Research Into Evidence-Based Psychological Interventions Needs a Stronger Focus on Replicability
title_full Research Into Evidence-Based Psychological Interventions Needs a Stronger Focus on Replicability
title_fullStr Research Into Evidence-Based Psychological Interventions Needs a Stronger Focus on Replicability
title_full_unstemmed Research Into Evidence-Based Psychological Interventions Needs a Stronger Focus on Replicability
title_short Research Into Evidence-Based Psychological Interventions Needs a Stronger Focus on Replicability
title_sort research into evidence based psychological interventions needs a stronger focus on replicability
topic replicability
evidence-based interventions
criteria development
url https://doi.org/10.32872/cpe.9997
work_keys_str_mv AT helenniemeyer researchintoevidencebasedpsychologicalinterventionsneedsastrongerfocusonreplicability
AT christineknaevelsrud researchintoevidencebasedpsychologicalinterventionsneedsastrongerfocusonreplicability
AT robbiecmvanaert researchintoevidencebasedpsychologicalinterventionsneedsastrongerfocusonreplicability
AT thomasehring researchintoevidencebasedpsychologicalinterventionsneedsastrongerfocusonreplicability