Rate and success of study replication in ecology and evolution

The recent replication crisis has caused several scientific disciplines to self-reflect on the frequency with which they replicate previously published studies and to assess their success in such endeavours. The rate of replication, however, has yet to be assessed for ecology and evolution. Here, I...

Full description

Bibliographic Details
Main Author: Clint D. Kelly
Format: Article
Language:English
Published: PeerJ Inc. 2019-09-01
Series:PeerJ
Subjects:
Online Access:https://peerj.com/articles/7654.pdf
_version_ 1797418262417375232
author Clint D. Kelly
author_facet Clint D. Kelly
author_sort Clint D. Kelly
collection DOAJ
description The recent replication crisis has caused several scientific disciplines to self-reflect on the frequency with which they replicate previously published studies and to assess their success in such endeavours. The rate of replication, however, has yet to be assessed for ecology and evolution. Here, I survey the open-access ecology and evolution literature to determine how often ecologists and evolutionary biologists replicate, or at least claim to replicate, previously published studies. I found that approximately 0.023% of ecology and evolution studies are described by their authors as replications. Two of the 11 original-replication study pairs provided sufficient statistical detail for three effects so as to permit a formal analysis of replication success. Replicating authors correctly concluded that they replicated an original effect in two cases; in the third case, my analysis suggests that the finding by the replicating authors was consistent with the original finding, contrary the conclusion of “replication failure” by the authors.
first_indexed 2024-03-09T06:30:04Z
format Article
id doaj.art-8cca26dc285c4251bebe431aa7b61a6c
institution Directory Open Access Journal
issn 2167-8359
language English
last_indexed 2024-03-09T06:30:04Z
publishDate 2019-09-01
publisher PeerJ Inc.
record_format Article
series PeerJ
spelling doaj.art-8cca26dc285c4251bebe431aa7b61a6c2023-12-03T11:07:26ZengPeerJ Inc.PeerJ2167-83592019-09-017e765410.7717/peerj.7654Rate and success of study replication in ecology and evolutionClint D. Kelly0Département des Sciences biologiques, Université du Québec à Montréal, Montréal, Quebec, CanadaThe recent replication crisis has caused several scientific disciplines to self-reflect on the frequency with which they replicate previously published studies and to assess their success in such endeavours. The rate of replication, however, has yet to be assessed for ecology and evolution. Here, I survey the open-access ecology and evolution literature to determine how often ecologists and evolutionary biologists replicate, or at least claim to replicate, previously published studies. I found that approximately 0.023% of ecology and evolution studies are described by their authors as replications. Two of the 11 original-replication study pairs provided sufficient statistical detail for three effects so as to permit a formal analysis of replication success. Replicating authors correctly concluded that they replicated an original effect in two cases; in the third case, my analysis suggests that the finding by the replicating authors was consistent with the original finding, contrary the conclusion of “replication failure” by the authors.https://peerj.com/articles/7654.pdfStudy replicationEffect size
spellingShingle Clint D. Kelly
Rate and success of study replication in ecology and evolution
PeerJ
Study replication
Effect size
title Rate and success of study replication in ecology and evolution
title_full Rate and success of study replication in ecology and evolution
title_fullStr Rate and success of study replication in ecology and evolution
title_full_unstemmed Rate and success of study replication in ecology and evolution
title_short Rate and success of study replication in ecology and evolution
title_sort rate and success of study replication in ecology and evolution
topic Study replication
Effect size
url https://peerj.com/articles/7654.pdf
work_keys_str_mv AT clintdkelly rateandsuccessofstudyreplicationinecologyandevolution