Simple decision-tree tool to facilitate author identification of reporting guidelines during submission: a before–after study
Abstract Background There is evidence that direct journal endorsement of reporting guidelines can lead to important improvements in the quality and reliability of the published research. However, over the last 20 years, there has been a proliferation of reporting guidelines for different study desig...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
BMC
2017-12-01
|
| Series: | Research Integrity and Peer Review |
| Subjects: | |
| Online Access: | http://link.springer.com/article/10.1186/s41073-017-0044-9 |
| _version_ | 1819289619368247296 |
|---|---|
| author | Daniel R. Shanahan Ines Lopes de Sousa Diana M. Marshall |
| author_facet | Daniel R. Shanahan Ines Lopes de Sousa Diana M. Marshall |
| author_sort | Daniel R. Shanahan |
| collection | DOAJ |
| description | Abstract Background There is evidence that direct journal endorsement of reporting guidelines can lead to important improvements in the quality and reliability of the published research. However, over the last 20 years, there has been a proliferation of reporting guidelines for different study designs, making it impractical for a journal to explicitly endorse them all. The objective of this study was to investigate whether a decision tree tool made available during the submission process facilitates author identification of the relevant reporting guideline. Methods This was a prospective 14-week before–after study across four speciality medical research journals. During the submission process, authors were prompted to follow the relevant reporting guideline from the EQUATOR Network and asked to confirm that they followed the guideline (‘before’). After 7 weeks, this prompt was updated to include a direct link to the decision-tree tool and an additional prompt for those authors who stated that ‘no guidelines were applicable’ (‘after’). For each article submitted, the authors’ response, what guideline they followed (if any) and what reporting guideline they should have followed (including none relevant) were recorded. Results Overall, 590 manuscripts were included in this analysis—300 in the before cohort and 290 in the after. There were relevant reporting guidelines for 75% of manuscripts in each group; STROBE was the most commonly applicable reporting guideline, relevant for 35% (n = 106) and 37% (n = 106) of manuscripts, respectively. Use of the tool was associated with an 8.4% improvement in the number of authors correctly identifying the relevant reporting guideline for their study (p < 0.0001), a 14% reduction in the number of authors incorrectly stating that there were no relevant reporting guidelines (p < 0.0001), and a 1.7% reduction in authors choosing a guideline (p = 0.10). However, the ‘after’ cohort also saw a significant increase in the number of authors stating that there were relevant reporting guidelines for their study, but not specifying which (34 vs 29%; p = 0.04). Conclusion This study suggests that use of a decision-tree tool during submission of a manuscript is associated with improved author identification of the relevant reporting guidelines for their study type; however, the majority of authors still failed to correctly identify the relevant guidelines. |
| first_indexed | 2024-12-24T03:09:44Z |
| format | Article |
| id | doaj.art-54cd6c3cdacc4a9aace0b64673de7eb0 |
| institution | Directory Open Access Journal |
| issn | 2058-8615 |
| language | English |
| last_indexed | 2024-12-24T03:09:44Z |
| publishDate | 2017-12-01 |
| publisher | BMC |
| record_format | Article |
| series | Research Integrity and Peer Review |
| spelling | doaj.art-54cd6c3cdacc4a9aace0b64673de7eb02022-12-21T17:17:51ZengBMCResearch Integrity and Peer Review2058-86152017-12-01211610.1186/s41073-017-0044-9Simple decision-tree tool to facilitate author identification of reporting guidelines during submission: a before–after studyDaniel R. Shanahan0Ines Lopes de Sousa1Diana M. Marshall2Faculty of 1000 Ltd., Middlesex HouseBioMed Central Ltd.BioMed Central Ltd.Abstract Background There is evidence that direct journal endorsement of reporting guidelines can lead to important improvements in the quality and reliability of the published research. However, over the last 20 years, there has been a proliferation of reporting guidelines for different study designs, making it impractical for a journal to explicitly endorse them all. The objective of this study was to investigate whether a decision tree tool made available during the submission process facilitates author identification of the relevant reporting guideline. Methods This was a prospective 14-week before–after study across four speciality medical research journals. During the submission process, authors were prompted to follow the relevant reporting guideline from the EQUATOR Network and asked to confirm that they followed the guideline (‘before’). After 7 weeks, this prompt was updated to include a direct link to the decision-tree tool and an additional prompt for those authors who stated that ‘no guidelines were applicable’ (‘after’). For each article submitted, the authors’ response, what guideline they followed (if any) and what reporting guideline they should have followed (including none relevant) were recorded. Results Overall, 590 manuscripts were included in this analysis—300 in the before cohort and 290 in the after. There were relevant reporting guidelines for 75% of manuscripts in each group; STROBE was the most commonly applicable reporting guideline, relevant for 35% (n = 106) and 37% (n = 106) of manuscripts, respectively. Use of the tool was associated with an 8.4% improvement in the number of authors correctly identifying the relevant reporting guideline for their study (p < 0.0001), a 14% reduction in the number of authors incorrectly stating that there were no relevant reporting guidelines (p < 0.0001), and a 1.7% reduction in authors choosing a guideline (p = 0.10). However, the ‘after’ cohort also saw a significant increase in the number of authors stating that there were relevant reporting guidelines for their study, but not specifying which (34 vs 29%; p = 0.04). Conclusion This study suggests that use of a decision-tree tool during submission of a manuscript is associated with improved author identification of the relevant reporting guidelines for their study type; however, the majority of authors still failed to correctly identify the relevant guidelines.http://link.springer.com/article/10.1186/s41073-017-0044-9Reporting guidelinesSelective reportingPre-submission interventionsEquator |
| spellingShingle | Daniel R. Shanahan Ines Lopes de Sousa Diana M. Marshall Simple decision-tree tool to facilitate author identification of reporting guidelines during submission: a before–after study Research Integrity and Peer Review Reporting guidelines Selective reporting Pre-submission interventions Equator |
| title | Simple decision-tree tool to facilitate author identification of reporting guidelines during submission: a before–after study |
| title_full | Simple decision-tree tool to facilitate author identification of reporting guidelines during submission: a before–after study |
| title_fullStr | Simple decision-tree tool to facilitate author identification of reporting guidelines during submission: a before–after study |
| title_full_unstemmed | Simple decision-tree tool to facilitate author identification of reporting guidelines during submission: a before–after study |
| title_short | Simple decision-tree tool to facilitate author identification of reporting guidelines during submission: a before–after study |
| title_sort | simple decision tree tool to facilitate author identification of reporting guidelines during submission a before after study |
| topic | Reporting guidelines Selective reporting Pre-submission interventions Equator |
| url | http://link.springer.com/article/10.1186/s41073-017-0044-9 |
| work_keys_str_mv | AT danielrshanahan simpledecisiontreetooltofacilitateauthoridentificationofreportingguidelinesduringsubmissionabeforeafterstudy AT ineslopesdesousa simpledecisiontreetooltofacilitateauthoridentificationofreportingguidelinesduringsubmissionabeforeafterstudy AT dianammarshall simpledecisiontreetooltofacilitateauthoridentificationofreportingguidelinesduringsubmissionabeforeafterstudy |