The relationship between methodological quality and the use of retracted publications in evidence syntheses
Abstract Background Evidence syntheses cite retracted publications. However, citation is not necessarily endorsement, as authors may be criticizing or refuting its findings. We investigated the sentiment of these citations—whether they were critical or supportive—and associations with the methodolog...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
BMC
2023-09-01
|
| Series: | Systematic Reviews |
| Subjects: | |
| Online Access: | https://doi.org/10.1186/s13643-023-02316-z |
| _version_ | 1797577850365149184 |
|---|---|
| author | Caitlin J. Bakker Nicole Theis-Mahon Sarah Jane Brown Maurice P. Zeegers |
| author_facet | Caitlin J. Bakker Nicole Theis-Mahon Sarah Jane Brown Maurice P. Zeegers |
| author_sort | Caitlin J. Bakker |
| collection | DOAJ |
| description | Abstract Background Evidence syntheses cite retracted publications. However, citation is not necessarily endorsement, as authors may be criticizing or refuting its findings. We investigated the sentiment of these citations—whether they were critical or supportive—and associations with the methodological quality of the evidence synthesis, reason for the retraction, and time between publication and retraction. Methods Using a sample of 286 evidence syntheses containing 324 citations to retracted publications in the field of pharmacy, we used AMSTAR-2 to assess methodological quality. We used scite.ai and a human screener to determine citation sentiment. We conducted a Pearson’s chi-square test to assess associations between citation sentiment, methodological quality, and reason for retraction, and one-way ANOVAs to investigate association between time, methodological quality, and citation sentiment. Results Almost 70% of the evidence syntheses in our sample were of critically low quality. We found that these critically low-quality evidence syntheses were more associated with positive statements while high-quality evidence syntheses were more associated with negative citation of retracted publications. In our sample of 324 citations, 20.4% of citations to retracted publications noted that the publication had been retracted. Conclusion The association between high-quality evidence syntheses and recognition of a publication’s retracted status may indicate that best practices are sufficient. However, the volume of critically low-quality evidence syntheses ultimately perpetuates the citation of retracted publications with no indication of their retracted status. Strengthening journal requirements around the quality of evidence syntheses may lessen the inappropriate citation of retracted publications. |
| first_indexed | 2024-03-10T22:13:49Z |
| format | Article |
| id | doaj.art-e355b4c432e1403288a737ba513bd090 |
| institution | Directory Open Access Journal |
| issn | 2046-4053 |
| language | English |
| last_indexed | 2024-03-10T22:13:49Z |
| publishDate | 2023-09-01 |
| publisher | BMC |
| record_format | Article |
| series | Systematic Reviews |
| spelling | doaj.art-e355b4c432e1403288a737ba513bd0902023-11-19T12:30:58ZengBMCSystematic Reviews2046-40532023-09-011211910.1186/s13643-023-02316-zThe relationship between methodological quality and the use of retracted publications in evidence synthesesCaitlin J. Bakker0Nicole Theis-Mahon1Sarah Jane Brown2Maurice P. Zeegers3Dr. John Archer Library and Archives, University of ReginaHealth Sciences Libraries, University of Minnesota Twin Cities, Phillips-Wangensteen BuildingHealth Sciences Libraries, University of Minnesota Twin Cities, Phillips-Wangensteen BuildingDepartment of Epidemiology, School for Nutrition and Translational Research in Metabolisms, Care and Health Research Institute, Maastricht University Medical Center +Abstract Background Evidence syntheses cite retracted publications. However, citation is not necessarily endorsement, as authors may be criticizing or refuting its findings. We investigated the sentiment of these citations—whether they were critical or supportive—and associations with the methodological quality of the evidence synthesis, reason for the retraction, and time between publication and retraction. Methods Using a sample of 286 evidence syntheses containing 324 citations to retracted publications in the field of pharmacy, we used AMSTAR-2 to assess methodological quality. We used scite.ai and a human screener to determine citation sentiment. We conducted a Pearson’s chi-square test to assess associations between citation sentiment, methodological quality, and reason for retraction, and one-way ANOVAs to investigate association between time, methodological quality, and citation sentiment. Results Almost 70% of the evidence syntheses in our sample were of critically low quality. We found that these critically low-quality evidence syntheses were more associated with positive statements while high-quality evidence syntheses were more associated with negative citation of retracted publications. In our sample of 324 citations, 20.4% of citations to retracted publications noted that the publication had been retracted. Conclusion The association between high-quality evidence syntheses and recognition of a publication’s retracted status may indicate that best practices are sufficient. However, the volume of critically low-quality evidence syntheses ultimately perpetuates the citation of retracted publications with no indication of their retracted status. Strengthening journal requirements around the quality of evidence syntheses may lessen the inappropriate citation of retracted publications.https://doi.org/10.1186/s13643-023-02316-zRetraction of publicationScientific misconductSystematic reviewsResearch integrityPublication ethics |
| spellingShingle | Caitlin J. Bakker Nicole Theis-Mahon Sarah Jane Brown Maurice P. Zeegers The relationship between methodological quality and the use of retracted publications in evidence syntheses Systematic Reviews Retraction of publication Scientific misconduct Systematic reviews Research integrity Publication ethics |
| title | The relationship between methodological quality and the use of retracted publications in evidence syntheses |
| title_full | The relationship between methodological quality and the use of retracted publications in evidence syntheses |
| title_fullStr | The relationship between methodological quality and the use of retracted publications in evidence syntheses |
| title_full_unstemmed | The relationship between methodological quality and the use of retracted publications in evidence syntheses |
| title_short | The relationship between methodological quality and the use of retracted publications in evidence syntheses |
| title_sort | relationship between methodological quality and the use of retracted publications in evidence syntheses |
| topic | Retraction of publication Scientific misconduct Systematic reviews Research integrity Publication ethics |
| url | https://doi.org/10.1186/s13643-023-02316-z |
| work_keys_str_mv | AT caitlinjbakker therelationshipbetweenmethodologicalqualityandtheuseofretractedpublicationsinevidencesyntheses AT nicoletheismahon therelationshipbetweenmethodologicalqualityandtheuseofretractedpublicationsinevidencesyntheses AT sarahjanebrown therelationshipbetweenmethodologicalqualityandtheuseofretractedpublicationsinevidencesyntheses AT mauricepzeegers therelationshipbetweenmethodologicalqualityandtheuseofretractedpublicationsinevidencesyntheses AT caitlinjbakker relationshipbetweenmethodologicalqualityandtheuseofretractedpublicationsinevidencesyntheses AT nicoletheismahon relationshipbetweenmethodologicalqualityandtheuseofretractedpublicationsinevidencesyntheses AT sarahjanebrown relationshipbetweenmethodologicalqualityandtheuseofretractedpublicationsinevidencesyntheses AT mauricepzeegers relationshipbetweenmethodologicalqualityandtheuseofretractedpublicationsinevidencesyntheses |