Reporting of methods to prepare, pilot and perform data extraction in systematic reviews: analysis of a sample of 152 Cochrane and non-Cochrane reviews
Abstract Background Previous research on data extraction methods in systematic reviews has focused on single aspects of the process. We aimed to provide a deeper insight into these methods by analysing a current sample of reviews. Methods We included systematic reviews of health interventions in hum...
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
BMC
2021-11-01
|
| Series: | BMC Medical Research Methodology |
| Subjects: | |
| Online Access: | https://doi.org/10.1186/s12874-021-01438-z |
| _version_ | 1818752328029700096 |
|---|---|
| author | Roland Brian Büchter Alina Weise Dawid Pieper |
| author_facet | Roland Brian Büchter Alina Weise Dawid Pieper |
| author_sort | Roland Brian Büchter |
| collection | DOAJ |
| description | Abstract Background Previous research on data extraction methods in systematic reviews has focused on single aspects of the process. We aimed to provide a deeper insight into these methods by analysing a current sample of reviews. Methods We included systematic reviews of health interventions in humans published in English. We analysed 75 Cochrane reviews from May and June 2020 and a random sample of non-Cochrane reviews published in the same period and retrieved from Medline. We linked reviews with protocols and study registrations. We collected information on preparing, piloting, and performing data extraction and on use of software to assist review conduct (automation tools). Data were extracted by one author, with 20% extracted in duplicate. Data were analysed descriptively. Results Of the 152 included reviews, 77 reported use of a standardized extraction form (51%); 42 provided information on the type of form used (28%); 24 on piloting (16%); 58 on what data was collected (38%); 133 on the extraction method (88%); 107 on resolving disagreements (70%); 103 on methods to obtain additional data or information (68%); 52 on procedures to avoid data errors (34%); and 47 on methods to deal with multiple study reports (31%). Items were more frequently reported in Cochrane than non-Cochrane reviews. The data extraction form used was published in 10 reviews (7%). Use of software was rarely reported except for statistical analysis software and use of RevMan and GRADEpro GDT in Cochrane reviews. Covidence was the most frequent automation tool used: 18 reviews used it for study selection (12%) and 9 for data extraction (6%). Conclusions Reporting of data extraction methods in systematic reviews is limited, especially in non-Cochrane reviews. This includes core items of data extraction such as methods used to manage disagreements. Few reviews currently use software to assist data extraction and review conduct. Our results can serve as a baseline to assess the uptake of such tools in future analyses. |
| first_indexed | 2024-12-18T04:49:43Z |
| format | Article |
| id | doaj.art-17e7c14eabef42319eb86b69ee0201b8 |
| institution | Directory Open Access Journal |
| issn | 1471-2288 |
| language | English |
| last_indexed | 2024-12-18T04:49:43Z |
| publishDate | 2021-11-01 |
| publisher | BMC |
| record_format | Article |
| series | BMC Medical Research Methodology |
| spelling | doaj.art-17e7c14eabef42319eb86b69ee0201b82022-12-21T21:20:28ZengBMCBMC Medical Research Methodology1471-22882021-11-0121111110.1186/s12874-021-01438-zReporting of methods to prepare, pilot and perform data extraction in systematic reviews: analysis of a sample of 152 Cochrane and non-Cochrane reviewsRoland Brian Büchter0Alina Weise1Dawid Pieper2Institute for Research in Operative Medicine (IFOM), Faculty of Health, School of Medicine, Witten/Herdecke UniversityInstitute for Research in Operative Medicine (IFOM), Faculty of Health, School of Medicine, Witten/Herdecke UniversityInstitute for Research in Operative Medicine (IFOM), Faculty of Health, School of Medicine, Witten/Herdecke UniversityAbstract Background Previous research on data extraction methods in systematic reviews has focused on single aspects of the process. We aimed to provide a deeper insight into these methods by analysing a current sample of reviews. Methods We included systematic reviews of health interventions in humans published in English. We analysed 75 Cochrane reviews from May and June 2020 and a random sample of non-Cochrane reviews published in the same period and retrieved from Medline. We linked reviews with protocols and study registrations. We collected information on preparing, piloting, and performing data extraction and on use of software to assist review conduct (automation tools). Data were extracted by one author, with 20% extracted in duplicate. Data were analysed descriptively. Results Of the 152 included reviews, 77 reported use of a standardized extraction form (51%); 42 provided information on the type of form used (28%); 24 on piloting (16%); 58 on what data was collected (38%); 133 on the extraction method (88%); 107 on resolving disagreements (70%); 103 on methods to obtain additional data or information (68%); 52 on procedures to avoid data errors (34%); and 47 on methods to deal with multiple study reports (31%). Items were more frequently reported in Cochrane than non-Cochrane reviews. The data extraction form used was published in 10 reviews (7%). Use of software was rarely reported except for statistical analysis software and use of RevMan and GRADEpro GDT in Cochrane reviews. Covidence was the most frequent automation tool used: 18 reviews used it for study selection (12%) and 9 for data extraction (6%). Conclusions Reporting of data extraction methods in systematic reviews is limited, especially in non-Cochrane reviews. This includes core items of data extraction such as methods used to manage disagreements. Few reviews currently use software to assist data extraction and review conduct. Our results can serve as a baseline to assess the uptake of such tools in future analyses.https://doi.org/10.1186/s12874-021-01438-zSystematic review methodsEvidence synthesisData extraction |
| spellingShingle | Roland Brian Büchter Alina Weise Dawid Pieper Reporting of methods to prepare, pilot and perform data extraction in systematic reviews: analysis of a sample of 152 Cochrane and non-Cochrane reviews BMC Medical Research Methodology Systematic review methods Evidence synthesis Data extraction |
| title | Reporting of methods to prepare, pilot and perform data extraction in systematic reviews: analysis of a sample of 152 Cochrane and non-Cochrane reviews |
| title_full | Reporting of methods to prepare, pilot and perform data extraction in systematic reviews: analysis of a sample of 152 Cochrane and non-Cochrane reviews |
| title_fullStr | Reporting of methods to prepare, pilot and perform data extraction in systematic reviews: analysis of a sample of 152 Cochrane and non-Cochrane reviews |
| title_full_unstemmed | Reporting of methods to prepare, pilot and perform data extraction in systematic reviews: analysis of a sample of 152 Cochrane and non-Cochrane reviews |
| title_short | Reporting of methods to prepare, pilot and perform data extraction in systematic reviews: analysis of a sample of 152 Cochrane and non-Cochrane reviews |
| title_sort | reporting of methods to prepare pilot and perform data extraction in systematic reviews analysis of a sample of 152 cochrane and non cochrane reviews |
| topic | Systematic review methods Evidence synthesis Data extraction |
| url | https://doi.org/10.1186/s12874-021-01438-z |
| work_keys_str_mv | AT rolandbrianbuchter reportingofmethodstopreparepilotandperformdataextractioninsystematicreviewsanalysisofasampleof152cochraneandnoncochranereviews AT alinaweise reportingofmethodstopreparepilotandperformdataextractioninsystematicreviewsanalysisofasampleof152cochraneandnoncochranereviews AT dawidpieper reportingofmethodstopreparepilotandperformdataextractioninsystematicreviewsanalysisofasampleof152cochraneandnoncochranereviews |