Quality of systematic reviews in African emergency medicine: a cross-sectional methodological study
Introduction: Reliable systematic reviews are essential to inform clinical practice guidelines, policies and further research priorities in Africa. For systematic review findings to be trustworthy, they need to be conducted with methodological rigour and reported transparently. We assessed the metho...
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Elsevier
2023-12-01
|
| Series: | African Journal of Emergency Medicine |
| Subjects: | |
| Online Access: | http://www.sciencedirect.com/science/article/pii/S2211419X2300054X |
| _version_ | 1797399128047616000 |
|---|---|
| author | J. van Niekerk T. Fapohunda A. Rohwer M. McCaul |
| author_facet | J. van Niekerk T. Fapohunda A. Rohwer M. McCaul |
| author_sort | J. van Niekerk |
| collection | DOAJ |
| description | Introduction: Reliable systematic reviews are essential to inform clinical practice guidelines, policies and further research priorities in Africa. For systematic review findings to be trustworthy, they need to be conducted with methodological rigour and reported transparently. We assessed the methodological quality of systematic reviews published in African emergency medicine journals, comparing them to those published in international emergency medicine journals. Additionally, we describe the types of review literature published in the African journals. Methods: We performed a cross-sectional methodological study of systematic reviews published in selected African and international emergency medicine journals from 2012 to 2021. Studies were eligible if they were i) a systematic review on an emergency medicine topic, ii) published in one of the top five emergency medicine journals in the African region or internationally and iii) published between January 2012 and December 2021 in English or French. We searched PubMed, Web of Science and Scopus databases and hand-searched selected journals. Two authors screened titles, abstracts and full texts independently and in duplicate. Data extraction was performed by one reviewer, using a standardised form, after completing a calibration exercise. We described the characteristics of systematic reviews and assessed methodological quality using AMSTAR II. Results: We identified 34 (37%) African and 511 (54%) international systematic reviews from 92 and 948 review articles respectively across 10 journals. We included all 34 African and a random sample of 100 international systematic reviews. Methodological quality was low or critically low for all the African systematic reviews (n=34, 100%) and all but three international systematic reviews (n=97, 97%). The median number of critical domain weaknesses was 4 (IQR 4;5) and 2 (IQR 2;4) for African and international systematic reviews respectively. The most common weaknesses across both African and international systematic reviews were i) not establishing a priori review protocols, ii) unclear selection of study designs iii) not providing a list of excluded studies and iv) unclear reporting on funding sources for included studies. Conclusion: Emergency medicine systematic reviews published in African and international journals are lacking in methodological quality. Reporting an a priori protocol, developing a comprehensive search strategy, appropriate evidence synthesis and adequate assessment of risk of bias, heterogeneity and evidence certainty may improve the quality of systematic reviews. |
| first_indexed | 2024-03-09T01:34:58Z |
| format | Article |
| id | doaj.art-33b8ccecbdfc42429a1f6df46db8102d |
| institution | Directory Open Access Journal |
| issn | 2211-419X |
| language | English |
| last_indexed | 2024-03-09T01:34:58Z |
| publishDate | 2023-12-01 |
| publisher | Elsevier |
| record_format | Article |
| series | African Journal of Emergency Medicine |
| spelling | doaj.art-33b8ccecbdfc42429a1f6df46db8102d2023-12-09T06:05:52ZengElsevierAfrican Journal of Emergency Medicine2211-419X2023-12-01134331338Quality of systematic reviews in African emergency medicine: a cross-sectional methodological studyJ. van Niekerk0T. Fapohunda1A. Rohwer2M. McCaul3Corresponding author.; Division of Epidemiology and Biostatistics, Department of Global Health, Faculty of Medicine and Health Sciences, Stellenbosch UniversityDivision of Epidemiology and Biostatistics, Department of Global Health, Faculty of Medicine and Health Sciences, Stellenbosch UniversityDivision of Epidemiology and Biostatistics, Department of Global Health, Faculty of Medicine and Health Sciences, Stellenbosch UniversityDivision of Epidemiology and Biostatistics, Department of Global Health, Faculty of Medicine and Health Sciences, Stellenbosch UniversityIntroduction: Reliable systematic reviews are essential to inform clinical practice guidelines, policies and further research priorities in Africa. For systematic review findings to be trustworthy, they need to be conducted with methodological rigour and reported transparently. We assessed the methodological quality of systematic reviews published in African emergency medicine journals, comparing them to those published in international emergency medicine journals. Additionally, we describe the types of review literature published in the African journals. Methods: We performed a cross-sectional methodological study of systematic reviews published in selected African and international emergency medicine journals from 2012 to 2021. Studies were eligible if they were i) a systematic review on an emergency medicine topic, ii) published in one of the top five emergency medicine journals in the African region or internationally and iii) published between January 2012 and December 2021 in English or French. We searched PubMed, Web of Science and Scopus databases and hand-searched selected journals. Two authors screened titles, abstracts and full texts independently and in duplicate. Data extraction was performed by one reviewer, using a standardised form, after completing a calibration exercise. We described the characteristics of systematic reviews and assessed methodological quality using AMSTAR II. Results: We identified 34 (37%) African and 511 (54%) international systematic reviews from 92 and 948 review articles respectively across 10 journals. We included all 34 African and a random sample of 100 international systematic reviews. Methodological quality was low or critically low for all the African systematic reviews (n=34, 100%) and all but three international systematic reviews (n=97, 97%). The median number of critical domain weaknesses was 4 (IQR 4;5) and 2 (IQR 2;4) for African and international systematic reviews respectively. The most common weaknesses across both African and international systematic reviews were i) not establishing a priori review protocols, ii) unclear selection of study designs iii) not providing a list of excluded studies and iv) unclear reporting on funding sources for included studies. Conclusion: Emergency medicine systematic reviews published in African and international journals are lacking in methodological quality. Reporting an a priori protocol, developing a comprehensive search strategy, appropriate evidence synthesis and adequate assessment of risk of bias, heterogeneity and evidence certainty may improve the quality of systematic reviews.http://www.sciencedirect.com/science/article/pii/S2211419X2300054XEmergency medicineSystematic reviewMethodological qualityAMSTAR II |
| spellingShingle | J. van Niekerk T. Fapohunda A. Rohwer M. McCaul Quality of systematic reviews in African emergency medicine: a cross-sectional methodological study African Journal of Emergency Medicine Emergency medicine Systematic review Methodological quality AMSTAR II |
| title | Quality of systematic reviews in African emergency medicine: a cross-sectional methodological study |
| title_full | Quality of systematic reviews in African emergency medicine: a cross-sectional methodological study |
| title_fullStr | Quality of systematic reviews in African emergency medicine: a cross-sectional methodological study |
| title_full_unstemmed | Quality of systematic reviews in African emergency medicine: a cross-sectional methodological study |
| title_short | Quality of systematic reviews in African emergency medicine: a cross-sectional methodological study |
| title_sort | quality of systematic reviews in african emergency medicine a cross sectional methodological study |
| topic | Emergency medicine Systematic review Methodological quality AMSTAR II |
| url | http://www.sciencedirect.com/science/article/pii/S2211419X2300054X |
| work_keys_str_mv | AT jvanniekerk qualityofsystematicreviewsinafricanemergencymedicineacrosssectionalmethodologicalstudy AT tfapohunda qualityofsystematicreviewsinafricanemergencymedicineacrosssectionalmethodologicalstudy AT arohwer qualityofsystematicreviewsinafricanemergencymedicineacrosssectionalmethodologicalstudy AT mmccaul qualityofsystematicreviewsinafricanemergencymedicineacrosssectionalmethodologicalstudy |