Guideline appraisal with AGREE II: Systematic review of the current evidence on how users handle the 2 overall assessments.
INTRODUCTION:The Appraisal of Guidelines for Research & Evaluation (AGREE) II instrument is the most commonly used guideline appraisal tool. It includes 23 appraisal criteria (items) organized within 6 domains and 2 overall assessments (1. overall guideline quality; 2. recommendation for use). T...
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Public Library of Science (PLoS)
2017-01-01
|
| Series: | PLoS ONE |
| Online Access: | http://europepmc.org/articles/PMC5373625?pdf=render |
| _version_ | 1818315485456891904 |
|---|---|
| author | Wiebke Hoffmann-Eßer Ulrich Siering Edmund A M Neugebauer Anne Catharina Brockhaus Ulrike Lampert Michaela Eikermann |
| author_facet | Wiebke Hoffmann-Eßer Ulrich Siering Edmund A M Neugebauer Anne Catharina Brockhaus Ulrike Lampert Michaela Eikermann |
| author_sort | Wiebke Hoffmann-Eßer |
| collection | DOAJ |
| description | INTRODUCTION:The Appraisal of Guidelines for Research & Evaluation (AGREE) II instrument is the most commonly used guideline appraisal tool. It includes 23 appraisal criteria (items) organized within 6 domains and 2 overall assessments (1. overall guideline quality; 2. recommendation for use). The aim of this systematic review was twofold. Firstly, to investigate how often AGREE II users conduct the 2 overall assessments. Secondly, to investigate the influence of the 6 domain scores on each of the 2 overall assessments. MATERIALS AND METHODS:A systematic bibliographic search was conducted for publications reporting guideline appraisals with AGREE II. The impact of the 6 domain scores on the overall assessment of guideline quality was examined using a multiple linear regression model. Their impact on the recommendation for use (possible answers: "yes", "yes, with modifications", "no") was examined using a multinomial regression model. RESULTS:118 relevant publications including 1453 guidelines were identified. 77.1% of the publications reported results for at least one overall assessment, but only 32.2% reported results for both overall assessments. The results of the regression analyses showed a statistically significant influence of all domains on overall guideline quality, with Domain 3 (rigour of development) having the strongest influence. For the recommendation for use, the results showed a significant influence of Domains 3 to 5 ("yes" vs. "no") and Domains 3 and 5 ("yes, with modifications" vs. "no"). CONCLUSIONS:The 2 overall assessments of AGREE II are underreported by guideline assessors. Domains 3 and 5 have the strongest influence on the results of the 2 overall assessments, while the other domains have a varying influence. Within a normative approach, our findings could be used as guidance for weighting individual domains in AGREE II to make the overall assessments more objective. Alternatively, a stronger content analysis of the individual domains could clarify their importance in terms of guideline quality. Moreover, AGREE II should require users to transparently present how they conducted the assessments. |
| first_indexed | 2024-12-13T09:06:17Z |
| format | Article |
| id | doaj.art-db37fc32497f481d8a6086d0f404cd6e |
| institution | Directory Open Access Journal |
| issn | 1932-6203 |
| language | English |
| last_indexed | 2024-12-13T09:06:17Z |
| publishDate | 2017-01-01 |
| publisher | Public Library of Science (PLoS) |
| record_format | Article |
| series | PLoS ONE |
| spelling | doaj.art-db37fc32497f481d8a6086d0f404cd6e2022-12-21T23:53:04ZengPublic Library of Science (PLoS)PLoS ONE1932-62032017-01-01123e017483110.1371/journal.pone.0174831Guideline appraisal with AGREE II: Systematic review of the current evidence on how users handle the 2 overall assessments.Wiebke Hoffmann-EßerUlrich SieringEdmund A M NeugebauerAnne Catharina BrockhausUlrike LampertMichaela EikermannINTRODUCTION:The Appraisal of Guidelines for Research & Evaluation (AGREE) II instrument is the most commonly used guideline appraisal tool. It includes 23 appraisal criteria (items) organized within 6 domains and 2 overall assessments (1. overall guideline quality; 2. recommendation for use). The aim of this systematic review was twofold. Firstly, to investigate how often AGREE II users conduct the 2 overall assessments. Secondly, to investigate the influence of the 6 domain scores on each of the 2 overall assessments. MATERIALS AND METHODS:A systematic bibliographic search was conducted for publications reporting guideline appraisals with AGREE II. The impact of the 6 domain scores on the overall assessment of guideline quality was examined using a multiple linear regression model. Their impact on the recommendation for use (possible answers: "yes", "yes, with modifications", "no") was examined using a multinomial regression model. RESULTS:118 relevant publications including 1453 guidelines were identified. 77.1% of the publications reported results for at least one overall assessment, but only 32.2% reported results for both overall assessments. The results of the regression analyses showed a statistically significant influence of all domains on overall guideline quality, with Domain 3 (rigour of development) having the strongest influence. For the recommendation for use, the results showed a significant influence of Domains 3 to 5 ("yes" vs. "no") and Domains 3 and 5 ("yes, with modifications" vs. "no"). CONCLUSIONS:The 2 overall assessments of AGREE II are underreported by guideline assessors. Domains 3 and 5 have the strongest influence on the results of the 2 overall assessments, while the other domains have a varying influence. Within a normative approach, our findings could be used as guidance for weighting individual domains in AGREE II to make the overall assessments more objective. Alternatively, a stronger content analysis of the individual domains could clarify their importance in terms of guideline quality. Moreover, AGREE II should require users to transparently present how they conducted the assessments.http://europepmc.org/articles/PMC5373625?pdf=render |
| spellingShingle | Wiebke Hoffmann-Eßer Ulrich Siering Edmund A M Neugebauer Anne Catharina Brockhaus Ulrike Lampert Michaela Eikermann Guideline appraisal with AGREE II: Systematic review of the current evidence on how users handle the 2 overall assessments. PLoS ONE |
| title | Guideline appraisal with AGREE II: Systematic review of the current evidence on how users handle the 2 overall assessments. |
| title_full | Guideline appraisal with AGREE II: Systematic review of the current evidence on how users handle the 2 overall assessments. |
| title_fullStr | Guideline appraisal with AGREE II: Systematic review of the current evidence on how users handle the 2 overall assessments. |
| title_full_unstemmed | Guideline appraisal with AGREE II: Systematic review of the current evidence on how users handle the 2 overall assessments. |
| title_short | Guideline appraisal with AGREE II: Systematic review of the current evidence on how users handle the 2 overall assessments. |
| title_sort | guideline appraisal with agree ii systematic review of the current evidence on how users handle the 2 overall assessments |
| url | http://europepmc.org/articles/PMC5373625?pdf=render |
| work_keys_str_mv | AT wiebkehoffmanneßer guidelineappraisalwithagreeiisystematicreviewofthecurrentevidenceonhowusershandlethe2overallassessments AT ulrichsiering guidelineappraisalwithagreeiisystematicreviewofthecurrentevidenceonhowusershandlethe2overallassessments AT edmundamneugebauer guidelineappraisalwithagreeiisystematicreviewofthecurrentevidenceonhowusershandlethe2overallassessments AT annecatharinabrockhaus guidelineappraisalwithagreeiisystematicreviewofthecurrentevidenceonhowusershandlethe2overallassessments AT ulrikelampert guidelineappraisalwithagreeiisystematicreviewofthecurrentevidenceonhowusershandlethe2overallassessments AT michaelaeikermann guidelineappraisalwithagreeiisystematicreviewofthecurrentevidenceonhowusershandlethe2overallassessments |