Identifying quality improvement intervention publications - A comparison of electronic search strategies
<p>Abstract</p> <p>Background</p> <p>The evidence base for quality improvement (QI) interventions is expanding rapidly. The diversity of the initiatives and the inconsistency in labeling these as QI interventions makes it challenging for researchers, policymakers, and Q...
| Main Authors: | , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
BMC
2011-08-01
|
| Series: | Implementation Science |
| Online Access: | http://www.implementationscience.com/content/6/1/85 |
| _version_ | 1818664829322264576 |
|---|---|
| author | Rubenstein Lisa V Hempel Susanne Shanman Roberta M Foy Robbie Golder Su Danz Marjorie Shekelle Paul G |
| author_facet | Rubenstein Lisa V Hempel Susanne Shanman Roberta M Foy Robbie Golder Su Danz Marjorie Shekelle Paul G |
| author_sort | Rubenstein Lisa V |
| collection | DOAJ |
| description | <p>Abstract</p> <p>Background</p> <p>The evidence base for quality improvement (QI) interventions is expanding rapidly. The diversity of the initiatives and the inconsistency in labeling these as QI interventions makes it challenging for researchers, policymakers, and QI practitioners to access the literature systematically and to identify relevant publications.</p> <p>Methods</p> <p>We evaluated search strategies developed for MEDLINE (Ovid) and PubMed based on free text words, Medical subject headings (MeSH), QI intervention components, continuous quality improvement (CQI) methods, and combinations of the strategies. Three sets of pertinent QI intervention publications were used for validation. Two independent expert reviewers screened publications for relevance. We compared the yield, recall rate, and precision of the search strategies for the identification of QI publications and for a subset of empirical studies on effects of QI interventions.</p> <p>Results</p> <p>The search yields ranged from 2,221 to 216,167 publications. Mean recall rates for reference publications ranged from 5% to 53% for strategies with yields of 50,000 publications or fewer. The 'best case' strategy, a simple text word search with high face validity ('quality' AND 'improv*' AND 'intervention*') identified 44%, 24%, and 62% of influential intervention articles selected by Agency for Healthcare Research and Quality (AHRQ) experts, a set of exemplar articles provided by members of the Standards for Quality Improvement Reporting Excellence (SQUIRE) group, and a sample from the Cochrane Effective Practice and Organization of Care Group (EPOC) register of studies, respectively. We applied the search strategy to a PubMed search for articles published in 10 pertinent journals in a three-year period which retrieved 183 publications. Among these, 67% were deemed relevant to QI by at least one of two independent raters. Forty percent were classified as empirical studies reporting on a QI intervention.</p> <p>Conclusions</p> <p>The presented search terms and operating characteristics can be used to guide the identification of QI intervention publications. Even with extensive iterative development, we achieved only moderate recall rates of reference publications. Consensus development on QI reporting and initiatives to develop QI-relevant MeSH terms are urgently needed.</p> |
| first_indexed | 2024-12-17T05:38:57Z |
| format | Article |
| id | doaj.art-4f54fc784a7646669f7803d1f8bc0d67 |
| institution | Directory Open Access Journal |
| issn | 1748-5908 |
| language | English |
| last_indexed | 2024-12-17T05:38:57Z |
| publishDate | 2011-08-01 |
| publisher | BMC |
| record_format | Article |
| series | Implementation Science |
| spelling | doaj.art-4f54fc784a7646669f7803d1f8bc0d672022-12-21T22:01:31ZengBMCImplementation Science1748-59082011-08-01618510.1186/1748-5908-6-85Identifying quality improvement intervention publications - A comparison of electronic search strategiesRubenstein Lisa VHempel SusanneShanman Roberta MFoy RobbieGolder SuDanz MarjorieShekelle Paul G<p>Abstract</p> <p>Background</p> <p>The evidence base for quality improvement (QI) interventions is expanding rapidly. The diversity of the initiatives and the inconsistency in labeling these as QI interventions makes it challenging for researchers, policymakers, and QI practitioners to access the literature systematically and to identify relevant publications.</p> <p>Methods</p> <p>We evaluated search strategies developed for MEDLINE (Ovid) and PubMed based on free text words, Medical subject headings (MeSH), QI intervention components, continuous quality improvement (CQI) methods, and combinations of the strategies. Three sets of pertinent QI intervention publications were used for validation. Two independent expert reviewers screened publications for relevance. We compared the yield, recall rate, and precision of the search strategies for the identification of QI publications and for a subset of empirical studies on effects of QI interventions.</p> <p>Results</p> <p>The search yields ranged from 2,221 to 216,167 publications. Mean recall rates for reference publications ranged from 5% to 53% for strategies with yields of 50,000 publications or fewer. The 'best case' strategy, a simple text word search with high face validity ('quality' AND 'improv*' AND 'intervention*') identified 44%, 24%, and 62% of influential intervention articles selected by Agency for Healthcare Research and Quality (AHRQ) experts, a set of exemplar articles provided by members of the Standards for Quality Improvement Reporting Excellence (SQUIRE) group, and a sample from the Cochrane Effective Practice and Organization of Care Group (EPOC) register of studies, respectively. We applied the search strategy to a PubMed search for articles published in 10 pertinent journals in a three-year period which retrieved 183 publications. Among these, 67% were deemed relevant to QI by at least one of two independent raters. Forty percent were classified as empirical studies reporting on a QI intervention.</p> <p>Conclusions</p> <p>The presented search terms and operating characteristics can be used to guide the identification of QI intervention publications. Even with extensive iterative development, we achieved only moderate recall rates of reference publications. Consensus development on QI reporting and initiatives to develop QI-relevant MeSH terms are urgently needed.</p>http://www.implementationscience.com/content/6/1/85 |
| spellingShingle | Rubenstein Lisa V Hempel Susanne Shanman Roberta M Foy Robbie Golder Su Danz Marjorie Shekelle Paul G Identifying quality improvement intervention publications - A comparison of electronic search strategies Implementation Science |
| title | Identifying quality improvement intervention publications - A comparison of electronic search strategies |
| title_full | Identifying quality improvement intervention publications - A comparison of electronic search strategies |
| title_fullStr | Identifying quality improvement intervention publications - A comparison of electronic search strategies |
| title_full_unstemmed | Identifying quality improvement intervention publications - A comparison of electronic search strategies |
| title_short | Identifying quality improvement intervention publications - A comparison of electronic search strategies |
| title_sort | identifying quality improvement intervention publications a comparison of electronic search strategies |
| url | http://www.implementationscience.com/content/6/1/85 |
| work_keys_str_mv | AT rubensteinlisav identifyingqualityimprovementinterventionpublicationsacomparisonofelectronicsearchstrategies AT hempelsusanne identifyingqualityimprovementinterventionpublicationsacomparisonofelectronicsearchstrategies AT shanmanrobertam identifyingqualityimprovementinterventionpublicationsacomparisonofelectronicsearchstrategies AT foyrobbie identifyingqualityimprovementinterventionpublicationsacomparisonofelectronicsearchstrategies AT goldersu identifyingqualityimprovementinterventionpublicationsacomparisonofelectronicsearchstrategies AT danzmarjorie identifyingqualityimprovementinterventionpublicationsacomparisonofelectronicsearchstrategies AT shekellepaulg identifyingqualityimprovementinterventionpublicationsacomparisonofelectronicsearchstrategies |