An experimental search strategy retrieves more precise results than PubMed and Google for questions about medical interventions
Objective. We compared the precision of a search strategy designed specifically to retrieve randomized controlled trials (RCTs) and systematic reviews of RCTs with search strategies designed for broader purposes.Methods. We designed an experimental search strategy that automatically revised searches...
Main Authors: | , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
PeerJ Inc.
2015-04-01
|
Series: | PeerJ |
Subjects: | |
Online Access: | https://peerj.com/articles/913.pdf |
_version_ | 1797418759157186560 |
---|---|
author | Robert G. Badgett Daniel P. Dylla Susan D. Megison E Glynn Harmon |
author_facet | Robert G. Badgett Daniel P. Dylla Susan D. Megison E Glynn Harmon |
author_sort | Robert G. Badgett |
collection | DOAJ |
description | Objective. We compared the precision of a search strategy designed specifically to retrieve randomized controlled trials (RCTs) and systematic reviews of RCTs with search strategies designed for broader purposes.Methods. We designed an experimental search strategy that automatically revised searches up to five times by using increasingly restrictive queries as long at least 50 citations were retrieved. We compared the ability of the experimental and alternative strategies to retrieve studies relevant to 312 test questions. The primary outcome, search precision, was defined for each strategy as the proportion of relevant, high quality citations among the first 50 citations retrieved.Results. The experimental strategy had the highest median precision (5.5%; interquartile range [IQR]: 0%–12%) followed by the narrow strategy of the PubMed Clinical Queries (4.0%; IQR: 0%–10%). The experimental strategy found the most high quality citations (median 2; IQR: 0–6) and was the strategy most likely to find at least one high quality citation (73% of searches; 95% confidence interval 68%–78%). All comparisons were statistically significant.Conclusions. The experimental strategy performed the best in all outcomes although all strategies had low precision. |
first_indexed | 2024-03-09T06:37:35Z |
format | Article |
id | doaj.art-c689cfbcb8d34139821f922ae58e4904 |
institution | Directory Open Access Journal |
issn | 2167-8359 |
language | English |
last_indexed | 2024-03-09T06:37:35Z |
publishDate | 2015-04-01 |
publisher | PeerJ Inc. |
record_format | Article |
series | PeerJ |
spelling | doaj.art-c689cfbcb8d34139821f922ae58e49042023-12-03T10:55:53ZengPeerJ Inc.PeerJ2167-83592015-04-013e91310.7717/peerj.913913An experimental search strategy retrieves more precise results than PubMed and Google for questions about medical interventionsRobert G. Badgett0Daniel P. Dylla1Susan D. Megison2E Glynn Harmon3Department of Internal Medicine, Kansas University School of Medicine - Wichita, Wichita, KS, USAKaty Campus Library, Houston Community College, Houston, TX, USANo institutional affiliation, Birmingham, AL, USASchool of Information, University of Texas at Austin, Austin, TX, USAObjective. We compared the precision of a search strategy designed specifically to retrieve randomized controlled trials (RCTs) and systematic reviews of RCTs with search strategies designed for broader purposes.Methods. We designed an experimental search strategy that automatically revised searches up to five times by using increasingly restrictive queries as long at least 50 citations were retrieved. We compared the ability of the experimental and alternative strategies to retrieve studies relevant to 312 test questions. The primary outcome, search precision, was defined for each strategy as the proportion of relevant, high quality citations among the first 50 citations retrieved.Results. The experimental strategy had the highest median precision (5.5%; interquartile range [IQR]: 0%–12%) followed by the narrow strategy of the PubMed Clinical Queries (4.0%; IQR: 0%–10%). The experimental strategy found the most high quality citations (median 2; IQR: 0–6) and was the strategy most likely to find at least one high quality citation (73% of searches; 95% confidence interval 68%–78%). All comparisons were statistically significant.Conclusions. The experimental strategy performed the best in all outcomes although all strategies had low precision.https://peerj.com/articles/913.pdfInformation retrievalEvidence-based medicineGooglePubMed |
spellingShingle | Robert G. Badgett Daniel P. Dylla Susan D. Megison E Glynn Harmon An experimental search strategy retrieves more precise results than PubMed and Google for questions about medical interventions PeerJ Information retrieval Evidence-based medicine PubMed |
title | An experimental search strategy retrieves more precise results than PubMed and Google for questions about medical interventions |
title_full | An experimental search strategy retrieves more precise results than PubMed and Google for questions about medical interventions |
title_fullStr | An experimental search strategy retrieves more precise results than PubMed and Google for questions about medical interventions |
title_full_unstemmed | An experimental search strategy retrieves more precise results than PubMed and Google for questions about medical interventions |
title_short | An experimental search strategy retrieves more precise results than PubMed and Google for questions about medical interventions |
title_sort | experimental search strategy retrieves more precise results than pubmed and google for questions about medical interventions |
topic | Information retrieval Evidence-based medicine PubMed |
url | https://peerj.com/articles/913.pdf |
work_keys_str_mv | AT robertgbadgett anexperimentalsearchstrategyretrievesmorepreciseresultsthanpubmedandgoogleforquestionsaboutmedicalinterventions AT danielpdylla anexperimentalsearchstrategyretrievesmorepreciseresultsthanpubmedandgoogleforquestionsaboutmedicalinterventions AT susandmegison anexperimentalsearchstrategyretrievesmorepreciseresultsthanpubmedandgoogleforquestionsaboutmedicalinterventions AT eglynnharmon anexperimentalsearchstrategyretrievesmorepreciseresultsthanpubmedandgoogleforquestionsaboutmedicalinterventions AT robertgbadgett experimentalsearchstrategyretrievesmorepreciseresultsthanpubmedandgoogleforquestionsaboutmedicalinterventions AT danielpdylla experimentalsearchstrategyretrievesmorepreciseresultsthanpubmedandgoogleforquestionsaboutmedicalinterventions AT susandmegison experimentalsearchstrategyretrievesmorepreciseresultsthanpubmedandgoogleforquestionsaboutmedicalinterventions AT eglynnharmon experimentalsearchstrategyretrievesmorepreciseresultsthanpubmedandgoogleforquestionsaboutmedicalinterventions |