An experimental search strategy retrieves more precise results than PubMed and Google for questions about medical interventions

Objective. We compared the precision of a search strategy designed specifically to retrieve randomized controlled trials (RCTs) and systematic reviews of RCTs with search strategies designed for broader purposes.Methods. We designed an experimental search strategy that automatically revised searches...

Full description

Bibliographic Details
Main Authors: Robert G. Badgett, Daniel P. Dylla, Susan D. Megison, E Glynn Harmon
Format: Article
Language:English
Published: PeerJ Inc. 2015-04-01
Series:PeerJ
Subjects:
Online Access:https://peerj.com/articles/913.pdf
_version_ 1797418759157186560
author Robert G. Badgett
Daniel P. Dylla
Susan D. Megison
E Glynn Harmon
author_facet Robert G. Badgett
Daniel P. Dylla
Susan D. Megison
E Glynn Harmon
author_sort Robert G. Badgett
collection DOAJ
description Objective. We compared the precision of a search strategy designed specifically to retrieve randomized controlled trials (RCTs) and systematic reviews of RCTs with search strategies designed for broader purposes.Methods. We designed an experimental search strategy that automatically revised searches up to five times by using increasingly restrictive queries as long at least 50 citations were retrieved. We compared the ability of the experimental and alternative strategies to retrieve studies relevant to 312 test questions. The primary outcome, search precision, was defined for each strategy as the proportion of relevant, high quality citations among the first 50 citations retrieved.Results. The experimental strategy had the highest median precision (5.5%; interquartile range [IQR]: 0%–12%) followed by the narrow strategy of the PubMed Clinical Queries (4.0%; IQR: 0%–10%). The experimental strategy found the most high quality citations (median 2; IQR: 0–6) and was the strategy most likely to find at least one high quality citation (73% of searches; 95% confidence interval 68%–78%). All comparisons were statistically significant.Conclusions. The experimental strategy performed the best in all outcomes although all strategies had low precision.
first_indexed 2024-03-09T06:37:35Z
format Article
id doaj.art-c689cfbcb8d34139821f922ae58e4904
institution Directory Open Access Journal
issn 2167-8359
language English
last_indexed 2024-03-09T06:37:35Z
publishDate 2015-04-01
publisher PeerJ Inc.
record_format Article
series PeerJ
spelling doaj.art-c689cfbcb8d34139821f922ae58e49042023-12-03T10:55:53ZengPeerJ Inc.PeerJ2167-83592015-04-013e91310.7717/peerj.913913An experimental search strategy retrieves more precise results than PubMed and Google for questions about medical interventionsRobert G. Badgett0Daniel P. Dylla1Susan D. Megison2E Glynn Harmon3Department of Internal Medicine, Kansas University School of Medicine - Wichita, Wichita, KS, USAKaty Campus Library, Houston Community College, Houston, TX, USANo institutional affiliation, Birmingham, AL, USASchool of Information, University of Texas at Austin, Austin, TX, USAObjective. We compared the precision of a search strategy designed specifically to retrieve randomized controlled trials (RCTs) and systematic reviews of RCTs with search strategies designed for broader purposes.Methods. We designed an experimental search strategy that automatically revised searches up to five times by using increasingly restrictive queries as long at least 50 citations were retrieved. We compared the ability of the experimental and alternative strategies to retrieve studies relevant to 312 test questions. The primary outcome, search precision, was defined for each strategy as the proportion of relevant, high quality citations among the first 50 citations retrieved.Results. The experimental strategy had the highest median precision (5.5%; interquartile range [IQR]: 0%–12%) followed by the narrow strategy of the PubMed Clinical Queries (4.0%; IQR: 0%–10%). The experimental strategy found the most high quality citations (median 2; IQR: 0–6) and was the strategy most likely to find at least one high quality citation (73% of searches; 95% confidence interval 68%–78%). All comparisons were statistically significant.Conclusions. The experimental strategy performed the best in all outcomes although all strategies had low precision.https://peerj.com/articles/913.pdfInformation retrievalEvidence-based medicineGooglePubMed
spellingShingle Robert G. Badgett
Daniel P. Dylla
Susan D. Megison
E Glynn Harmon
An experimental search strategy retrieves more precise results than PubMed and Google for questions about medical interventions
PeerJ
Information retrieval
Evidence-based medicine
Google
PubMed
title An experimental search strategy retrieves more precise results than PubMed and Google for questions about medical interventions
title_full An experimental search strategy retrieves more precise results than PubMed and Google for questions about medical interventions
title_fullStr An experimental search strategy retrieves more precise results than PubMed and Google for questions about medical interventions
title_full_unstemmed An experimental search strategy retrieves more precise results than PubMed and Google for questions about medical interventions
title_short An experimental search strategy retrieves more precise results than PubMed and Google for questions about medical interventions
title_sort experimental search strategy retrieves more precise results than pubmed and google for questions about medical interventions
topic Information retrieval
Evidence-based medicine
Google
PubMed
url https://peerj.com/articles/913.pdf
work_keys_str_mv AT robertgbadgett anexperimentalsearchstrategyretrievesmorepreciseresultsthanpubmedandgoogleforquestionsaboutmedicalinterventions
AT danielpdylla anexperimentalsearchstrategyretrievesmorepreciseresultsthanpubmedandgoogleforquestionsaboutmedicalinterventions
AT susandmegison anexperimentalsearchstrategyretrievesmorepreciseresultsthanpubmedandgoogleforquestionsaboutmedicalinterventions
AT eglynnharmon anexperimentalsearchstrategyretrievesmorepreciseresultsthanpubmedandgoogleforquestionsaboutmedicalinterventions
AT robertgbadgett experimentalsearchstrategyretrievesmorepreciseresultsthanpubmedandgoogleforquestionsaboutmedicalinterventions
AT danielpdylla experimentalsearchstrategyretrievesmorepreciseresultsthanpubmedandgoogleforquestionsaboutmedicalinterventions
AT susandmegison experimentalsearchstrategyretrievesmorepreciseresultsthanpubmedandgoogleforquestionsaboutmedicalinterventions
AT eglynnharmon experimentalsearchstrategyretrievesmorepreciseresultsthanpubmedandgoogleforquestionsaboutmedicalinterventions