Simple search techniques in PubMed are potentially suitable for evaluating the completeness of systematic reviews.

TitleSimple search techniques in PubMed are potentially suitable for evaluating the completeness of systematic reviews.
Publication TypeJournal Article
Year of Publication2013
AuthorsWaffenschmidt S, Janzen T, Hausner E, Kaiser T
JournalJournal of clinical epidemiology
Volume66
Issue6
Pagination660-5
Date Published2013 Jun
ISSN1878-5921
KeywordsEvidence-Based Medicine; Humans; Information Storage and Retrieval; Pharmaceutical Preparations; PubMed; Randomized Controlled Trials as Topic; Reference Standards; Reproducibility of Results; Retrospective Studies; Review Literature as Topic; Sensitivity and Specificity
AbstractOBJECTIVE: The Institute for Quality and Efficiency in Health Care (IQWiG) assesses the added benefit of new drugs by means of company dossiers. The pharmaceutical company performs the information retrieval, which is then assessed by IQWiG. Our aim was to determine whether PubMed's Related Citations (RelCits) and/or a simple-structured Boolean search (SSBS) are efficient and reliable search techniques to assess the completeness of an evidence base consisting of published randomized controlled trials (RCTs). STUDY DESIGN AND SETTING: Retrospective analysis of citations included as relevant in systematic reviews (SRs) of drugs. The proportion of relevant citations identified by the above-mentioned search techniques was determined. Relative sensitivity, precision, and the number needed to read (NNR) were then calculated. RESULTS: A total of 19 SRs included 330 relevant PubMed citations. The single techniques yielded either insufficient completeness, reliability, or efficiency. The first 20 RelCits plus SSBS achieved high completeness and reliability (sensitivity: 98.1%, range: 80-100%) and sufficient efficiency (precision: 5.0%, NNR: 25). The first 50 RelCit plus SSBS achieved slightly better completeness and reliability, but slightly worse efficiency. CONCLUSION: Combining the first 20 RelCits and an SSBS in PubMed is a suitable method to assess the completeness of an evidence base of published RCTs.
DOI10.1016/j.jclinepi.2012.11.011
Alternate JournalJ Clin Epidemiol