Novel citation-based search method for scientific literature: a validation study

BMC Med Res Methodol. 2020 Feb 7;20(1):25. doi: 10.1186/s12874-020-0907-5.

Abstract

Background: We recently developed CoCites, a citation-based search method that is designed to be more efficient than traditional keyword-based methods. The method begins with identification of one or more highly relevant publications (query articles) and consists of two searches: the co-citation search, which ranks publications on their co-citation frequency with the query articles, and the citation search, which ranks publications on frequency of all citations that cite or are cited by the query articles.

Methods: We aimed to reproduce the literature searches of published systematic reviews and meta-analyses and assess whether CoCites retrieves all eligible articles while screening fewer titles.

Results: A total of 250 reviews were included. CoCites retrieved a median of 75% of the articles that were included in the original reviews. The percentage of retrieved articles was higher (88%) when the query articles were cited more frequently and when they had more overlap in their citations. Applying CoCites to only the highest-cited article yielded similar results. The co-citation and citation searches combined were more efficient when the review authors had screened more than 500 titles, but not when they had screened less.

Conclusions: CoCites is an efficient and accurate method for finding relevant related articles. The method uses the expert knowledge of authors to rank related articles, does not depend on keyword selection and requires no special expertise to build search queries. The method is transparent and reproducible.

Keywords: Citation; Co-citation; Keywords; Literature search; Meta-analysis; Systematic review.

Publication types

  • Research Support, N.I.H., Extramural

MeSH terms

  • Humans
  • Information Storage and Retrieval / methods*
  • Journal Impact Factor
  • Models, Theoretical*
  • Publications / statistics & numerical data*
  • Reproducibility of Results
  • Research Design / statistics & numerical data*