No consensus exists on search reporting methods for systematic reviews

J Clin Epidemiol. 2008 Aug;61(8):748-54. doi: 10.1016/j.jclinepi.2007.10.009. Epub 2008 Feb 14.

Abstract

Objectives: The reporting of the search methods used in systematic reviews has implications for how systematic reviews are critically appraised, their reproducibility and how easily they may be updated. The objective of this paper was to identify validated or evaluated search reporting instruments used in reporting systematic review searches and to compare reported and recommended searching practices.

Study design and setting: This cohort study was a systematic review. The search strategy to identify instruments addressing the reporting of search strategies was developed first in the Library & Information Science Abstracts (LISAs) database and then adapted for MEDLINE and five additional databases. Additional instruments were identified through experts. Current reporting practice data were analyzed from a cohort of 297 recent systematic reviews.

Results: Of the 11 instruments examined, 7 cited supporting evidence but only 4 were validated. Eighteen different reporting items were identified but only one item, "databases used," appeared in all instruments. There was a trend toward including more items in more recent instruments (r=0.41). Current search reporting practices ranged from a high of 98.7% for databases used to a low of 11.4% for qualifications of the searcher.

Conclusions: There is no clear consensus regarding optimum reporting of systematic review search methods and commonly recommended items show suboptimal reporting.

Publication types

  • Research Support, N.I.H., Extramural
  • Research Support, Non-U.S. Gov't

MeSH terms

  • Cohort Studies
  • Consensus
  • Databases, Bibliographic
  • Humans
  • Information Storage and Retrieval / methods*
  • Meta-Analysis as Topic
  • Publishing / standards
  • Reproducibility of Results
  • Review Literature as Topic*