Comprehensive Literature Search for a Research Synthesis

Description

A recall-oriented, documented search across all five retrieval modes and grey-literature sources, stopped when further searching stops yielding new relevant studies.

Recall and precision vary inversely, and a synthesis needs high recall. Wilson's five retrieval modes are footnote chasing, consultation, subject-index searching (natural language versus controlled vocabulary), browsing, and citation searching, including related records ranked by bibliographic coupling. Least-effort strategies are biased toward central researchers and cannot be replicated. Reed and Baxter give six steps from topic definition to final searches, with Boolean search profiles, author and forward-citation searches, and a stopping rule. Rothstein and Hopewell list grey-literature sources (dissertation and report databases, hand-searching journals and proceedings, reference lists, contacting researchers, research registers, the internet) and show that published trials report larger effects than unpublished ones, which is why grey literature matters. Every source is biased, vocabularies differ across disciplines and decades, and consultation finds unpublished work but favours insiders' views, so the search mixes modes and documents everything.

Attributes

Loss type
Siloed
Effort
Weeks

Steps

  1. Define the topic as a sentence or question after preliminary reading, and set scope, population, methods and inclusion criteria.
  2. Harvest subject terms from known relevant papers, adding synonyms and thesaurus terms; for interventions combine problem, intervention and design concepts.
  3. Write a search profile with Boolean AND, OR, NOT, proximity operators and truncation, and run it in several complementary databases.
  4. Evaluate retrieved records for relevance, revise terms and run final searches, adding searches on the most prolific authors and forward citation searches.
  5. Footnote-chase reference lists and use related-records (bibliographic coupling) features.
  6. Search grey literature: dissertation and report databases, hand-search key journals and conference proceedings, research registers, contact researchers, and the web.
  7. Stop when the last searches yield under about 1% new unique relevant citations, or ten hours of searching yield nothing new.
  8. Document every source, query, date and count in a search log.

Sources

  • The Handbook of Research Synthesis and Meta-Analysis (Cooper et al., 2009)

Also known as

  • Systematic search strategy
  • Recall-oriented searching
  • Footnote chasing
  • Citation searching
  • Citation chasing
  • Hand searching
  • Grey literature searching
  • Search stopping rule

Categories

  • Research Operations
  • Research Design & Rigor