Skip to content
Back to glossary
Concepts & theories

Publication bias

DEPublikationsbias

Publication bias is the tendency for studies with positive or striking results to be published, and published sooner, while null results stay in the file drawer. The literature that survives is therefore not a fair sample of the research that was actually done, and any meta-analysis built on it inherits the shifted picture. The standard detection tool is the funnel plot. Each study is plotted by effect size against its precision. Small, imprecise studies scatter widely at the base, large ones cluster near the pooled estimate, and a complete literature forms a roughly symmetric funnel. A gap in one lower corner suggests missing small negative studies. Egger's test fits a regression to that asymmetry. Trim-and-fill imputes the apparently missing studies and recomputes the pooled effect. All three are weaker than they look. Egger's test has low power below roughly ten studies, and it flags asymmetry more readily when effects are ratios and events are rare. Trim-and-fill adds studies that may never have existed, so its adjusted estimate is a sensitivity check, not a correction. Asymmetry also has causes other than publication bias: real differences between small and large trials, weaker methods in small studies, or genuine heterogeneity. Prospective trial registration and pre-specified outcomes address the problem at its source better than any test applied afterwards.

Last reviewed:

This definition is educational and is not medical advice, a diagnosis, or treatment. Talk to a doctor about any health decisions. Read our full medical disclaimer

Sources

  1. Egger M, Davey Smith G, Schneider M, et al.. (1997). Bias in meta-analysis detected by a simple, graphical test. *BMJ*doi:10.1136/bmj.315.7109.629
  2. Duval S, Tweedie R. (2000). Trim and Fill: A Simple Funnel-Plot-Based Method of Testing and Adjusting for Publication Bias in Meta-Analysis. *Biometrics*doi:10.1111/j.0006-341X.2000.00455.x
  3. Sterne JAC, Sutton AJ, Ioannidis JPA, et al.. (2011). Recommendations for examining and interpreting funnel plot asymmetry in meta-analyses of randomised controlled trials. *BMJ*doi:10.1136/bmj.d4002
  4. Dwan K, Gamble C, Williamson PR, et al.. (2013). Systematic Review of the Empirical Evidence of Study Publication Bias and Outcome Reporting Bias: An Updated Review. *PLOS ONE*doi:10.1371/journal.pone.0066844