Meta-analysis and aggregation of multiple published prediction models

Thomas P.A. Debray*, Hendrik Koffijberg, Daan Nieboer, Yvonne Vergouwe, Ewout W. Steyerberg, Karel G.M. Moons

*Corresponding author for this work

Research output: Contribution to journalArticleAcademicpeer-review

29 Citations (Scopus)

Abstract

Published clinical prediction models are often ignored during the development of novel prediction models despite similarities in populations and intended usage. The plethora of prediction models that arise from this practice may still perform poorly when applied in other populations. Incorporating prior evidence might improve the accuracy of prediction models and make them potentially better generalizable. Unfortunately, aggregation of prediction models is not straightforward, and methods to combine differently specified models are currently lacking. We propose two approaches for aggregating previously published prediction models when a validation dataset is available: model averaging and stacked regressions. These approaches yield user-friendly stand-alone models that are adjusted for the new validation data. Both approaches rely on weighting to account for model performance and between-study heterogeneity but adopt a different rationale (averaging versus combination) to combine the models. We illustrate their implementation in a clinical example and compare them with established methods for prediction modeling in a series of simulation studies. Results from the clinical datasets and simulation studies demonstrate that aggregation yields prediction models with better discrimination and calibration in a vast majority of scenarios, and results in equivalent performance (compared to developing a novel model from scratch) when validation datasets are relatively large. In conclusion, model aggregation is a promising strategy when several prediction models are available from the literature and a validation dataset is at hand. The aggregation methods do not require existing models to have similar predictors and can be applied when relatively few data are at hand.

Original languageEnglish
Pages (from-to)2341-2362
Number of pages22
JournalStatistics in medicine
Volume33
Issue number14
DOIs
Publication statusPublished - 2014

Keywords

  • Aggregation
  • External validation
  • Logistic regression
  • Multivariable
  • Prediction research
  • Risk prediction models
  • Updating
  • Validation

Fingerprint Dive into the research topics of 'Meta-analysis and aggregation of multiple published prediction models'. Together they form a unique fingerprint.

  • Cite this

    Debray, T. P. A., Koffijberg, H., Nieboer, D., Vergouwe, Y., Steyerberg, E. W., & Moons, K. G. M. (2014). Meta-analysis and aggregation of multiple published prediction models. Statistics in medicine, 33(14), 2341-2362. https://doi.org/10.1002/sim.6080