Multiple Score Comparison: a network meta-analysis approach to comparison and external validation of prognostic scores

Mostra el registre complet Registre parcial de l'ítem

  • dc.contributor.author Haile, Sarah R.ca
  • dc.contributor.author García Aymerich, Judithca
  • dc.contributor.author Antó i Boqué, Josep Mariaca
  • dc.contributor.author Puhan, Milo A.ca
  • dc.contributor.author Crystal structure of cold-aminopeptidase from Colwellia psychrerythraea (3CIA) collaboratorsca
  • dc.date.accessioned 2018-03-23T11:54:21Z
  • dc.date.available 2018-03-23T11:54:21Z
  • dc.date.issued 2017
  • dc.description.abstract BACKGROUND: Prediction models and prognostic scores have been increasingly popular in both clinical practice and clinical research settings, for example to aid in risk-based decision making or control for confounding. In many medical fields, a large number of prognostic scores are available, but practitioners may find it difficult to choose between them due to lack of external validation as well as lack of comparisons between them. METHODS: Borrowing methodology from network meta-analysis, we describe an approach to Multiple Score Comparison meta-analysis (MSC) which permits concurrent external validation and comparisons of prognostic scores using individual patient data (IPD) arising from a large-scale international collaboration. We describe the challenges in adapting network meta-analysis to the MSC setting, for instance the need to explicitly include correlations between the scores on a cohort level, and how to deal with many multi-score studies. We propose first using IPD to make cohort-level aggregate discrimination or calibration scores, comparing all to a common comparator. Then, standard network meta-analysis techniques can be applied, taking care to consider correlation structures in cohorts with multiple scores. Transitivity, consistency and heterogeneity are also examined. RESULTS: We provide a clinical application, comparing prognostic scores for 3-year mortality in patients with chronic obstructive pulmonary disease using data from a large-scale collaborative initiative. We focus on the discriminative properties of the prognostic scores. Our results show clear differences in performance, with ADO and eBODE showing higher discrimination with respect to mortality than other considered scores. The assumptions of transitivity and local and global consistency were not violated. Heterogeneity was small. CONCLUSIONS: We applied a network meta-analytic methodology to externally validate and concurrently compare the prognostic properties of clinical scores. Our large-scale external validation indicates that the scores with the best discriminative properties to predict 3 year mortality in patients with COPD are ADO and eBODE.
  • dc.format.mimetype application/pdf
  • dc.identifier.citation Haile SR, Guerra B, Soriano JB, Puhan MA, 3CIA collaboration. Multiple Score Comparison: a network meta-analysis approach to comparison and external validation of prognostic scores. BMC Med Res Methodol. 2017 Dec 21;17(1):172. DOI: 10.1186/s12874-017-0433-2
  • dc.identifier.doi http://dx.doi.org/10.1186/s12874-017-0433-2
  • dc.identifier.issn 1471-2288
  • dc.identifier.uri http://hdl.handle.net/10230/34254
  • dc.language.iso eng
  • dc.publisher BioMed Centralca
  • dc.relation.ispartof Anuncis BMC Medical Research Methodology. 2017 Dec 21;17(1):172
  • dc.rights © The Author(s). 2017 Open Access. This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
  • dc.rights.accessRights info:eu-repo/semantics/openAccess
  • dc.rights.uri http://creativecommons.org/licenses/by/4.0/
  • dc.subject.keyword Prognostic scores
  • dc.subject.keyword External validation
  • dc.subject.keyword Multiple score comparison
  • dc.subject.keyword Chronic obstructive pulmonary disease
  • dc.title Multiple Score Comparison: a network meta-analysis approach to comparison and external validation of prognostic scoresca
  • dc.type info:eu-repo/semantics/article
  • dc.type.version info:eu-repo/semantics/publishedVersion