Predicted risk of mortality models: surgeons need to understand limitations of the University HealthSystem Consortium models.

Full Abstract

BACKGROUND: The University HealthSystem Consortium (UHC) mortality risk adjustment models are increasingly being used as benchmarks for quality assessment. But these administrative database models may include postoperative complications in their adjustments for preoperative risk. The purpose of this study was to compare the performance of the UHC with the Society of Thoracic Surgeons (STS) risk-adjusted mortality models for adult cardiac surgery and evaluate the contribution of postoperative complications on model performance. STUDY DESIGN: We identified adult cardiac surgery patients with mortality risk estimates in both the UHC and Society of Thoracic Surgeons databases. We compared the predictive performance and calibration of estimates from both models. We then reestimated both models using only patients without any postoperative complications to determine the relative contribution of adjustments for postoperative events on model performance. RESULTS: In the study population of 2,171 patients, the UHC model explained more variability (27% versus 13%, p < 0.001) and achieved better discrimination (C statistic = 0.88 versus 0.81, p < 0.001). But when applied in the population of patients without complications, the UHC model performance declined severely. The C statistic decreased from 0.88 to 0.49, a level of discrimination equivalent to random chance. The discrimination of the Society of Thoracic Surgeons model was unchanged (C statistic of 0.79 versus 0.81). CONCLUSIONS: Although the UHC model demonstrated better performance in the total study population, this difference in performance reflects adjustments for conditions that are postoperative complications. The current UHC models should not be used for quality benchmarks.

Author information

Author/s: Kozower, Benjamin D (BD); Ailawadi, Gorav (G); Jones, David R (DR); Pates, Robert D (RD); Lau, Christine L (CL); Kron, Irving L (IL); Stukenborg, George J (GJ);

Affiliation: Department of Surgery, University of Virginia Health System, Charlottesville, VA, USA.

Journal and publication information

Publication Type: Comparative Study; Journal Article

Journal: Journal of the American College of Surgeons (J Am Coll Surg), published in United States. (Language: eng)

Reference: 2009-Nov; vol 209 (issue 5) : pp 551-6

Dates: Created 2009/10/26; Completed 2009/11/10;

PMID: 19854393, status: MEDLINE (last retrieved date: 11/10/2009)

Sourced from the National Library of Medicine. Abstract text and other information may be subject to copyright.

External Links for this article
(including full text providers, if available):

Click Electronic Full-text Provider Links to see options for finding the electronic full text links to this article. Note there may be a subscription or fee required for access to the full text. See our FAQ for information on finding FREE full text articles.

This article may also be located in paper journal collections available in many libraries. Use the Journal and Publication Information above to find the full article.