Abstract
Background
The P-POSSUM score, the most well known of predictive scores for postoperative mortality, requires validation for population and setting.
Methods
Validation methods included discrimination (C-index statistic), observed:expected (O:E) ratio, calibration with the Hosmer-Lemeshow test, and subgroup analysis (emergency surgery, cancer, age, organs). The study included 3,881 multisite patients undergoing major digestive surgery in France.
Results
Discrimination via the receiver operating characteristic curve was good (C-index = 0.87). The overall O:E ratio was 1 (95% confidence interval ([95 % CI]: 0.88–1.13), and therefore the quality of the surgical performance is within normal ranges. The O:E ratio, calculated by risk ranges, showed overestimation in the low risk range, especially in the 3 % to 6 % and 6 % to 10 % ranges. Calibration was poor (p < 0.001). The model deviated from the normal pattern of calibration, with mortality lower than expected in the high-risk range. Subgroup analysis found reasonable to good discrimination of populations (C-index ranging from 0.78 to 0.93 except for liver surgery [0.67]) while calibration of individuals remained poor (p < 0.001 to 0.02).
Conclusions
Good discrimination, as well as nonsignificant overall O:E values, makes P-POSSUM a valuable tool when it is used for surgical audit to compare mortality between populations for major digestive surgery. Conversely, poor calibration (goodness-of-fit), especially in subgroup analysis, and underestimation or overestimation of O:E ratios considerably limits the value of P-POSSUM for prediction of mortality in individuals. Therefore P-POSSUM should not be used to predict outcomes for one particular patient.
Similar content being viewed by others
References
Katz MH (2006) Assumptions of multiple linear regression, multiple logistic regression, and proportional hazard analysis. In: Katz MH (ed) Multivariable analysis. A practical guide for clinicians, 2nd edn. Cambridge University Press, chapter doi:http://dx.doi.org/10.1017/CBO9780511811692.006
Copeland GP, Jones D, Walters M (1991) Possum: a scoring system for surgical audit. Br J Surg 78:355–360
Khuri SF, Daley J, Henderson W et al (1998) The department of veterans affairs NSQIP: the first national validated outcome based, risk adjustment, and peer-controlled program for the measurement and enhancement of quality of surgical care national V.A surgical improvement program. Ann Surg 228:491–507
Best WR, Khuri SF, Phelan M et al (2002) Identifying patients’ preoperative risk factors and postoperative adverse events and administrative data base: results from the Department of Veterans Affairs National Surgical Quality Improvement Program. J Am Coll Surg 194:257–266
Aust JB, Henderson W, Khuri S et al (2005) The impact of operative complexity on patient risk factor. Ann Surg 6:1024–1027
Prytherch DR, Whiteley MS, Higgins B et al (1998) Possum and Portsmouth Possum for predicting mortality. Br J Surg 85:1217–1220
Whiteley MS, Prytherch D, Higgins B et al (1995) Comparative audit of colorectal resection with the Possum scoring system. Br J Surg 82:418–426
Copeland GP (2002) The POSSUM system of surgical audit. Arch Surg 137:15
Lloyd H, Ahmed I, Taylor S et al (2005) Index for predicting mortality in elderly surgical patients. Br J Surg 6:487–492
Neary WD, Prytherch D, Foy C et al (2007) Comparison of different methods of risk stratification in urgent and emergency surgery. Br J Surg 94:1300–1305
McIlroy BS, MilLarr A, Copeland GP et al (1994) Audit of emergency preoperative resuscitation. Br J Surg 81:200–202
Whiteley MS, Prytherch DR, Higgins B et al (2001) A P-Possum type risk model that includes nonoperative patients. Br J Surg 88:752–753
Can MF, Yagci G, Tufan T et al (2008) Can SAPS predict operative mortality more accurately than Possum and P-Possum in patients with colorectal carcinoma undergoing resection? World J Surg 32:589–595. doi:10.1007/s00268-007-9321-y
Tamijmarane A, Bhati CS, Mirza DF et al (2008) Application of Portsmouth modification of physiological and operative severity scoring system for enumeration of morbidity and mortality (P-POSSUM) in pancreatic surgery. World J Surg Oncol 6:39
Slim K, Panis Y, Alves A et al (2006) Predicting postoperative mortality in patients undergoing colorectal surgery. World J Surg 30:100–106. doi:10.1007/s00268-005-0081-2
Oomen JL, Cuesta MA, Engel AF (2007) Comparison of outcome of Possum, P-Possum and CR-Possum scoring after elective resection of the sigmoid colon for carcinoma or complicated diverticular disease. Scand J Gastroenterol 42:841–847
Tez M, Yoldas O, Gocmen E et al (2006) Evaluation of P-POSSUM and CR-POSSUM scores in patients with colorectal cancer undergoing resection. World J Surg 30:2266–2269. doi:10.1007/s00268-005-0675-8
Yii MK, Ng KJ (2002) Risk-adjusted surgical audit with the Possum scoring system in a developing country. Br J Surg 89:110–113
Wexner S (2005) Invited critique to article of Alves et al. “Postoperative mortality and morbidity in French patients undergoing colorectal surgery”. Arch Surg 140:284
Copeland GP (1993) Comparative audit: fact vs fantasy. Br J Surg 910:1424–1425
Copeland GP, Sagar P, Brennan J et al (1995) Risk-adjusted analysis of surgeon performance: 1-year study. Br J Surg 82:408–411
Tekkis PP, Kocher HM, Bentley AJ et al (2000) Operative mortality rates among surgeons: comparison of POSSUM and p-POSSUM scoring systems in gastrointestinal surgery. Dis Colon Rectum 43:1528–1531
Wakabayashi H, Sano T, Yachida S et al (2007) Validation of risk assessment scoring systems for an audit of elective surgery for gastrointestinal cancer in elderly patients. Int J Surg 5:323–327
Kocher HM, Tekkis PP, Gopal P et al (2005) Risk adjustment in hepatobiliary pancreatic surgery. World J Gastroenterol 11:2450–2455
Lam CM, Fan ST, Yuen AWC et al (2004) Validation of POSSUM scoring systems for audit of major hepatectomy. Br J Surg 91:450–455
Nagabhusman JS, Srinajit S, Weir F et al (2007) Comparison of P-Possum and O-Possum in predicting mortality after oesophagogastric resections. Postgrad Med J 83:355–358
Lai F, Kwan TL, Yuen WC et al (2007) Evaluation of various POSSUM models for predicting mortality in patients undergoing elective oesophagectomy for carcinoma. Br J Surg 94:1172–1178
Bennett-Guerrero E, Hyam JA, Shaefi S et al (2003) Comparison of P-POSSUM risk-adjusted mortality rates after surgery between patients in the USA and the UK. Br J Surg 90:1593–1598
DeLong ER, DeLong DM, Clarke-Pearson DL (1988) Comparing the areas under two or more correlated receiver operating characteristic curves: a non parametric approach. Biometrics 44:837–845
Tekkis PP, McCulloch P, Poloniecki JD et al (2004) Risk-adjusted prediction of operative mortality in oesophagogastric surgery with O-POSSUM. Br J Surg 91:288–295
Breslow NE, Day NE (1987) Statistical methods in cancer research, vol 2, IARC Scientific publ no. 82, Lyon, International Agency for Research on Cancer
Hosmer DW, Lemeshow S (1989) Applied logistic regression. Wiley, New York
Sagar PM, Hartley MN, MacFie J et al (1996) Comparison of individual surgeon’s performance. Risk adjusted analysis with Possum scoring system. Dis Colon Rectum 39:654–658
Brooks MJ, Sutton A, Sarin S (2005) Comparison of surgical risk score, Possum and P. Possum in high risk surgical patients. Br J Surg 92:1288–1292
Midwinter LJH, Tytherleigh M, Ashley S (1999) Estimation of mortality and morbidity risk in vascular surgery using POSSUM and the Portsmouth predictor equation. Br J Surg 86:471–474
Tekkis PP, Kessaris N, Kocher HM et al (2003) Evaluation of POSSUM and P-POSSUM scoring systems in patients undergoing colorectal surgery. Br J Surg 90:340–345
Paquet JC, Dziri C, Hay JM, the French Association for Surgical Research et al (2000) Prevention of deep abdominal complications with omentoplasty on the raw surface after hepatic resection. Am J Surg 179:103–109
Sutton R, Bann S, Brooks M et al (2002) Risk score as an improved tool for risk adjusted analysis in comparative surgical audit. Br J Surg 89:763–768
Tekkis PP, Prytherch DR, Kocher JM et al (2004) Development of a dedicated risk-adjustment scoring system for colorectal surgery (colorectal POSSUM). Br J Surg 91:1174–1182
Mohil RS, Bhatnagar D, Bahadur L et al (2003) POSSUM and P-POSSUM for risk-adjusted audit of patients undergoing emergency laparotomy. Br J Surg 91:500–503
Lagarde SM, Maris AKD, de Castro SMM et al (2007) Evaluation of O-POSSUM in predicting in-hospital mortality after resection for oesophageal cancer. Br J Surg 94:1521–1526
Tran Ba Loc P, Tezenas du Montcel S et al (2010) Elderly POSSUM, a dedicated score for prediction of mortality and morbidity after major colorectal surgery in older patients. Br J Surg 97:396–403
Acknowledgments
This work was supported by three grants: Haute Autorité de Santé (HAS) GJ/SF/109-05 PR 01-010. Programme Hospitalier de Recherche Clinique (PHRC) Appel d’offre Régional (AOR) 03-013. Ligue Nationale contre le Cancer (LNCC) PRC-2003-LNCC/JMH1. The following were contributing surgeons and participating units: Brassier, Didier (Aulnay/Bois); Collet, Denis (Pessac/Bordeaux), DeCalan, Loic (Tours), Decker, Georges (Luxembourg), Bakoto, A (Chateauroux), Descottes, Bernard (Limoges), Demaizières, François (Paray-le-Monial), Desrousseaux, Bruno (Lomme), Desvignes, Gérard (Montargis Amilly), Dilin, Christian (Thonon les Bains), Ducerf, Christian (Lyon), Evrard, Serge (Bordeaux), Fabre, Xavier (Cholet), Flamant, Yves (Colombes), Fingerhut, Abe (Poissy), Fourtanier, Gilles (Toulouse), Gabelle, Philippe (Grenoble), Gainant, Alain (Limoges), Gayet, Brice (Paris), Hennet, Henri (Romorantin), Herbiere, Patrick (Albi), Herjean, Marion (Valenciennes), Ianelli, Antonio (Menton), Jaeck, Daniel (Strasbourg), Kohlmann, Gérard (Corbeil-Essonne), Laborde, Yves (Pau), Lehur, Paul-Antoine (Nantes), Langlois-Zantain, Odile (Montluçon), Leynaud, Gérard (Montluçon), Merad, Fehti (Poissy/Eaubonne/Alger), Michot, François (Rouen), Oberlin, Philippe (Villeneuve St Georges), Pellissier, Edouard (Besançon), Pessaux, Patrick (Angers), Peyrard, Pierre (Compiegne), Philippe, Olivier (Orange), Pujol, José (Bergerac), Regimbeau, Jean-Marc (Amiens), Rey, Claude (Vernon), Sage, Michel (Auxerre), Segol, Philippe (Caen), Tarla, Emmanuel (Cannes), Tison, Marc (Dunkerque), Triboulet, Jean-Pierre (Lille), Troalen, Karen (Gonesse), Vacher, Bernard (Argenteuil), Veyrières, Michel (Pontoise).
Conflict of interest
None of the authors has any conflict of interest with respect to the contents or the writing of the manuscript.
Ethical approval
As completely anonymous patient data recording took place all throughout the study, no ethics board or IRB approval was deemed necessary for this study.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Merad, F., Baron, G., Pasquet, B. et al. Prospective Evaluation of In-hospital Mortality with the P-POSSUM Scoring System in Patients Undergoing Major Digestive Surgery. World J Surg 36, 2320–2327 (2012). https://doi.org/10.1007/s00268-012-1683-0
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00268-012-1683-0