Internal and Emergency Medicine

, Volume 12, Issue 5, pp 613–619 | Cite as

External validation of a claims-based and clinical approach for predicting post-pulmonary embolism outcomes among United States veterans

  • Christine G. Kohn
  • Erin R. Weeda
  • Neela Kumar
  • Philip S. Wells
  • W. Frank Peacock
  • Gregory J. Fermann
  • Li Wang
  • Onur Baser
  • Jeff R. Schein
  • Concetta Crivera
  • Craig I. ColemanEmail author


The In-hospital Mortality for PulmonAry embolism using Claims daTa (IMPACT) rule can accurately identify pulmonary embolism (PE) patients at low risk of early complications using claims data. We sought to externally validate the IMPACT and simplified Pulmonary Embolism Severity Index (sPESI) tools for predicting all-cause mortality and readmission. We used Veteran Health Administration data (10/1/2010–9/30/2015) to identify adults with ≥1 inpatient diagnosis code for acute PE, ≥12 months continuous medical and pharmacy benefits prior to the index PE, ≥90 days of post-event follow-up (unless death occurred) and ≥1 claim for an anticoagulant during the index PE stay. Prognostic accuracies of IMPACT and sPESI for 30- and 90-day all-cause mortality and 90-day readmission were estimated. Of 6,746 PE patients, 7.5 and 12.6% died at 30 and 90 days. Within 90 days, 20.1% were readmitted for any reason. Hospitalization for recurrent VTE and major bleeding occurred in 5.6 and 1.7% of patients. IMPACT classified 15.2% as low risk, while 28.4% were low risk per sPESI. Both tools displayed sensitivity >90% and negative predictive values (NPVs) >97% for 30-day mortality, but low specificity (range 16.2–30.0) and positive predictive values (PPVs) (range 8.7–9.5); with similar results observed for 90-day mortality. IMPACT’s sensitivity for all-cause readmission was numerically higher than sPESI (88.2 vs. 79.0%), but both had comparable NPVs (85.1 vs. 84.2%). Similar trends were observed for VTE or major bleeding readmissions. IMPACT classified patients for post-PE outcomes with similar accuracy as sPESI. IMPACT appears useful for identifying PE patients at low risk for early mortality or readmission in claims-based studies.


Mortality Pulmonary embolism Prognosis Risk assessment Severity of illness index Administrative claim 


Compliance with ethical standards

Conflict of interest

CIC has received grant funding and consultancy fees from Janssen Pharmaceuticals; Bayer Pharma AG and Boehringer-Ingelheim Pharmaceuticals, Inc. PW has received grant funding from Bristol Myers Squib and Pfizer, is on the advisory board and has received speaker’s fees from Bayer Healthcare, has received consultancy fees from Janssen Pharmaceuticals, and served on a writing committee with Itreas. CC and JRS are employees of Janssen Scientific Affairs LLC. WFP has received grant funding and consultancy fees from Janssen Pharmaceuticals and Portola. GJF has received grant funding from Pfizer and is on the advisory board and speaker’s bureau for Janssen Pharmaceuticals. LW and OB are employees of STATinMed, Plano, TX, USA. CGK, ERW and NK have no conflicts of interest germane to this manuscript to report. No non-financial conflicts of interest exist for any of the authors.

Statement of human and animal rights

This article does not contain any studies with human participants or animals performed by any of the authors.

Informed consent


Supplementary material

11739_2017_1625_MOESM1_ESM.docx (14 kb)
Supplementary material 1 (DOCX 13 kb)


  1. 1.
    Kearon C, Akl EA, Ornelas J, Blaivas A, Jimenez D, Bounameaux H, Huisman M, King CS, Morris T, Sood N, Stevens SM, Vintch JRE, Wells P, Woller SC, Moores CL (2016) Antithrombotic therapy for VTE disease: CHEST guideline and expert panel report. Chest 149:315–352CrossRefPubMedGoogle Scholar
  2. 2.
    Konstantinides SV, Torbicki A, Agnelli G, Danchin N, Fitzmaurice D, Galiè N et al (2014) 2014 ESC guidelines on the diagnosis and management of acute pulmonary embolism. Eur Heart J 35:3033–3069CrossRefPubMedGoogle Scholar
  3. 3.
    Kohn CG, Mearns ES, Parker MW, Hernandez AV, Coleman CI (2015) Prognostic accuracy of clinical prediction rules for early post-pulmonary embolism all-cause mortality: a bivariate meta-analysis. Chest 147:1043–1062CrossRefPubMedGoogle Scholar
  4. 4.
    Jiménez D, Aujesky D, Moores L, Gómez V, Lobo JL, Uresandi F et al (2010) Simplification of the pulmonary embolism severity index for prognostication in patients with acute symptomatic pulmonary embolism. Arch Intern Med 170:1383–1389CrossRefPubMedGoogle Scholar
  5. 5.
    Coleman CI, Kohn CG, Bunz TJ (2015) Derivation and validation of the In-hospital mortality for pulmonary embolism using claims daTa (IMPACT) prediction rule. Curr Med Res Opin 31:1461–1468CrossRefPubMedGoogle Scholar
  6. 6.
    Weeda ER, Kohn CG, Fermann GJ, Peacock WF, Tanner C, McGrath D, Crivera C, Schein JR, Coleman CI (2016) External validation of prognostic rules for early post-pulmonary embolism mortality: assessment of a claims-based and three clinical-based approaches. Thromb J. 14:7CrossRefPubMedPubMedCentralGoogle Scholar
  7. 7.
    Waller D (2006) How VA hospitals became the best. Time. 168:36–37PubMedGoogle Scholar
  8. 8.
    Elixhauser A, Steiner C, Harris DR, Coffey RM (1998) Comorbidity measures for use with administrative data. Med Care 36:8–27CrossRefPubMedGoogle Scholar
  9. 9.
    Geersing GJ, Bouwmeester W, Zuithoff P, Spijker R, Leeflang M, Moons KG (2012) Search filters for finding prognostic and diagnostic prediction studies in Medline to enhance systematic reviews. PLoS One 7:e32844CrossRefPubMedPubMedCentralGoogle Scholar
  10. 10.
    Trikalinos TA, Balion CM, Coleman CI et al (2012) Chapter 8: meta-analysis of test performance when there is a gold standard. J Gen Intern Med 27(suppl 1):S56–S66CrossRefPubMedGoogle Scholar
  11. 11.
    Coleman CI, Kohn CG, Crivera C, Schein JR, Peacock WF (2015) Validation of the multivariable In-hospital Mortality for PulmonAry embolism using Claims daTa (IMPACT) prediction rule within an all-payer inpatient administrative claims database. BMJ Open 5:e009251CrossRefPubMedPubMedCentralGoogle Scholar
  12. 12.
    Kohn CG, Peacock WF, Fermann GJ, Bunz TJ, Crivera C, Schein JR et al (2016) External validation of the in-hospital mortality for PulmonAry embolism using Claims daTa (IMPACT) multivariable prediction rule. Int J Clin Pract 70:82–88CrossRefPubMedGoogle Scholar
  13. 13.
    Coleman CI, Peacock WF, Fermann GJ, Crivera C, Weeda ER, Hull M, DuCharme M, Becker L, Schein JR (2016) External validation of a multivariable claims-based rule for predicting in-hospital mortality and 30-day post-pulmonary embolism complications. BMC Health Serv Res. 16:610CrossRefPubMedPubMedCentralGoogle Scholar
  14. 14.
    Nguyen E, Peacock WF, Fermann GJ et al (2016) External validation of the multivariable ‘in-hospital mortality for PulmonAry embolism using claims daTa’ prediction rule in the premier hospital database. Eur Heart J Qual Care Clin Outcomes. doi: 10.1093/ehjqcco/qcw046 Google Scholar

Copyright information

© SIMI 2017

Authors and Affiliations

  • Christine G. Kohn
    • 1
  • Erin R. Weeda
    • 2
  • Neela Kumar
    • 3
  • Philip S. Wells
    • 4
  • W. Frank Peacock
    • 5
  • Gregory J. Fermann
    • 6
  • Li Wang
    • 7
  • Onur Baser
    • 7
    • 8
  • Jeff R. Schein
    • 9
  • Concetta Crivera
    • 9
  • Craig I. Coleman
    • 2
    Email author
  1. 1.School of PharmacyUniversity of Saint JosephHartfordUSA
  2. 2.School of PharmacyUniversity of ConnecticutStorrsUSA
  3. 3.School of PharmacyUniversity of North Carolina at Chapel HillChapel HillUSA
  4. 4.Department of MedicineUniversity of OttawaOttawaUSA
  5. 5.Department of Emergency MedicineBaylor College of MedicineHoustonUSA
  6. 6.Department of Emergency MedicineUniversity of CincinnatiCincinnatiUSA
  7. 7.STATinMed ResearchPlanoUSA
  8. 8.Department of Internal MedicineColumbia UniversityNew YorkUSA
  9. 9.Health Economics and Outcomes ResearchJanssen Scientific Affairs, LLCRaritanUSA

Personalised recommendations