Improved Prediction of Body Mass Index in Real-World Administrative Healthcare Claims Databases

Abstract

Introduction

To continue closing the gap between the predictive modeling and its real-world application, we report a new data-to-prediction pipeline that advanced the state-of-the-art predictive performance of body mass index (BMI) classifications by integrating siloed claims databases via a common data model.

Methods

This study adapted the ensemble-based methodology of the baseline prediction model and focused on removing the silos in the claims databases. We applied the Super Learner machine learning algorithm (SLA) to learn a combined dataset consisting of 50% data from the Optum Date of Death database and 50% data from the IBM MarketScan Commercial Claims and Encounters (CCAE), and omitted the commonly used one-hot-encoding step and used multi-categorical variables directly in the feature engineering process. These developments were then optimized via a standard cross-validation scheme and the performance was evaluated on a holdout test set.

Results

Sociodemographic and clinical characteristics were used with (denoted as SLA₁) and without (denoted as SLA₂) baseline BMI values to predict BMI classifications (≥ 30, ≥ 35, and ≥ 40 kg/m²). Although the newly implemented SLA₁ performed similarly to the previous model, with the area under the receiver operating characteristic curve (ROC AUC) being approximately 88% for all BMI classifications, specificity ranging from 90% to 96%, and accuracy ranging from 88% to 93%. The new SLA₂ achieved consistently better performance on all metrics across all BMI classes. In particular, the new SLA₂ achieved 77–79% in ROC AUC, increasing from the previously reported level (73%). Its specificity improved to the range of 76–90% from 71–86%. Its accuracy improved to the range of 77–86% from 73–80%. Its recall (i.e., sensitivity) improved to the range of 64–78% from 60–76%.

Conclusions

This study demonstrates dramatic improvements in the prediction of BMI across classifications using integrated databases in a common data model for the generation of real-world evidence.