Abstract
Post-traumatic stress disorder (PTSD) is a mental disorder diagnosed by clinical interviews, self-report measures and neuropsychological testing. Traumatic brain injury (TBI) can have neuropsychiatric symptoms similar to PTSD. Diagnosing PTSD and TBI is challenging and more so for providers lacking specialized training facing time pressures in primary care and other general medical settings. Diagnosis relies heavily on patient self-report and patients frequently under-report or over-report their symptoms due to stigma or seeking compensation. We aimed to create objective diagnostic screening tests utilizing Clinical Laboratory Improvement Amendments (CLIA) blood tests available in most clinical settings. CLIA blood test results were ascertained in 475 male veterans with and without PTSD and TBI following warzone exposure in Iraq or Afghanistan. Using random forest (RF) methods, four classification models were derived to predict PTSD and TBI status. CLIA features were selected utilizing a stepwise forward variable selection RF procedure. The AUC, accuracy, sensitivity, and specificity were 0.730, 0.706, 0.659, and 0.715, respectively for differentiating PTSD and healthy controls (HC), 0.704, 0.677, 0.671, and 0.681 for TBI vs. HC, 0.739, 0.742, 0.635, and 0.766 for PTSD comorbid with TBI vs HC, and 0.726, 0.723, 0.636, and 0.747 for PTSD vs. TBI. Comorbid alcohol abuse, major depressive disorder, and BMI are not confounders in these RF models. Markers of glucose metabolism and inflammation are among the most significant CLIA features in our models. Routine CLIA blood tests have the potential for discriminating PTSD and TBI cases from healthy controls and from each other. These findings hold promise for the development of accessible and low-cost biomarker tests as screening measures for PTSD and TBI in primary care and specialty settings.
Similar content being viewed by others
Introduction
Post-traumatic stress disorder (PTSD) is defined by the co-occurrence of re-experiencing, avoidance of reminders, negative beliefs and feelings and hyper-arousal symptoms in survivors of traumatic events such as child abuse, rape, torture and war. Veterans who have been deployed to warzones are at high risk of developing PTSD. The lifetime prevalence of warzone-related PTSD in US veterans of the Vietnam War and subsequent conflicts, including the Iraq and Afghanistan Wars, is estimated to be between 10.1% and 30.9% [1, 2].
The diagnosis of PTSD is based on clinical criteria defined by the Diagnostic and Statistical Manual (DSM), which are determined by clinical interviews including the gold standard Clinician Administered PTSD Scale (CAPS)., and patient and clinician measures of symptoms and functioning. While PTSD causes substantial psychological distress and functional impairment, a significant portion of those with PTSD do not seek psychiatric care, likely due to a combination of factors including insufficient awareness, avoidance symptoms and social stigma related to feelings of self-blame, shame and weakness. Many of those seeking care following trauma present in primary care settings rather than specialty mental health settings. Primary care providers, including those in military medicine, often have limited training in the diagnosis of PTSD and limited time to assess their patients’ psychiatric problems. Because of shame, guilt and perceived weakness, warfighters frequently underreport their symptoms, while a minority exaggerate or fabricate their symptoms adding to the challenges for diagnosing PTSD including within specialty mental health settings.
PTSD is not the only and not always the most common neuropsychiatric sequelae of warzone service. Among US military veterans with deployments to Iraq and Afghanistan, 10–20% are estimated to have developed a traumatic brain injury (TBI) following blast exposure and other head injuries, with 75% of these classified by the American Congress of Rehabilitative Medicine criteria as a mild traumatic brain injury (mTBI) [3]. Additionally, TBI is a common comorbidity of veterans with PTSD. TBI results in structural and functional disruptions within the brain. Structural damage occurs through the impact of the trauma, which can include skull fracture, blood vessel damage and more commonly diffuse axonal shearing. These injuries subsequently cause inflammation, breakdown of the blood-brain barrier and eventually cell death. While moderate and severe TBI patients have significant trauma history and usually have neuroimaging changes, individuals with mTBI may or may not experience loss of consciousness and retrograde or anterograde amnesia and usually do not have radiological findings in routine head CT and MRI scans. In addition, veterans with mTBI often share similar symptomology with those experiencing PTSD, such as fatigue, depression, cognitive deficits, insomnia and irritability, complicating diagnosis of both conditions [4].
Development of objective biomarkers is an urgent priority for use in screening for PTSD and TBI in primary care settings and for tailoring treatments. Proteomic and lipidomic studies have identified markers, including serum tau fragments that are altered in individuals with mTBI compared to healthy controls, which show promise as diagnostic screening tests [5,6,7]. In PTSD, until recently, it was believed that there were no objective biomarkers. However, recent advances in biomarker research, including brain imaging [8], blood-based multiomic features [9], blood markers for immune modulation [10, 11] and voice markers [12] show promise for advancing PTSD diagnostic screening with objective data that is independent of self-report biases. Using a multi-omic approach with comprehensive genomic, epigenomic, metabolomic, proteomic and other high throughput measurements, Dean et al. [9] utilized a three-step down-selection process and developed a diagnostic panel with 28 different biological markers. They reported promising results for discriminating PTSD cases from controls (AUC = 0.80, accuracy 0.77, sensitivity 81%, and specificity 73%). This multiomic panel, developed by a Department of Defense (DoD) supported Systems Biology of PTSD consortium, represents one of the first efforts towards the development of a blood test for PTSD. While our PTSD consortium is working toward FDA approval for this blood test, requirements for further validation studies and the need to develop a commercial platform integrating genomic, metabolomic and proteomic markers currently precludes the use of this test in routine clinical settings.
As an alternative approach in the current study, we utilized CLIA lab tests, which are routine clinical blood tests available in primary and specialty medical practice settings, to determine if these tests have utility in discriminating warzone-related PTSD and mild TBI cases from warzone deployed healthy controls and from each other. A challenge of this approach is that many warfighters and civilians with PTSD and mild TBI develop alcohol use disorder (AUD), major depressive disorder (MDD), and obesity as determined by Body Mass Index (BMI), which can cause laboratory abnormalities that are attributable to these comorbidities rather than PTSD and mild TBI per se [13]. In this report, we present our initial findings suggesting the potential use of routine CLIA labs to screen for PTSD and mTBI, controlling for AUD, MDD, and BMI.
Materials and methods
Subject sources
We present findings from our Cohen Veteran Center (CVC) dataset which includes male veterans, recruited at NYU Langone Medical Center and Stanford University, with a history of deployment to either Iraq or Afghanistan. Exclusion criteria included current severe medical conditions unrelated to TBI or PTSD, including cerebrovascular disorders, multiple sclerosis, open head injury, cancer, autoimmune conditions and human immunodeficiency virus and severe psychiatric conditions (i.e., schizophrenia or bipolar disorder, history of psychotic disorder, obsessive-compulsive disorder, drug abuse and suicide and homicide risk).
We present results in a sample of 475 Iraq and Afghanistan veterans who had completed clinical assessments and CLIA labs and met selection criteria for one of four groups: PTSD (n = 44), TBI (n = 144), PTSD with comorbid TBI (n = 52), and warzone-deployed healthy controls (HC; n = 235).
PTSD and TBI diagnosis
PTSD diagnosis was established according to DSM-5 criteria using the Clinician-Administered PTSD Scale-5 (CAPS-5). Briefly, CAPS-5 is a 30-item clinical interview, which provides information on the frequency and severity of PTSD symptoms and functioning used to make current (past month) and lifetime diagnoses of PTSD.
mTBI diagnosis was determined by a history of closed head injury with loss of consciousness (LOC), as determined by The Ohio State University TBI Identification Method–Short Form. The Concussion Symptoms Inventory (CSI) was used for the assessment of post-concussive symptoms.
Assessing alcohol abuse and depression
Current alcohol abuse and depression were diagnosed by DSM IV criteria utilizing the Structured Clinical Interview for DSM-IV, Non-Patient Version (SCID-IV). A participant was considered positive for current alcohol use disorder if they met SCID-IV criteria for current mild to severe alcohol abuse. A participant was considered positive for current depression if they met SCID –IV criteria for current major depressive disorder.
Blood samples
Fasting venous blood samples were obtained by venipuncture between 0800 and 0900 am, following an overnight fast. Upon arrival at the clinical site, subjects were asked to rest in a supine position for 30 min prior to venipuncture. Nurses completed blood draws using 21 G butterfly needles. Blood samples were immediately delivered to the clinical lab after the blood draw and analyzed immediately for each participant.
CLIA lab analysis
Complete blood count with differential, basic metabolic panel, hepatic panel, total cholesterol, triglycerides (TG), high-density lipoprotein (HDL), low-density lipoprotein (LDL), hemoglobin A1c (HbA1c), C-reactive protein (CRP), gamma-glutamyl transferase (GGT) and serum insulin were measured using CLIA-certified lab procedures. Insulin resistance (IR) was assessed using the homeostatic model assessment (HOMA-IR), calculated as (glucose × insulin)/(22.5 × 18) [14]. Diabetes was defined by HbA1c ≥ 6.5 or fasting glucose ≥ 126, whereas pre-diabetes was defined by HbA1c 5.7–6.4 or fasting glucose 100–125.
Adjusting for imbalance in the sample
Because the dataset was imbalanced for the number of individuals in each clinical group, a decision boundary based on an unadjusted analysis is misleading. SMOTE (Synthetic Minority Oversampling Technique) was used to rebalance the data [15,16,17]. The SMOTE algorithm creates synthetic data points in the feature space by randomly picking a point on a line between two close neighboring subjects. There are several advantages to using SMOTE to rebalance the dataset, including 1) avoidance of overfitting problems, 2) avoidance of information loss, and 3) simplified data implementation and interpretation.
Feature selection and prediction
Random Forest, a classification method, is an ensemble method comprised of many independent decision trees. Each tree ends in terminal nodes whose composition determines the local predicted class. The overall RF classification is determined by a “vote” summarizing the individual tree results. RF uses a bootstrap method to select a sample from the dataset for each tree to train the decision tree and uses the left out (out-of-bag, OOB) sample to estimate the prediction error [18]. This method provides a measure of the importance of each feature for prediction by adding a noise term to each feature and examining its consequence via changes in the Gini Index, or overall error. The larger the changes, the more important this feature is to the prediction model.
Stepwise forward variable selection was used to maximize the AUC in each of the models. We ascertained 41 CLIA labs, including metabolic markers (fasting glucose and insulin resistance), inflammatory markers, liver function tests and complete blood count (CBC). These features, along with their mean and standard deviations across the study groups, are presented in Table 1.
Four RF models were used to discriminate PTSD from HC, mTBI from HC, PTSD comorbid with mTBI from HC and PTSD from mTBI based on the best features identified from the stepwise variable selection processes. AUC, accuracy, sensitivity and specificity were computed for each of the four models. The importance ranking of variables, measured by the mean decrease in the Gini impurity index, were also obtained.
Selection of cut points for determining sensitivity and specificity
For each of the four models we determined sensitivity (SE) and false positive rates (1-Specifity) rates by selecting to a cut point that maximizes the distance of a point on the ROC curve to the line of chance in which true positive rates equal true negative rates. This distance is known as Youden’s Index. The cut point corresponding to its maximum is considered ideal for representing the diagnostic value inherent in the ROC, in that it produces SE and 1-SP furthest from chance values.
Confounder analysis
In order to determine whether current comorbid alcohol abuse and current depression are confounders of our prediction models, we performed a confounder analysis. As an example, to test if the current MDD is a confounder, two hypotheses need to be rejected for each marker in the final models:: i) H0: Pr(CLIA | MDD) = Pr(CLIA) i.e., the CLIA lab values and MDD are independent and ii) H0: Pr(PTSD | CLIA, MDD,) = Pr(PTSD | CLIA) i.e., PTSD given CLIA and MDD is conditionally independent of MDD. To test the first hypothesis, Hoeffding’s D nonparametric test of independence or the Kruskall Wallace test as appropriate was used. To test the conditional independence hypothesis, Random Forests (RF) were individually obtained for Pr(PTSD | MDD, CLIA) and compared to Pr(PTSD | MDD) grown from a RF without the CLIA lab values. A test of equality of these probabilities was performed using a one-sample Wilcoxon rank on the differences in probabilities. A similar analysis was performed for current alcohol abuse and BMI.
Results
Table 2 summarizes demographic data for the participants. The average ages for PTSD, TBI, TBI with PTSD and HC subjects were 32.51 (SD 5.78), 32.21 (SD 7.75), 33.40 (SD 7.84), and 31.78 (SD 6.19), respectively. There were no significant differences comparing HC with PTSD, TBI, and TBI with comorbid PTSD groups in age, education level, and BMI. However, there were significant differences between HC and TBI with comorbid PTSD subjects in ethnicity, and HOMA-IR, although in neither group did participants meet diagnostic criteria for hyperlipidemia or prediabetes.
Discriminating PTSD cases from healthy controls
In this comparison we found glucose, CRP, hbA1c, WBC, and alkaline phosphatase as the five most important features in the RF model (Fig. 1a). The AUC, accuracy, sensitivity, and specificity using random forest with all CLIA features were 0.730, 0.706, 0.659, and 0.715, respectively (Fig. 2a). HOMA-IR was not included in the CLIA features for RF.
a Discriminating PTSD from Healthy Controls - AUC, Accuracy, Sensitivity, and Specificity b Discriminating TBI from Healthy Controls -AUC, Accuracy, Sensitivity, and Specificity c Discriminating PTSD comorbid with TBI from Healthy Controls- AUC, Accuracy, Sensitivity, and Specificity d Discriminating PTSD from TBI- AUC, Accuracy, Sensitivity, and Specificity.
Discriminating TBI from healthy controls
In this subgroup comparison, we found HbA1c, bicarbonate (CO2), sodium (Na), Calcium (Ca), and aspartate aminotransferase (AST) as the five most important features (Fig. 1b). The AUC, accuracy, sensitivity, and specificity using random forest features were 0.704, 0.677, 0.671, and 0.681, respectively (Fig. 2b). Similar to the previous subgroup comparison, HOMA-IR was not included in the CLIA features for RF.
Discriminating PTSD with comorbid TBI from healthy controls
After including HOMA-IR in this subgroup comparison, we found insulin, HOMA-IR, AST, neutrophils count, and triglyceride as the five most important features (Fig. 1c). The AUC, accuracy, sensitivity, and specificity using random forest were 0.739, 0.742, 0.635, and 0.766, respectively (Fig. 2c).
Discriminating PTSD from TBI
In this subgroup comparison, we found glucose, calcium (Ca), total protein, alkaline phosphatase, and mean corpuscular hemoglobin concentration (MCHC) as the five most important features (Fig. 1d). The AUC, accuracy, sensitivity, and specificity using random forest were 0.726, 0.723, 0.636, and 0.747, respectively (Fig. 2d). HOMA-IR was also included in the CLIA features for RF.
Confounder analysis
In light of a high prevalence of comorbid BMI, depression, and alcohol abuse in PTSD and TBI patients, we investigated whether AUD, MDD or BMI were confounders in our group comparisons. Our confounder analyses revealed that none of these three features are confounders, suggesting that our Random Forest classification using CLIA blood tests classifies PTSD and TBI independently of the effects of alcohol abuse, major depressive disorder, and obesity (see Supplemental Table 1–4).
Discussion
Developing biomarkers to screen for neuropsychiatric disorders including PTSD and mTBI is an urgent priority. A previous study from Dean et al. [9] identified 28 multi-omic blood biomarkers to accurately and reliably predict PTSD, a proof-of-concept study, which demonstrated that objective criteria are feasible. In the current study, we identified features from routine CLIA laboratory blood tests which hold promise for screening for PTSD and TBI in veterans in primary care and other medical practice settings. With independent replication implementation of this approach has potential for low cost, accessible biomarkers, permitting high throughput, nonstigmatizing screening for PTSD and TBI in military personnel and veterans in primary care and specialty medical settings. These findings are intended to advance screening, to be used in concert with PTSD and TBI diagnostic assessments based on clinical interviews and self-report measures in primary care and with the CAPS, self-report measures, neuropsychological testing and structural, functional and molecular neuroimaging in specialty mental health and neurological care. Our findings also shed light on biological mechanisms underlying the development of PTSD and TBI.
Each of the four models identified a set of CLIA features with variable importance. Of note, none of the single CLIA features results is sufficient to differentiate subjects with PTSD, mild TBI or PTSD with comorbid mild TBI from control subjects and from each other. However, using the RF technique, a combination of these CLIA features holds promise as screening measures for use in routine clinical practice. These findings are consistent with the complexity of the biology of PTSD and mTBI. They also underscore the importance of advanced statistical analysis in deciphering the multiple interactive biological features for these disorders.
The five most important biomarkers differentiating PTSD from HC from our analysis are glucose, CRP, HbA1c, WBC, and alkaline phosphatase. Each feature, except alkaline phosphatase, is greater in the PTSD than the HC group. Elevated glucose and HbA1c are indicative of impaired glucose metabolism, which may eventually lead to pre-diabetes and diabetes. Elevated CRP and WBC levels are associated with an inflammatory state. Together, the elevation of these four markers in the PTSD group is consistent with clinical signs of pre-diabetes and systematic inflammation. Given these findings we would expect that our PTSD subjects would have elevated AST and ALT, markers for subclinical impaired liver function. This is the case, even though these two markers are not the most important features identified in RF. Interestingly, we found that compared to HC alkaline phosphatase levels are lower in the PTSD group, instead of being increased as occurs in impaired liver function. Decreased alkaline phosphatase, which is relatively rare, is sometimes associated with mineral deficiency, such as zinc and magnesium. It is possible that alkaline phosphatase becomes elevated later in impaired liver function. von Känel and colleagues found that PTSD symptom severity following myocardial infarction was associated with higher levels of alkaline phosphatase [19]. Alternatively, PTSD subjects may have mineral deficiency which has not been previously reported. At this point, the relevance of decreased alkaline phosphatase in our PTSD subjects requires further clarification.
In our classification models differentiating mTBI and HC, the five most prominent features are HbA1c, CO2, Na, Ca, and AST. Except for CO2, these markers have increased values in the mTBI group. Similar to our PTSD group, elevated HbA1c is associated with impaired glucose metabolism. Elevation of AST is a sign of impaired liver function, which can occur with systematic inflammation, insulin resistance, or excessive alcohol intake. As expected, ALT is also elevated in the mTBI subjects, even though ALT is not among the most important features identified in RF. The other three features are electrolytes, which can be dysregulated in severe TBI patients due to neuroendocrine and metabolic changes. For example, hypernatremia is commonly associated with TBI with multiple mechanisms, including postconcussive diabetes insipidus from impaired ADH secretion, water loss from diuretics, and hypertonic sodium intake [20]. On the other hand, hypercalcemia in TBI patients may be associated with immobilization or neuroendocrine influence in bone remodeling [21]. Decreased serum CO2 can be associated with respiratory and metabolic acidosis, which can result from a variety of causes, such as chronic lung or kidney disease.
In our RF model for discriminating PTSD comorbid with TBI from HC, the five most prominent features are insulin, HOMA-IR, AST, neutrophils count, and triglyceride. All five features are elevated in PTSD comorbid with TBI. Insulin, similar to HOMA-IR, is another marker for glucose metabolism. Elevated neutrophil count is a sign of inflammation. Elevated triglyceride, similar to elevated AST, can be associated with metabolic syndrome, diabetes, or excessive alcohol intake.
Interestingly, electrolytes are not among the most prominent features. This could result from the more severe abnormalities in glucose metabolism and inflammation, which can mask the relatively subtle changes in electrolytes. These results are not surprising as there was elevation in HDL, HbA1c levels, and CRP levels, which suggest that subjects with TBI and PTSD have already developed sub-syndromal clinical signs of metabolic syndrome, although the level of abnormality has not reached a diagnostic threshold.
Our model for discriminating between PTSD and mTBI identified glucose, Ca, total protein, alkaline phosphatase, and MCHC as the most prominent features. Except for MCHC, all of these features are increased in the PTSD group relative to the mTBI group. Once again, glucose is among the most prominent features, suggesting that impaired glucose metabolism is a more important feature for PTSD than mTBI. Elevated alkaline phosphatase is suggestive of impaired liver function. While elevated total protein is associated with dehydration, decreased MCHC may suggest anemia. Both PTSD and mTBI subjects have higher levels of calcium compared to HC. The higher levels of calcium in PTSD than in mTBI may be explained by greater reductions in mobility due to social withdrawal. Alternatively, differences in calcium levels may be explained by different neuroendocrine changes in PTSD from mTBI with an unclear clinical significance.
In overview our study showed that in our RF models, routine clinical blood tests for assessing glucose metabolism and inflammatory processes are often among the most prominent features (glucose, insulin, HOMA-IR, HbA1c, CRP). RF models test for complex higher order interactions among all of the variables in the model. Identification of these features suggests that metabolic disturbances with impaired glucose tolerance and insulin resistance could be an important biological characteristic of PTSD. Importantly, dysregulation of glucose metabolism likely precedes the development of other clinical abnormalities such as systematic inflammation, dyslipidemia, and cardiovascular diseases. As impaired glucose metabolism is a significant risk factor for cardiovascular disease, these results also underscore the importance of using advanced statistical models to make clinical predictions based on subthreshold diagnostic laboratory values. These findings are in line with previous reports of US veterans indicating PTSD and other mental illnesses increase cardiovascular risks [22].
PTSD may increase the risk of insulin resistance and diabetes through several possible mechanisms. It is associated with elevated inflammatory markers, such as C-reactive protein, interleukin 6 (IL-6) and tumor necrosis factor (TNF), which can increase insulin resistance [19, 23]. It is also associated with alterations to the hypothalamic-pituitary-adrenal axis, often with paradoxically low cortisol [24, 25], which has been shown linked to visceral obesity and insulin resistance. PTSD is also associated with elevated BMI, poor sleep, and lifestyle changes including sedentary behavior and poor dietary choices, which all contribute to the development of diabetes [26, 27].
Our study has identified several CLIA features which hold promise for differentiating TBI and TBI with PTSD from healthy control subjects. Subgroup comparisons between HC and TBI showed that biomarkers in glucose metabolism (HbA1c) are among the most important features, which suggests that glucose intolerance and insulin resistance can also be a part of the pathophysiology of TBI.
Systematic inflammation can be another aspect of the pathophysiology of TBI. Neuronal injury from TBI can trigger an inflammatory molecular cascade in the area surrounding the injury, stimulating the release of proinflammatory cytokines from glial cells, as well as deregulating angiogenic factors and activating metalloproteases. These events are likely to cause damage and leakage of the blood-brain barrier and may lead to systemic inflammation, with changes in percentage of different peripheral WBCs, including lymphocytes [28, 29]. Indeed, systemic inflammation has been hypothesized as a consequence of both TBI and PTSD [30]. This systemic inflammation hypothesis is also confirmed by the concomitant increase in CRP, a well-known biomarker of inflammatory responses which is synthetized by the liver following interleukin-6 secretion by macrophages and T cells.
Biomarkers in lipid metabolism are also often among the most prominent features, although they are not among the top five features in all of the group comparisons. A disturbance in lipid metabolism was observed in the brain of a TBI mouse model [31]. Lower levels of several major phospholipid (PL) classes have been reported in TBI, PTSD, and TBI with PTSD groups, compared with healthy controls [32]. Lower PL levels have been reported in those with moderate-to-severe PTSD. In a clinical study, monounsaturated fatty acid–containing phosphatidylcholine (PC) and phosphatidylinositol (PI) species were lower in the TBI and TBI with PTSD groups [32].
Conclusion
PTSD and mild TBI have overlapping symptoms, with few previously reported abnormalities in routine clinical laboratory and imaging findings, presenting diagnostic challenges. Our study has shown that with advanced statistical techniques using random forest methods, we were able to utilize routine CLIA laboratory blood tests to differentiate PTSD and mild TBI from healthy controls and from each other. Our results have further shown that increased glucose and insulin resistance levels and upregulation of inflammatory markers are promising blood biomarkers for low cost, high-throughput diagnostic screening for both PTSD and mild TBI. Independent validation of our results in new samples of veterans and service members are required to support the implementation of CLIA labs for screening for military service-related PTSD and TBI in medical practice settings.
Limitations
There are a several limitations to this study. We do not propose our blood biomarkers as definitive diagnostic tests, rather as low cost, high throughput widely accessible initial screening measures to be used in conjunction with patient self-reports, clinical interviews and where feasible specialized neuropsychological testing and neuroimaging procedures. Additionally, the number of participants in the PTSD and mTBI groups is smaller than the HC group, which biases the model to predict the majority class in all cases. To address this issue, SMOTE was used to rebalance our data. Furthermore, the accuracies of the models are less than ideal for screening measures, necessitating refinement in down selection of the features in future studies.
The consistent ability of CLIA labs to discriminate between the psychopathology group contrasts provide some validation evidence of CLIA labs ability to separate PTSD cases from controls. Importantly, while the random forest OOB algorithm provides internal validation for all classification contrasts made, external validation is still required. In exploratory analyses we attempted to replicate our findings utilizing CLIA labs to differentiate PTSD cases and healthy controls in the CVC cohort in an independent data set of OEF and OIF veterans, designated the Systems Biology Cohort (SBC) (Dean and colleagues, 2020). The SBC comprises 83 PTSD cases and 82 combat exposed healthy controls. We did not recruit for an mTBI group in the SBC cohort. Applying the CLIA lab model from our discovery analyses in the CVC Cohort, we found lower overall accuracy in the replication sample, 0.706 in the CVC discovery sample versus 0.606 in the SBC external validation sample, with the AUC declining from 0.73 to 0.60. This reduced accuracy may be attributable in part to sample size limitations and heterogeneity of clinical and CLIA lab features in the CVC and SBC cohorts. Given these limitations, replication of our findings in an independently recruited larger cohort of veterans with CLIA labs ascertained in PTSD, mTBI, and warzone-deployed healthy controls, with more balanced numbers in each group, is needed as a next step towards validating our findings.
Code availability
An R-code implementing the considered tests in our paper is available with this paper at C.R.M’s website at New York University Langone Health.
References
Seal KH, Bertenthal D, Miner CR, Sen S, Marmar C. Bringing the war back home: mental health disorders among 103 788 US veterans returning from Iraq and Afghanistan seen at Department of Veterans Affairs Facilities. Arch Intern Med. 2007;167:476–82.
Marmar CR, Schlenger W, Henn-Haase C, Qian M, Purchia E, Li M, et al. Course of posttraumatic stress disorder 40 years after the Vietnam War: findings from the National Vietnam Veterans Longitudinal Study. JAMA Psychiatry. 2015;72:875–81.
Lotan E, Morley C, Newman J, Qian M, Abu-Amara D, Marmar C, et al. Prevalence of cerebral microhemorrhage following chronic blast-related mild traumatic brain injury in military service members using susceptibility-weighted MRI. AJNR Am J Neuroradiol. 2018;39:1222–5.
Stein MB, McAllister TW. Exploring the convergence of posttraumatic stress disorder and mild traumatic brain injury. Am J Psychiatry. 2009;166:768–76.
Shahim P, Gren M, Liman V, Andreasson U, Norgren N, Tegner Y, et al. Serum neurofilament light protein predicts clinical outcome in traumatic brain injury. Sci Rep. 2016;6:1–9.
Abu Hamdeh S, Shevchenko G, Mi J, Musunuri S, Bergquist J, Marklund N. Proteomic differences between focal and diffuse traumatic brain injury in human brain tissue. Sci Rep. 2018;8:1–5.
Pasvogel AE, Miketova P, Moore IM. Differences in CSF phospholipid concentration by traumatic brain injury outcome. Biol Res Nurs. 2010;11:325–31.
Toll RT, Wu W, Naparstek S, Zhang Y, Narayan M, Patenaude B, et al. An electroencephalography connectomic profile of posttraumatic stress disorder. Am J Psychiatry. 2020;177:233–43.
Dean KR, Hammamieh R, Mellon SH, Abu-Amara D, Flory JD, Guffanti G, et al. Multi-omic biomarker identification and validation for diagnosing warzone-related post-traumatic stress disorder. Mol Psychiatry. 2020;25:3337–49.
Passos IC, Vasconcelos-Moreno MP, Costa LG, Kunz M, Brietzke E, Quevedo J, et al. Inflammatory markers in post-traumatic stress disorder: a systematic review, meta-analysis, and meta-regression. Lancet Psychiatry. 2015;2:1002–12.
Daskalakis NP, Cohen H, Nievergelt CM, Baker DG, Buxbaum JD, Russo SJ, et al. New translational perspectives for blood-based biomarkers of PTSD: from glucocorticoid to immune mediators of stress susceptibility. Exp Neurol. 2016;284:133–40.
Marmar CR, Brown AD, Qian M, Laska E, Siegel C, Li M, et al. Speech-based markers for posttraumatic stress disorder in US veterans. Depress Anxiety. 2019;36:607–16.
Blessing EM, Reus V, Mellon SH, Wolkowitz OM, Flory JD, Bierer L, et al. Biological predictors of insulin resistance associated with posttraumatic stress disorder in young military veterans. Psychoneuroendocrinology. 2017;82:91–7.
Matthews DR, Hosker JP, Rudenski AS, Naylor BA, Treacher DF, Turner RC. Homeostasis model assessment: insulin resistance and beta-cell function from fasting plasma glucose and insulin concentrations in man. Diabetologia. 1985;28:412–9.
Chawla NV, Bowyer KW, Hall LO, Kegelmeyer WP. SMOTE: synthetic minority over-sampling technique. J Artif Intell Res. 2002;16:321–57.
Bunkhumpornpat C, Sinapiromsaran K, Lursinsap C. Safe-level-smote: safe-level- synthetic minority over-sampling technique for handling the class imbalanced problem. PAKDD 2009. Lecture Notes in Computer Science 2009;5476. https://doi.org/10.1007/978-3-642-01307-2_43.
Jishan ST, Rashu RI, Haque N, Rahman RM. Improving accuracy of students’ final grade prediction model using optimal equal width binning and synthetic minority over- sampling technique. Decis Analytics. 2015;2:1–25.
Breiman L. Out-of-bag estimation. edu/pub/users/breimain 1996;199.
von Känel R, Hepp U, Kraemer B, Traber R, Keel M, Mica L, et al. Evidence for low-grade systemic proinflammatory activity in patients with posttraumatic stress disorder. J Psychiatr Res. 2007;41:744–52.
Kolmodin L, Sekhon MS, Henderson WR, Turgeon AF, Griesdale DE. Hypernatremia in patients with severe traumatic brain injury: a systematic review. Ann Intensive Care. 2013;3:1–7.
Bajwa NM, Kesavan C, Mohan S. Long-term consequences of traumatic brain injury in bone metabolism. Front Neurol. 2018;9:115.
Cohen BE, Marmar CR, Neylan TC, Schiller NB, Ali S, Whooley MA. Posttraumatic stress disorder and health-related quality of life in patients with coronary heart disease: findings from the Heart and Soul Study. Arch Gen Psychiatry. 2009;66:1214–20.
Spitzer C, Barnow S, Völzke H, Wallaschofski H, John U, Freyberger HJ, et al. Association of posttraumatic stress disorder with low-grade elevation of C- reactive protein: evidence from the general population. J Psychiatr Res. 2010;44:15–21.
Yehuda R. Post-traumatic stress disorder. N. Engl J Med. 2002;346:108–14.
Yehuda R, Hoge CW, McFarlane AC, Vermetten E, Lanius RA, Nievergelt CM, et al. Post-traumatic stress disorder. Nat Rev Dis Prim. 2015;1:1–22.
Harvey AG, Jones C, Schmidt DA. Sleep and posttraumatic stress disorder: a review. Clin Psychol Rev. 2003;23:377–407.
Knutson KL, Ryden AM, Mander BA, Van Cauter E. Role of sleep duration and quality in the risk and severity of type 2 diabetes mellitus. Arch Intern Med. 2006;166:1768–74.
Siwicka-Gieroba D, Malodobry K, Biernawska J, Robba C, Bohatyrewicz R, Rola R, et al. The neutrophil/lymphocyte count ratio predicts mortality in severe traumatic brain injury patients. J Clin Med. 2019;8:1453.
Ramos-Cejudo J, Wisniewski T, Marmar C, Zetterberg H, Blennow K, de Leon MJ, et al. Traumatic brain injury and Alzheimer’s disease: the cerebrovascular link. EBioMedicine. 2018;28:21–30.
Kim TD, Lee S, Yoon S. Inflammation in post-traumatic stress disorder (PTSD): a review of potential correlates of PTSD with a neurological perspective. Antioxid (Basel). 2020;9:107.
Abdullah L, Evans JE, Ferguson S, Mouzon B, Montague H, Reed J, et al. Lipidomic analyses identify injury-specific phospholipid changes 3 mo after traumatic brain injury. FASEB J. 2014;28:5311–21.
Emmerich T, Abdullah L, Crynen G, Dretsch M, Evans J, Ait-Ghezala G, et al. Plasma lipidomic profiling in a military population of mild traumatic brain injury and post-traumatic stress disorder with apolipoprotein e ɛ4-dependent effect. J Neurotrauma. 2016;33:1331–48.
Acknowledgements
This study was supported by grants from the Steven A. and Alexandra M. Cohen Foundation, Inc., Cohen Veterans Bioscience, Inc. (CVB), the US Army Research Office and US Department of Defense to NYU Grossman School of Medicine and by support from the Office of Science and Research (OSR) of NYU Grossman School of Medicine. The content is solely the responsibility of the authors and does not necessarily represent the official views of the Cohen Foundation, CVB or US Army Research Office and US Department of Defense.
Author information
Authors and Affiliations
Contributions
The authors confirm contribution to the paper as follows: study conception and design: CRM; data collection: DA-A, AG, and MKJ; analysis and interpretation of results: MX, ZL, CES, EML, JN, EMB, SRF, SF, AE, and CRM; draft manuscript preparation: MX, ZL, CES, EML, and CRM All authors reviewed the results and approved the final version of the manuscript.
Corresponding author
Ethics declarations
Competing interests
C.R.M has received research and clinical program funding from National Institute on Alcohol Abuse and Alcoholism (NIAAA), National Institute of Mental Health (NIMH). Department of Defense (DoD), U.S. Army Medical Research & Acquisition Activity (USAMRA), U.S. Army Telemedicine & Advanced Technology Research Center (TATRC), Steven & Alexandra Cohen Foundation, Cohen Veterans Bioscience (CVB). Cohen Veterans Network (CVN), Robin Hood Foundation. McCormick Foundation, Home Depot Foundation, Bank of America Foundation, Brockman Foundation, City of New York, has served as a PTSD Fellow for the George W. Bush Institute and is serving on the Clinical Science Advisory Group for Otsuka Pharmaceuticals. A.E.is the founder and owns equity in Alto Neuroscience, has consulted for and owns equity in Akili Interactive and Mindstrong Health, and has consulted for Brainsway, Cervel, Takaeda, Posit, Acadia, Otsuka, Lundbeck, and Janssen. A.E. received a grant from Brain Resource and is a paid editor at Neuropsychopharmacology. A.E. and C.R.M. have a pending patent (WO2017172487A1) entitled “Detecting or treating post-traumatic stress syndrome.” The other authors report no financial relationships with commercial interests.
Protection of Human Subjects
The investigators have adhered to the policies for the protection of human subjects as prescribed in AR 70–25 and the IRBs of the NYU Grossman School of Medicine and Stanford University. Informed consent was obtained from all subjects.
Additional information
Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary information
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Xu, M., Lin, Z., Siegel, C.E. et al. Screening for PTSD and TBI in Veterans using Routine Clinical Laboratory Blood Tests. Transl Psychiatry 13, 64 (2023). https://doi.org/10.1038/s41398-022-02298-x
Received:
Revised:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41398-022-02298-x
- Springer Nature Limited