Introduction

Maxillofacial injuries comprise a substantial part of today’s emergency department visits. Computed tomography (CT) has been widely accepted as the routine imaging modality of choice for the diagnosis of these injuries. In the past decades, the increased use of CT has raised concerns regarding radiation dose associated risks, such as the carcinogenic potential [1]. Thus, clinical decisions aids were proposed to reduce unnecessary diagnostic imaging and associated health care costs.

The Wisconsin criteria were suggested as a clinical decision aid for midfacial and mandibular fractures [2]. Attempts to validate these criteria were unsuccessful in other studies [3,4,5]. A variety of studies published risk scores and clinical decision aids specifically for orbital fractures [6,7,8,9]. Separate clinical decision aids were also proposed for zygoma, orbital floor, nasal and mandibular fractures [4, 10, 11]. However, these decision aids have important limitations. First, a decision aid for specific fracture types is only useful for a selection of the maxillofacial trauma population. Second, combining midfacial and mandibular fractures as outcome does not allow for separate decision making for patients with isolated midfacial or mandibular trauma. Third, most studies collected data in single-centers resulting in geographic and demographic biases.

To our belief, a clinical decision aid for maxillofacial trauma should be straightforward and reproducible for all emergency department workers, including emergency physicians and specialized trauma surgeons. Moreover, a clinical decision aid should be applicable to both isolated and multitrauma patients. In today’s emergency care, diagnostic imaging is routinely considered in case of signs related to maxillofacial trauma. Therefore, it would be especially useful for identifying patients with a low risk of maxillofacial fractures thus reducing unnecessary imaging and, subsequently, in lowering radiation exposure and associated health care costs. In addition, we believe it would optimize the workflow of emergency department visits for these specific patients. We, therefore, initiated a prospective multicenter so called REDUCTION-I study (REDucing Unnecessary Computed Tomography In MaxillOfacial INjury). The aim of this study was twofold. First, to assess the diagnostic accuracy of physical examination findings for patients with clinically suspected midfacial or mandibular trauma. Second, to construct a clinical decision aid with the focus being on ruling out the presence of midfacial and mandibular fractures in emergency department patients.

Materials and methods

Study design and ethical approval

A prospective multicenter observational cohort study was conducted of all patients admitted with a midfacial or mandibular trauma. The Medical Ethical Committee of the University Medical Center Groningen confirmed that the Medical Research Involving Human Subjects Act does not apply (METc code 2017/249) and local feasibility was approved for the Isala hospitals (METC171208) and Nij Smellinghe hospital (MEC6383/JS/AB). The study was performed in compliance with the Declaration of Helsinki and the FEDERA (Foundation Federation of Dutch Medical Scientific Societies) code of conduct. The study was registered at ClinicalTrials.gov (NCT03314480) and reported according to the STARD guidelines (Standards for Reporting of Diagnostic Accuracy Studies) and Methodologic Standards for Interpreting Clinical Decision Rules in Emergency Medicine [12, 13].

Inclusion and exclusion criteria

All consecutive patients presenting with a midfacial or mandibular trauma at the emergency department of the University Medical Center Groningen (level I), Isala hospital Zwolle (Level I), Isala Diaconessenhuis hospital Meppel (level III) and Nij Smellinghe hospital Drachten (level III) between the period of May 2018 and October 2019 were included. Patients younger than 18 years and patients admitted a second time for maxillofacial trauma within the inclusion period were excluded. Patients were also excluded if the initial assessment was performed in another hospital or access to medical records was declined.

Standardized assessment

All the eligible patients underwent a full physical examination consisting of 15 and 14 physical examination findings dedicated to the midfacial and mandibular region respectively. The physical examination was conducted by emergency physicians, surgeons or resident physicians of these professions. The process to standardize the physical examination was established using a tripartite strategy. First, each physician received an individual hands-on instruction on how to standardize each physical examination parameter. Second, we provided instructional videos on an open accessible online educational tool. Third, a pocket card was provided for bedside use, containing eligibility criteria and visualized physical examination findings. The findings were assessed during the primary or secondary assessment, and scored as absent, present or not assessable (supplementary Table S1). The findings were assessed without knowledge of the radiological imaging outcome, unless the emergent medical need of the patient required otherwise.

Outcome and radiological imaging

The primary outcome was the presence of either a midfacial or mandibular fracture diagnosed with computed tomography (CT), cone beam computed tomography (CBCT) or panoramic orthopantomography (OPT). Midfacial fractures were defined as any fracture of the frontal sinus, orbital rim and walls, maxillary sinus, zygomaticomaxillary complex, nasoorbitoethmoid (NOE) complex, nasal bone, Le Fort I, II, III complex, and maxillary dentoalveolar complex. A mandibular fracture was defined as any fracture of the symphyseal, parasymphyseal, corpus, angular, ramus, coronoid and condylar process, and fractures of the mandibular dentoalveolar complex. CT datasets were assessed by radiologists, and CBCT and OPT were assessed by oral and maxillofacial surgeons. Radiological interpretations were performed blinded from the physical examination findings. Fracture classification was performed by a board certified oral and maxillofacial surgeon (BvM). Secondary outcomes were source of referral, mechanism of injury, age, reported alcohol use, state of consciousness in accordance with the Glasgow Coma Score, and status of intubation and sedation.

Statistical analysis

The Statistical Package for the Social Sciences was used for the data analysis (IBM Corp. Released 2015. IBM SPSS Statistics for Windows, Version 23.0. Armonk, NY: IBM Corp.). Categorical variables were reported as frequencies and percentages. Normally distributed variables were reported as means and standard deviations, and variables with a skewed distribution were reported as median and inter quartile range. Normality was examined using Q–Q plots and tested using the Kolmogorov–Smirnov test. The diagnostic accuracy with corresponding 95% confidence intervals was calculated for the individual physical examination findings considering absent and present findings.

Principle component analysis (PCA) was used to construct a clinical decision aid for midfacial and mandibular traumas separately, with the focus being on identifying patients with a low fracture risk. The PCA analysis was performed with subsequent promax rotation and Kaiser normalization, and used to identify the underlying structure among physical examination findings. The Barlett’s test of sphericity and the Kaiser–Meyer–Olkin measure of sampling adequacy were conducted to test whether the variables were uncorrelated in the correlation matrix. Factors with Eigenvalues greater than one were initially retained. The factor loadings and clinical considerations of two board certified oral and maxillofacial surgeons (MD and BvM) were perused to identify the best combination of clinical physical examination findings to predict the presence of midfacial or mandibular fractures. Contingency tables were constructed with the absent findings being listed as ‘negative’, whereas the present not testable and missing findings were listed as a ‘positive’ findings. The diagnostic accuracy outcomes included: prevalence, pre-test probability, sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), positive likelihood ratio (LR +) and negative likelihood ratio (LR – ).

Results

Patient identification

A total of 1128 consecutive patients with clinically suspected maxillofacial fracture(s) were screened in the 4 participating hospitals of whom 135 (12.0%) were excluded (Fig. 1). Seven patients were excluded because of multiple criteria of exclusion. Among the remaining 993 patients, 766 were suspected of midfacial fractures, 280 of mandibular fractures. Of the total population, 208 patients were suspected for both midfacial and mandibular fractures. Patient characteristics are summarized in Table 1.

Fig. 1
figure 1

Flowchart of study patients

Table 1 Patient characteristics

Radiological imaging

CT was obtained in 752 (98.2%) and CBCT in 14 (1.8%) midfacial trauma patients of whom fractures were diagnosed in 339 patients (44.3%). For mandibular trauma patients, CT was obtained in 238 (85.0%) patients, CBCT in 10 (3.6%) patients, and OPT in 32 (11.4%) patients. Mandibular fractures were diagnosed in 66 (23.6%) patients. Among the 208 patients with both midfacial and mandibular traumas, 106 (51.0%) of the patients only had midfacial fractures and 28 (13.5%) only had mandibular fractures. The remaining 11 (5.3%) patients had both midfacial and mandibular fractures.

Physical examination findings for midfacial trauma patients

The diagnostic accuracy outcomes of the individual physical examination findings are summarized in Table 2. Swelling (81.1%), laceration (56.1%), peri-orbital hematoma (46.3%) and epistaxis (37.7%) were the most common physical examination findings for the midfacial trauma populations. Physical examination findings that were least common included ocular movement limitations (1.9%), diplopia (2.9%), and subjective (3.7%) and objective malocclusion (1.4%). High sensitivity was found for swelling (86.7%) and high specificity was found for facial depression (99.3), raccoon eyes (95.3), subconjunctival hemorrhage (95.9), ocular movement limitations (99.8), diplopia (98.3), infra-orbital nerve paresthesia (97.0), subjective (98.2) and objective malocclusion (98.6), tooth mobility or avulsion (96.5), palpable step-off (98.6) and maxillary mobility (96.1). A high PPV and corresponding LR + was found for facial depression (93.9/20.0), ocular movement limitations (92.3/16.3) and palpable step-off (91.2/13.6). For NPV of the individual physical findings was low, ranging from 57.5 to 70.6.

Table 2 Diagnostic accuracy of individual physical examination findings

Physical examination findings for mandibular trauma patients

For mandibular trauma patients, jaw movement pain (47.6%) and subjective malocclusion (55.0%) were the most common physical examination findings, whereas inferior alveolar nerve paresthesia (3.1%), palpable step-off (6.3%) and tooth mobility or avulsion (6.6%) were less common. High sensitivity was found for jaw movement pain (95.2) and high specificity was found for inferior alveolar nerve paresthesia (98.0), intra-oral hematoma (92.3), palpable step-off (99.5), tooth mobility or avulsion (96.7), objective malocclusion (96.2) and the tongue blade bite test (95.0). A high PPV and LR + was found for palpable step-off (94.1/55.7) and objective malocclusion (95.5/16.5), whereas high NPV and low LR- was found for swelling (90.9/0.3), jaw movement pain (97.9/0.1), mouth opening limitations (95.7/0.2), the angular compression test (94.7/0.2), the axial chin pressure test (94.9/0.2) and the tongue blade bite test (90.5/0.5).

Clinical decision aids

A clinical decision aid was constructed for midfacial and mandibular traumas based on the positive factor loadings and the findings that were considered to be clinically relevant. The decision aid for midfacial trauma consisted of: peri-orbital haematoma, epistaxis, ocular movement limitation, infra-orbital nerve paraesthesia, palpable step-off and tooth mobility or avulsion resulting in sensitivity of 89.7 (86.0–92.5), NPV of 83.9 (78.4–88.2) and a LR- of 0.2 (0.2–0.3) (Table 3). Thereby, a total of 182 (23.8%) truly negative patients were identified when all the physical examination findings were absent. The fracture types that were ruled out by the clinical decision aid included orbital fractures (n = 9), zygomaticomaxillary complex fractures (n = 15) and nasal bone fractures (n = 12) (Table 4). Regarding mandibular trauma patients, the decision aid consisted of the angular compression test, axial chin pressure test, objective malocclusion, tooth mobility or avulsion and the tongue blade bite test, resulting in a sensitivity of 98.5 (91.9–99.7), NPV of 98.7 (92.8–99.8) and a LR –  of 0.0 (0.0–0.3) (Table 3). A total of 74 (26.4%) truly negative patients were identified when all these physical examination findings were absent. The clinical decision aid did not rule out a symphyseal/parasymphyseal fracture (n = 1). The contingency tables for the individual physical examination findings and the clinical decision aids are presented in supplementary Table S2.

Table 3 Clinical decision aid for ruling out patients with midfacial and mandibular fractures
Table 4 Fracture outcomes

Discussion

Emergency department workers are frequently faced with patients suspected of fractures of the maxillofacial region. Both the midfacial and mandibular regions are characterized by a set of distinctive physical examination findings that can be used to predict the likelihood of a fracture and, consequently, justify the need for radiological imaging. Clinical decision aids were constructed for this large prospective multicentre cohort study of emergency department patients with the aim to diagnose or rule out the presence of midfacial and mandibular fractures. We found that the clinical decision aid for midfacial trauma patients produced a sensitivity of 89.7 and NPV of 83.9, correctly identifying 23.8% of the patients who did not have a fracture. The aid for mandibular trauma patients gave a sensitivity of 98.5 and NPV of 98.7, thus identifying that 26.4% of the population did not have a fracture. Hence, the clinical decision aid can be used to reduce unnecessary use of radiological imaging, consequently reducing radiation exposure and associated health care costs for this population of patients.

Physical examination findings related to midfacial trauma are based on the distinctive and complex anatomy of the midface. Since facial depression, ocular movement limitations, infra-orbital nerve paraesthesia and palpable step-off individually had a high PPV (> 90) and LR + (> 10) means a midfacial fracture is very likely when one or more of these findings is present. Our clinical decision aid, consisting of peri-orbital haematoma, epistaxis, ocular movement limitation, infra-orbital nerve paraesthesia, palpable step-off and tooth mobility or avulsion, was unable to identify over 90% of the patients without fractures. Although 182 patients were correctly identified as not having a fracture, 35 patients were missed among whom orbital, zygomaticomaxillary complex and nasal fractures were most common. Clinical decision aids for midfacial trauma were also proposed by other authors. For example, the Wisconsin criteria uses a combination of bony step-off or instability, peri-orbital swelling or contusion, a Glasgow Coma Scale score of less than 14, malocclusion and tooth absence 2. The authors combined midfacial and mandibular fractures as an outcome. The presence of any of these findings resulted in a NPV of 87.8 and a sensitivity of 98.2, whereas the validation of these criteria by three studies resulted in a NPV of 81.3, 28.6 and 60, and a sensitivity of 97.4, 90.0 and 81.0, respectively. The other authors presented clinical decision aids for specific midfacial fracture types [8, 14]. A decision tool for orbital fractures was defined as any presence of subconjunctival hemorrhage, infra-orbital nerve paraesthesia, a change in position of the globe, reduced visual acuity or any two from peri-orbital hemorrhage, diplopia or limited eye movement, resulting in a NPV of 56.3 and a sensitivity of 80.0 8. Another study provided a decision tool for orbital floor fractures in the presence of any of the following: subconjunctival hemorrhage, infra-orbital nerve paraesthesia and ecchymosis or swelling, and resulted in a NPV and PPV of 92.3 and 74.2, respectively [14]. They also provided a decision aid for nasal and zygomaticomaxillary fractures, showing a NPV of 97.8 and 90.9. The clinical decision aids presented in their study were specifically constructed to rule out particular fracture types. However, from a clinical perspective, emergency department workers are blinded for the outcome of interest and, therefore, need to consider the full range of potential fracture types. In this present study, any midfacial fracture was chosen as an outcome to reflect the emergency department setting. Post hoc analysis can provide evidence of how the physical examination findings are related to these fracture types.

The distinctive mandibular trauma physical examination findings are related to the bilateral temporomandibular joint articulation that allows dental occlusion and articulation by mandibular motion. As individual findings, palpable step-off and objective malocclusion were found to have a particularly high PPV and LR + and so, therefore, strongly suggest the presence of a mandibular fracture. On the other hand, swelling, jaw movement pain, mouth opening limitation, the angular compression test, the axial chin pressure test and the tongue blade bite test gave a high NPV and LR – , indicating that these individual findings seems particularly useful for excluding the presence of mandibular fractures. This is in line with previous research which also found a high NPV for the tongue blade bite test [14,15,16]. We have successfully constructed a clinical decision aid for mandibular trauma patients resulting in a NPV of 98.7 and so identifying, retrospectively, that 26.4% of the patients had redundantly received radiological imaging. The clinical decision aid only missed one patient with a symphyseal fracture. Moreover, the cumulative diagnostic accuracy revealed that the clinical decision aid without the tongue blade bite test resulted in a NPV of 98.0 and so identified 34.3% of the patients correctly. There are no data available from previous research on the angular compression test and the axial chin pressure test. The utility of these tests seems particularly useful because of their generalizability and reproducibility for all emergency department workers. The diagnostic work-up for mandibular trauma patients is unique because OPT and posteroanterior mandibular radiographs can be used as primary diagnostic modality. However, this study provided evidence that CT is preferred because of the patients’ positioning, other diagnostic needs or medical treatment urgency in the setting of the emergency department.

Although the clinical decision aids in this study provide recommendations for ruling out midfacial and mandibular fractures, each patient should receive a standardized physical examination of the maxillofacial region. The presented findings and corresponding diagnostic accuracy can be used to stratify which patient at risk for maxillofacial fractures and subsequently require radiological imaging. Although, the prevalence varied in this study, each physical examination findings may have predictive value for specific fractures types. For example, ocular movement limitation and maxillary mobility were found in only 1.9% and 5.0% of the patients but may be beneficial in identifying orbital fractures and the more severe Le Fort type fractures, respectively. In addition, ophthalmologic findings including perception to light, color, form, visual acuity, pupillary reactions and fundus examination are not included in the present study but should be assessed for each patient to detect intrabulbar hemorrhage, retinal edema, detachment and optic nerve compression [17]. As each of these findings may identify specific conditions, they should be tested to the best possible, also in patients who are intubated or have an altered state of consciousness.

The methodological strengths of the study include the prospective multicenter study design, the large number of consecutive patients and the standardized physical examinations strategy for each patient. Furthermore, we included patients whose physical examination findings were stated as ‘not testable’. On using this approach, we were able to include patients who could not be assessed because of, for example, severe swelling with respect to ocular related findings, or the state of consciousness since interaction with the patients is necessary. The results of our study show that the physical examinations of both midfacial and mandibular trauma patients can lead to “not testable” findings, emphasizing the need to score this as an outcome. Previous studies did not report these specific outcomes. Most importantly, our approach to constructing the clinical decision aids makes them applicable to a full range of midfacial and mandibular trauma patients, regardless of age, mechanism of injury or trauma severity.

Limitations of our study include that the physical examinations were performed by various professions, each with different years of experience. However, from a clinical perspective, the diagnostic management of these patients is also conducted by a multidisciplinary team. Another limitation is that no validation was performed. Therefore, future research should focus on how these clinical decision aids safely can reduce unnecessary radiological imaging in a prospective cohort study with a new population of patients. Future research should also focus on how physical examination findings are related to midfacial or mandibular fractures that require immediate intervention. For example, orbital floor fractures are known for the potential entrapment of the inferior rectus muscle, causing ocular movement limitations that require surgical exploration and should, therefore, not to be missed.

In conclusion, the diagnostic accuracy of physical examination findings was identified for patients with suspected midfacial and mandibular fractures. The construction of a clinical decision aid resulted in a NPV of 83.9 for midfacial trauma patients and a NPV of 98.7 for mandibular trauma patients and may aid in stratifying patients suspected for fractures to reduce unnecessary diagnostic imaging.

Standards of reporting

The study was reported according to the STARD guidelines (Standards for Reporting of Diagnostic Accuracy Studies) and Methodologic Standards for Interpreting Clinical Decision Rules in Emergency Medicine [12, 13].