Abstract
Purpose
The aims of this study were (1) to demonstrate the AOSpine thoracolumbar spine injury classification system can be reliably applied by an international group of surgeons and (2) to delineate those injury types which are difficult for spine surgeons to classify reliably.
Methods
A previously described classification system of thoracolumbar injuries which consists of a morphologic classification of the fracture, a grading system for the neurologic status and relevant patient-specific modifiers was applied to 25 cases by 100 spinal surgeons from across the world twice independently, in grading sessions 1 month apart. The results were analyzed for classification reliability using the Kappa coefficient (κ).
Results
The overall Kappa coefficient for all cases was 0.56, which represents moderate reliability. Kappa values describing interobserver agreement were 0.80 for type A injuries, 0.68 for type B injuries and 0.72 for type C injuries, all representing substantial reliability. The lowest level of agreement for specific subtypes was for fracture subtype A4 (Kappa = 0.19). Intraobserver analysis demonstrated overall average Kappa statistic for subtype grading of 0.68 also representing substantial reproducibility.
Conclusion
In a worldwide sample of spinal surgeons without previous exposure to the recently described AOSpine Thoracolumbar Spine Injury Classification System, we demonstrated moderate interobserver and substantial intraobserver reliability. These results suggest that most spine surgeons can reliably apply this system to spine trauma patients as or more reliably than previously described systems.
Similar content being viewed by others
References
AOSpine International (2014) AOSpine classification for traumatic fractures of the thoracolumbar spine tutorial. http://www.aovideo.ch/external/AOSCT/. Accessed 11 Nov 2013
Bailey CS, Urquhart JC, Dvorak MF, Nadeau M, Boyd MC, Thomas KC, Kwon BK, Gurr KR, Bailey SI, Fisher CG (2014) Orthosis versus no orthosis for the treatment of thoracolumbar burst fractures without neurologic injury: a multicenter prospective randomized equivalence trial. Spine J 14(11):2557–2564
Harrop JS, Vaccaro AR, Hurlbert RJ, Wilsey JT, Baron EM, Shaffrey CI, Fisher CG, Dvorak MF, Oner FC, Wood KB, Anand N, Anderson DG, Lim MR, Lee JY, Bono CM, Arnold PM, Rampersaud YR, Fehlings MG, Spine Trauma Study Group (2006) Intrarater and interrater reliability and validity in the assessment of the mechanism of injury and integrity of the posterior ligamentous complex: a novel injury severity scoring system for thoracolumbar injuries. Invited submission from the Joint Section Meeting On Disorders of the Spine and Peripheral Nerves, March 2005. J Neurosurg Spine 4:118–122
Hauptfleisch J, Meagher TM, King D, Lopez de Heredia L, Hughes RJ (2013) Out-of-hours MRI provision in the UK and models of service delivery. Clin Radiol 68:e245–e248
Kelly JC, O’Briain DE, Kelly GA, Mc Cabe JP (2012) Imaging the spine for tumour and trauma—a national audit of practice in Irish hospitals. Surgeon 10:80–83
Landis JR, Koch GG (1977) The measurement of observer agreement for categorical data. Biometrics 33:159–174
Magerl F, Aebi M, Gertzbein SD, Harms J, Nazarian S (1994) A comprehensive classification of thoracic and lumbar injuries. Eur Spine J 3:184–201
Oner FC, Ramos LM, Simmermacher RK, Kingma PT, Diekerhof CH, Dhert WJ, Verbout AJ (2002) Classification of thoracic and lumbar spine fractures: problems of reproducibility. A study of 53 patients using CT and MRI. Eur Spine J 11:235–245
Reinhold M, Audige L, Schnake KJ, Bellabarba C, Dai LY, Oner FC (2013) AO spine injury classification system: a revision proposal for the thoracic and lumbar spine. Eur Spine J 22:2184–2201
Rihn JA, Yang N, Fisher C, Saravanja D, Smith H, Morrison WB, Harrop J, Vacaro AR (2010) Using magnetic resonance imaging to accurately assess injury to the posterior ligamentous complex of the spine: a prospective comparison of the surgeon and radiologist. J Neurosurg Spine 12:391–396
Schmid R, Krappinger D, Seykora P, Blauth M, Kathrein A (2010) PLIF in thoracolumbar trauma: technique and radiological results. Eur Spine J 19:1079–1086
Schmid R, Lindtner RA, Lill M, Blauth M, Krappinger D, Kammerlander C (2012) Combined posteroanterior fusion versus transforaminal lumbar interbody fusion (TLIF) in thoracolumbar burst fractures. Injury 43:475–479
Schnake KJ, Stavridis SI, Kandziora F (2014) Five-year clinical and radiological results of combined anteroposterior stabilization of thoracolumbar fractures. J Neurosurg Spine 20:497–504
Vaccaro AR, Lehman RA Jr, Hurlbert RJ, Anderson PA, Harris M, Hedlund R, Harrop J, Dvorak M, Wood K, Fehlings MG, Fisher C, Zeiller SC, Anderson DG, Bono CM, Stock GH, Brown AK, Kuklo T, Oner FC (2005) A new classification of thoracolumbar injuries: the importance of injury morphology, the integrity of the posterior ligamentous complex, and neurologic status. Spine (Phila Pa 1976) 30:2325–2333
Vaccaro AR, Oner C, Kepler CK, Dvorak M, Schnake K, Bellabarba C, Reinhold M, Aarabi B, Kandziora F, Chapman J, Shanmuganathan R, Fehlings M, Vialle L, Forum AOSpine Spinal Cord Injury and Trauma Knowledge (2013) AOSpine thoracolumbar spine injury classification system: fracture description, neurological status, and key modifiers. Spine 38:2028–2037
Whang PG, Vaccaro AR, Poelstra KA, Patel AA, Anderson DG, Albert TJ, Hilibrand AS, Harrop JS, Sharan AD, Ratliff JK, Hurlbert RJ, Anderson P, Aarabi B, Sekhon LH, Gahr R, Carrino JA (2007) The influence of fracture mechanism and morphology on the reliability and validity of two novel thoracolumbar injury classification systems. Spine (Phila Pa 1976) 32:791–795
Wood KB, Khanna G, Vaccaro AR, Arnold PM, Harris MB, Mehbod AA (2005) Assessment of two thoracolumbar fracture classification systems as used by multiple surgeons. J Bone Joint Surg Am 87:1423–1429
Conflict of interest
AOSpine is a clinical division of the AO Foundation—an independent medically guided not for profit organization. The AO has a strong financial independence thanks to the foundations endowment. The annual operating activities are financed through three pillars: Collaboration and support agreements with DePuy Synthes and other industrial partners, return on own financial assets and other third party income (e.g. participant fees, R&D projects, memberships).
The AOSpine Knowledge Forums are pathology focused working groups acting on behalf of AOSpine in their domain of scientific expertise. Each forum consists of a steering committee of up to 10 international spine experts who meet biannually to discuss research, assess the best evidence for current practices and formulate clinical trials to advance their field of spine expertise. Authors are compensated for their travel and accommodation costs. Study support is provided directly through AOSpine’s Research department and AO’s Clinical Investigation and Documentation unit. There are no other institutional subsidies, corporate affiliations or funding sources supporting this work unless clearly documented and disclosed.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Kepler, C.K., Vaccaro, A.R., Koerner, J.D. et al. Reliability analysis of the AOSpine thoracolumbar spine injury classification system by a worldwide group of naïve spinal surgeons. Eur Spine J 25, 1082–1086 (2016). https://doi.org/10.1007/s00586-015-3765-9
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00586-015-3765-9