Skip to main content
SpringerLink
Log in

The reliability of the Glasgow Coma Scale: a systematic review

Intensive Care Medicine volume 42, pages 3–15 (2016)Cite this article

Abstract

Introduction

The Glasgow Coma Scale (GCS) provides a structured method for assessment of the level of consciousness. Its derived sum score is applied in research and adopted in intensive care unit scoring systems. Controversy exists on the reliability of the GCS. The aim of this systematic review was to summarize evidence on the reliability of the GCS.

Methods

A literature search was undertaken in MEDLINE, EMBASE and CINAHL. Observational studies that assessed the reliability of the GCS, expressed by a statistical measure, were included. Methodological quality was evaluated with the consensus-based standards for the selection of health measurement instruments checklist and its influence on results considered. Reliability estimates were synthesized narratively.

Results

We identified 52 relevant studies that showed significant heterogeneity in the type of reliability estimates used, patients studied, setting and characteristics of observers. Methodological quality was good (n = 7), fair (n = 18) or poor (n = 27). In good quality studies, kappa values were ≥0.6 in 85 %, and all intraclass correlation coefficients indicated excellent reliability. Poor quality studies showed lower reliability estimates. Reliability for the GCS components was higher than for the sum score. Factors that may influence reliability include education and training, the level of consciousness and type of stimuli used.

Conclusions

Only 13 % of studies were of good quality and inconsistency in reported reliability estimates was found. Although the reliability was adequate in good quality studies, further improvement is desirable. From a methodological perspective, the quality of reliability studies needs to be improved. From a clinical perspective, a renewed focus on training/education and standardization of assessment is required.

This is a preview of subscription content, access via your institution.

Access options

Buy single article

Instant access to the full article PDF.

USD 39.95

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Fig. 1
Fig. 2

References

  1. Teasdale G, Jennett B (1974) Assessment of coma and impaired consciousness. A practical scale. Lancet 2:81–84

    Article  CAS  PubMed  Google Scholar 

  2. Koziol J, Hacke W (1990) Multivariate data reduction by principal components with application to neurological scoring instruments. J Neurol 237:461–464

    Article  CAS  PubMed  Google Scholar 

  3. Knaus WA, Draper EA, Wagner DP, Zimmerman JE (1985) APACHE II: a severity of disease classification system. Crit Care Med 13:818–829

    Article  CAS  PubMed  Google Scholar 

  4. Vincent JL, Moreno R, Takala J et al (1996) The SOFA (Sepsis-related Organ Failure Assessment) score to describe organ dysfunction/failure. On behalf of the Working Group on Sepsis-Related Problems of the European Society of Intensive Care Medicine. Intensive Care Med 22:707–710

    Article  CAS  PubMed  Google Scholar 

  5. Le Gall JR, Lemeshow S, Saulnier F (1993) A new Simplified Acute Physiology Score (SAPS II) based on a European/North American multicenter study. JAMA 270:2957–2963

    Article  PubMed  Google Scholar 

  6. Teasdale G, Maas A, Lecky F et al (2014) The Glasgow Coma Scale at 40 years: standing the test of time. Lancet Neurol 13:844–854. doi:10.1016/S1474-4422(14)70120-6

    Article  PubMed  Google Scholar 

  7. Murray GD, Butcher I, McHugh GS et al (2007) Multivariable prognostic analysis in traumatic brain injury: results from the IMPACT study. J Neurotrauma 24:329–337

    Article  PubMed  Google Scholar 

  8. Mokkink LB, Terwee CB, Patrick DL et al (2010) The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes. J Clin Epidemiol 63:737–745. doi:10.1016/j.jclinepi.2010.02.006

    Article  PubMed  Google Scholar 

  9. Fava GA, Tomba E, Sonino N (2012) Clinimetrics: the science of clinical measurements. Int J Clin Pract 66:11–15. doi:10.1111/j.1742-1241.2011.02825.x

    Article  CAS  PubMed  Google Scholar 

  10. Sun S (2011) Meta-analysis of Cohen’s kappa. Health Serv Outcomes Res Methodol 11:145–163

    Article  Google Scholar 

  11. Baker M (2008) Reviewing the application of the Glasgow Coma Scale: Does it have interrater reliability? Br J Neurosci Nurs 4:342–347. doi:10.12968/bjnn.2008.4.7.30674

    Article  Google Scholar 

  12. Green SM (2011) Cheerio, laddie! Bidding farewell to the Glasgow Coma Scale. Ann Emerg Med 58:427–430

    Article  PubMed  Google Scholar 

  13. Lowry M (1998) Emergency nursing and the Glasgow Coma Scale. Accid Emerg Nurs 6:143–148

    Article  CAS  PubMed  Google Scholar 

  14. Wijdicks EFM (2006) Clinical scales for comatose patients: the Glasgow Coma Scale in historical context and the new FOUR Score. Rev Neurol Dis 3:109–117

    PubMed  Google Scholar 

  15. Zuercher M, Ummenhofer W, Baltussen A, Walder B (2009) The use of Glasgow Coma Scale in injury assessment: a critical review. Brain Inj 23:371–384. doi:10.1080/02699050902926267

    Article  PubMed  Google Scholar 

  16. Prasad K (1996) The Glasgow Coma Scale: a critical appraisal of its clinimetric properties. J Clin Epidemiol 49:755–763

    Article  CAS  PubMed  Google Scholar 

  17. Moher D, Liberati A, Tetzlaff J, Altman DG (2009) Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med 6:e1000097. doi:10.1371/journal.pmed.1000097

    Article  PubMed Central  PubMed  Google Scholar 

  18. Landis JR, Koch GG (1977) The measurement of observer agreement for categorical data. Biometrics 33:159–174

    Article  CAS  PubMed  Google Scholar 

  19. Terwee CB, Bot SDM, de Boer MR et al (2007) Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol 60:34–42. doi:10.1016/j.jclinepi.2006.03.012

    Article  PubMed  Google Scholar 

  20. Fleiss J (1986) The design and analysis of clinical experiments. Wiley, New York

    Google Scholar 

  21. Teasdale G, Knill-Jones R, van der Sande J (1978) Observer variability in assessing impaired consciousness and coma. J Neurol Neurosurg Psychiatry 41:603–610

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  22. Heron R, Davie A, Gillies R, Courtney M (2001) Interrater reliability of the Glasgow Coma Scale scoring among nurses in sub-specialties of critical care. Aust Crit Care 14:100–105

    Article  CAS  PubMed  Google Scholar 

  23. Nunnally JC, Bernstein IH (1994) Psychometric theory, 3rd edn. McGraw-Hill, New York

    Google Scholar 

  24. Menegazzi JJ, Davis EA, Sucov AN, Paris PM (1993) Reliability of the Glasgow Coma Scale when used by emergency physicians and paramedics. J Trauma 34:46–48

    Article  CAS  PubMed  Google Scholar 

  25. Hollander JE, Go S, Lowery DW et al (2003) Inter-rater reliability of criteria used in assessing blunt head injury patients for intracranial injuries. Acad Emerg Med 10:830–835

    Article  PubMed  Google Scholar 

  26. Kho ME, McDonald E, Stratford PW, Cook DJ (2007) Interrater reliability of APACHE II scores for medical-surgical intensive care patients: a prospective blinded study. Am J Crit Care 16:378–383

    PubMed  Google Scholar 

  27. Wenner JB, Norena M, Khan N et al (2009) Reliability of intensive care unit admitting and comorbid diagnoses, race, elements of Acute Physiology and Chronic Health Evaluation II Score, and predicted probability of mortality in an electronic intensive care unit database. J Crit Care 24:401–407

    Article  PubMed  Google Scholar 

  28. Chen LM, Martin CM, Morrison TL, Sibbald WJ (1999) Interobserver variability in data collection of the APACHE II score in teaching and community hospitals. Crit Care Med 27:1999–2004

    Article  CAS  PubMed  Google Scholar 

  29. Diringer MN, Edwards DF (1997) Does modification of the Innsbruck and the Glasgow Coma Scales improve their ability to predict functional outcome? Arch Neurol 54:606–611

    Article  CAS  PubMed  Google Scholar 

  30. Sadaka F, Patel D, Lakshmanan R (2012) The FOUR score predicts outcome in patients after traumatic brain injury. Neurocrit Care 16:95–101

    Article  PubMed  Google Scholar 

  31. Gill MR, Reiley DG, Green SM (2004) Inter-rater reliability of Glasgow Coma Scale scores in the emergency department. Ann Emerg Med 43:215–223

    Article  PubMed  Google Scholar 

  32. Feldman A, Hart KW, Lindsell CJ, McMullan JT (2015) Randomized controlled trial of a scoring aid to improve Glasgow Coma Scale scoring by emergency medical services providers. Ann Emerg Med 65(325–329):e2. doi:10.1016/j.annemergmed.2014.07.454

    PubMed  Google Scholar 

  33. Juarez VJ, Lyons M (1995) Interrater reliability of the Glasgow Coma Scale. J Neurosci Nurs 27:283–286

    Article  CAS  PubMed  Google Scholar 

  34. Rowley G, Fielding K (1991) Reliability and accuracy of the Glasgow Coma Scale with experienced and inexperienced users. Lancet 337:535–538

    Article  CAS  PubMed  Google Scholar 

  35. Fielding K, Rowley G (1990) Reliability of assessments by skilled observers using the Glasgow Coma Scale. Aust J Adv Nurs 7:13–17

    CAS  PubMed  Google Scholar 

  36. Gill M, Martens K, Lynch EL et al (2007) Inter-rater reliability of 3 simplified neurologic scales applied to adults presenting to the emergency department with altered levels of consciousness. Ann Emerg Med 49:403–407

    Article  PubMed  Google Scholar 

  37. Koch D, Linn S (2000) The Glasgow Coma Scale and the challenge of clinimetrics. Int Med J 7:51–60

    Google Scholar 

  38. Sternbach GL (2000) The Glasgow coma scale. J Emerg Med 19:67–71

    Article  CAS  PubMed  Google Scholar 

  39. McHugh ML (2012) Interrater reliability: the kappa statistic. Biochem Medica 22:276–282

    Article  Google Scholar 

  40. Heard K, Bebarta VS (2004) Reliability of the Glasgow Coma Scale for the emergency department evaluation of poisoned patients. Hum Exp Toxicol 23:197–200

    Article  PubMed  Google Scholar 

  41. Le Roux P, Menon DK, Citerio G et al (2014) Consensus summary statement of the international multidisciplinary consensus conference on multimodality monitoring in neurocritical care : a statement for healthcare professionals from the Neurocritical Care Society and the European Society of Intensive Care Medicine. Intensive Care Med 40(9):1189–1209. doi:10.1007/s00134-014-3369-6

    Article  PubMed  Google Scholar 

  42. Livingston BM, Mackenzie SJ, MacKirdy FN, Howie JC (2000) Should the pre-sedation Glasgow Coma Scale value be used when calculating acute physiology and chronic health evaluation scores for sedated patients? Scottish Intensive Care Society Audit Group. Crit Care Med 28:389–394

    Article  CAS  PubMed  Google Scholar 

  43. Rutledge R, Lentz CW, Fakhry S, Hunt J (1996) Appropriate use of the Glasgow Coma Scale in intubated patients: a linear regression prediction of the Glasgow Verbal Score from the Glasgow Eye and Motor scores. J Trauma 41:514–522

    Article  CAS  PubMed  Google Scholar 

  44. Zuercher M, Ummenhofer W, Baltussen A, Walder B (2009) The use of Glasgow Coma Scale in injury assessment: a critical review. Brain Inj 23:371–384. doi:10.1080/02699050902926267

    Article  PubMed  Google Scholar 

  45. Kottner J, Audige L, Brorson S et al (2011) Guidelines for reporting reliability and agreement studies (GRRAS) were proposed. J Clin Epidemiol 64:96–106. doi:10.1016/j.jclinepi.2010.03.002

    Article  PubMed  Google Scholar 

  46. Zhao X (2011) When to use Cohen’s k, if Ever?. International Communication Association 2011 Conference, Boston, pp 1–30

    Google Scholar 

  47. Braakman R, Avezaat CJ, Maas AI et al (1977) Inter observer agreement in the assessment of the motor response of the Glasgow coma scale. Clin Neurol Neurosurg 80:100–106

    Article  CAS  PubMed  Google Scholar 

  48. Rimel RW, Jane JA, Edlich RF (1979) An injury severity scale for comprehensive management of central nervous system trauma. JACEP 8:64–67

    Article  CAS  PubMed  Google Scholar 

  49. Lindsay KW, Teasdale GM, Knill-Jones RP (1983) Observer variability in assessing the clinical features of subarachnoid hemorrhage. J Neurosurg 58:57–62

    Article  CAS  PubMed  Google Scholar 

  50. Stanczak DE, White JG 3rd, Gouview WD et al (1984) Assessment of level of consciousness following severe neurological insult. A comparison of the psychometric qualities of the Glasgow Coma Scale and the comprehensive level of Consciousness Scale. J Neurosurg 60:955–960. doi:10.3171/jns.1984.60.5.0955

    Article  CAS  PubMed  Google Scholar 

  51. Starmark JE, Heath A (1988) Severity grading in self-poisoning. Hum Toxicol 7:551–555

    Article  CAS  PubMed  Google Scholar 

  52. Starmark JE, Stalhammar D, Holmgren E, Rosander B (1988) A comparison of the Glasgow Coma Scale and the Reaction Level Scale (RLS85). J Neurosurg 69:699–706

    Article  CAS  PubMed  Google Scholar 

  53. Tesseris J, Pantazidis N, Routsi C, Fragoulakis D (1991) A comparative study of the Reaction Level Scale (RLS85) with Glasgow Coma Scale (GCS) and Edinburgh-2 Coma Scale (modified) (E2CS(M)). Acta Neurochir Wien 110:65–76

    Article  CAS  PubMed  Google Scholar 

  54. Ellis A, Cavanagh SJ (1992) Aspects of neurosurgical assessment using the Glasgow Coma Scale. Intensive Crit Care Nurs 8:94–99

    Article  CAS  PubMed  Google Scholar 

  55. Oshiro EM, Walter KA, Piantadosi S et al (1997) A new subarachnoid hemorrhage grading system based on the Glasgow Coma Scale: a comparison with the Hunt and Hess and World Federation of Neurological Surgeons Scales in a clinical series. Neurosurgery 41:140–147

    Article  CAS  PubMed  Google Scholar 

  56. Crossman J, Bankes M, Bhan A, Crockard HA (1998) The Glasgow Coma Score: reliable evidence? Injury 29:435–437

    Article  CAS  PubMed  Google Scholar 

  57. Wijdicks EF, Kokmen E, O’Brien PC (1998) Measurement of impaired consciousness in the neurological intensive care unit: a new test. J Neurol Neurosurg Psychiatry 64:117–119

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  58. Lane PL, Baez AA, Brabson T et al (2002) Effectiveness of a Glasgow Coma Scale instructional video for EMS providers. Prehosp Disaster Med 17:142–146

    PubMed  Google Scholar 

  59. Ely EW, Truman B, Shintani A et al (2003) Monitoring sedation status over time in ICU patients: reliability and validity of the Richmond Agitation-Sedation Scale (RASS). JAMA 289:2983–2991

    Article  PubMed  Google Scholar 

  60. Wijdicks EF, Bamlet WR, Maramattom BV et al (2005) Validation of a new Coma Scale: the FOUR score. Ann Neurol 58:585–593

    Article  PubMed  Google Scholar 

  61. Holdgate A, Ching N, Angonese L (2006) Variability in agreement between physicians and nurses when measuring the Glasgow Coma Scale in the emergency department limits its clinical usefulness. Emerg Med Australas 18:379–384

    Article  PubMed  Google Scholar 

  62. Baez AA, Giraldez EM, De Pena JM (2007) Precision and reliability of the Glasgow Coma Scale score among a cohort of Latin American prehospital emergency care providers. Prehosp Disaster Med 22:230–232

    Article  PubMed  Google Scholar 

  63. Kerby JD, MacLennan PA, Burton JN et al (2007) Agreement between prehospital and emergency department Glasgow Coma Scores. J Trauma 63:1026–1031

    Article  PubMed  Google Scholar 

  64. Wolf CA, Wijdicks EF, Bamlet WR, McClelland RL (2007) Further validation of the FOUR Score Coma Scale by intensive care nurses. Mayo Clin Proc 82:435–438

    Article  PubMed  Google Scholar 

  65. Nassar AP Jr, Neto RCP, de Figueiredo WB, Park M (2008) Validity, reliability and applicability of Portuguese versions of Sedation-Agitation Scales among critically ill patients. Sao Paulo Med J 126:215–219

    Article  Google Scholar 

  66. Akavipat P (2009) Endorsement of the FOUR Score for consciousness assessment in neurosurgical patients. Neurol Med Chir Tokyo 49:565–571

    Article  PubMed  Google Scholar 

  67. Iyer VN, Mandrekar JN, Danielson RD et al (2009) Validity of the FOUR Score Coma Scale in the medical intensive care unit. Mayo Clin Proc 84:694–701

    Article  PubMed Central  PubMed  Google Scholar 

  68. Ryu WHA, Feinstein A, Colantonio A et al (2009) Early identification and incidence of mild TBI in Ontario. Can J Neurol Sci 36:429–435

    Article  PubMed  Google Scholar 

  69. Stead LG, Wijdicks EF, Bhagra A et al (2009) Validation of a new Coma Scale, the FOUR Score, in the emergency department. Neurocrit Care 10:50–54

    Article  PubMed  Google Scholar 

  70. Fischer M, Ruegg S, Czaplinski A et al (2010) Inter-rater reliability of the Full Outline of Unresponsiveness Score and the Glasgow Coma Scale in critically ill patients: a prospective observational study. Crit Care 14:R64

    Article  PubMed Central  PubMed  Google Scholar 

  71. Idrovo L, Fuentes B, Medina J et al (2010) Validation of the FOUR Score (Spanish Version) in acute stroke: an interobserver variability study. Eur Neurol 63:364–369

    Article  PubMed  Google Scholar 

  72. Necioglu Orken D, Kocaman Sagduyu A, Sirin H et al (2010) Reliability of the Turkish version of a new Coma Scale: FOUR Score. Balk Med J 27:28–31

    Google Scholar 

  73. Ashkenazy S, DeKeyser-Ganz F (2011) Assessment of the reliability and validity of the Comfort Scale for adult intensive care patients. Heart Lung 40:e44–e51

    Article  PubMed  Google Scholar 

  74. Bruno MA, Ledoux D, Lambermont B et al (2011) Comparison of the FOUR and Glasgow Liege Scale/Glasgow Coma Scale in an intensive care unit population. Neurocrit Care 15:447–453

    Article  PubMed  Google Scholar 

  75. Gujjar AR, Nandagopal R, Jacob PC et al (2011) FOUR Score–a new Coma Score: inter-observer reliability and relation to outcome in critically ill medical patients. Eur J Neurol 18:441

    Google Scholar 

  76. Kevric J, Jelinek GA, Knott J, Weiland TJ (2011) Validation of the Full Outline of Unresponsiveness (FOUR) Scale for conscious state in the emergency department: comparison against the Glasgow Coma Scale. Emerg Med J 28:486–490

    Article  CAS  PubMed  Google Scholar 

  77. Namiki J, Yamazaki M, Funabiki T, Hori S (2011) Inaccuracy and misjudged factors of Glasgow Coma Scale scores when assessed by inexperienced physicians. Clin Neurol Neurosurg 113:393–398

    Article  PubMed  Google Scholar 

  78. Patel D, Sadaka F, Lakshmanan R (2011) The FOUR score predicts outcome in patients after traumatic brain injury. Neurocrit Care 15:S238

    Google Scholar 

  79. Takahashi C, Okudera H, Origasa H et al (2011) A simple and useful coma scale for patients with neurologic emergencies: the Emergency Coma Scale. Am J Emerg Med 29:196–202

    Article  PubMed  Google Scholar 

  80. Winship C, Williams B, Boyle M (2011) Assessment of the Glasgow Coma Scale: a pilot study examining the accuracy of paramedic undergraduates. Australas J Paramed 10:11

    Google Scholar 

  81. Marcati E, Ricci S, Casalena A et al (2012) Validation of the Italian version of a new Coma Scale: the Four Score. Intern Emerg Med 7:145–152

    Article  PubMed  Google Scholar 

  82. Winship C, Williams B, Boyle MJ (2012) Should an alternative to the Glasgow Coma Scale be taught to paramedic students? Emerg Med J 30:e19

    Article  PubMed  Google Scholar 

  83. Benítez-Rosario MA, Castillo-Padrós M, Garrido-Bernet B et al (2013) Appropriateness and reliability testing of the modified richmond Agitation-Sedation Scale in Spanish patients with advanced cancer. J Pain Symptom Manag 45:1112–1119

    Article  Google Scholar 

  84. Dinh MM, Oliver M, Bein K et al (2013) Level of agreement between prehospital and emergency department vital signs in trauma patients. Emerg Med Australas 25:457–463

    PubMed  Google Scholar 

  85. Gujjar AR, Jacob PC, Nandhagopal R et al (2013) FOUR score and Glasgow Coma Scale in medical patients with altered sensorium: interrater reliability and relation to outcome. J Crit Care 28(316):e1–e8

    PubMed  Google Scholar 

Download references

Acknowledgments

The authors would like to thank Sir Graham Teasdale, Emeritus Professor of Neurosurgery, University of Glasgow, UK, for the valuable discussions and very helpful contribution throughout the course of this work. This work was in part supported by the Framework 7 program of the European Union in the context of CENTER-TBI (Grant Number 602150-2).

Author information

Authors and Affiliations

  1. Department of Neurosurgery, Antwerp University Hospital, Wilrijkstraat 10, 2650, Edegem, Belgium

    Florence C. M. Reith, Ruben Van den Brande & Andrew I. R. Maas

  2. University of Antwerp, Edegem, Belgium

    Florence C. M. Reith, Ruben Van den Brande & Andrew I. R. Maas

  3. Australian & New Zealand Intensive Care Research Centre (ANZIC-RC), School of Public Health and Preventive Medicine, Monash University, Melbourne, Australia

    Anneliese Synnot

  4. Cochrane Consumers and Communication Review Group, Centre for Health Communication and Participation, School of Psychology and Public Health, La Trobe University, Melbourne, Australia

    Anneliese Synnot

  5. Central Clinical School, Monash University, Melbourne, Australia

    Russell Gruen

  6. Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore, Singapore

    Russell Gruen

  7. ANZIC-RC, Department of Epidemiology and Preventive Medicine, Monash University, The Alfred Hospital, Level 6, 99 Commercial Road, Melbourne, VIC, 3004, Australia

    Anneliese Synnot

  8. Central Clinical School, Level 6, The Alfred Centre, 99 Commercial Road, Melbourne, VIC, 3004, Australia

    Russell Gruen

Authors
  1. Florence C. M. Reith
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ruben Van den Brande
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Anneliese Synnot
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Russell Gruen
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Andrew I. R. Maas
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Florence C. M. Reith.

Ethics declarations

Conflicts of interest

The authors declare that they have no conflict of interest.

Additional information

Take-home message: The overall reliability of the GCS is adequate, but can be improved by a renewed focus on adequate training and standardization. The methodological quality of reliability studies should be improved.

Electronic supplementary material

Rights and permissions

Reprints and Permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Reith, F.C.M., Van den Brande, R., Synnot, A. et al. The reliability of the Glasgow Coma Scale: a systematic review. Intensive Care Med 42, 3–15 (2016). https://doi.org/10.1007/s00134-015-4124-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00134-015-4124-3

Keywords

search

Navigation