Abstract
Objective
The goal of the paper is to determine inter-rater reliability of trained examiners performing standardized strength assessments using manual muscle testing (MMT).
Design, subjects, and setting
The authors report on 19 trainees undergoing quality assurance within a multi-site prospective cohort study.
Intervention
Inter-rater reliability for specially trained evaluators (“trainees”) and a reference rater, performing MMT using both simulated and actual patients recovering from critical illness was evaluated.
Measurements and results
Across 26 muscle groups tested by 19 trainee-reference rater pairs, the median (interquartile range) percent agreement and intraclass correlation coefficient (ICC; 95% CI) were: 96% (91, 98%) and 0.98 (0.95, 1.00), respectively. Across all 19 pairs, the ICC (95% CI) for the overall composite MMT score was 0.99 (0.98–1.00). When limited to actual patients, the ICC was 1.00 (95% CI 0.99–1.00). The agreement (kappa; 95% CI) in detecting clinically significant weakness was 0.88 (0.44–1.00).
Conclusions
MMT has excellent inter-rater reliability in trained examiners and is a reliable method of comprehensively assessing muscle strength.
References
Herridge MS, Cheung AM, Tansey CM, Matte-Martyn A, Diaz-Granados N, Al-Saidi F, Cooper AB, Guest CB, Mazer CD, Mehta S, Stewart TE, Barr A, Cook D, Slutsky AS, Canadian Critical Care Trials Group (2003) One-year outcomes in survivors of the acute respiratory distress syndrome. New Engl J Med 348:683–693
Stevens RD, Dowdy DW, Micheals RK, Mendez-Tellez PA, Pronovost PJ, Needham DM (2007) Neuromuscular dysfunction acquired in critical illness: a systematic review. Intensive Care Med 33:1876–1891
Nanas S, Kritikos K, Angelopoulos E, Siafaka A, Tsikriki S, Poriazi M, Kanaloupiti D, Kontogeorgi M, Pratikaki M, Zervakis D, Routsi C, Roussos C (2008) Predisposing factors for critical illness polyneuropathy in a multidisciplinary intensive care unit. Acta Neurol Scand 118:175–181
Guarneri B, Bertolini G, Latronico N (2008) Long-term outcome in patients with critical illness myopathy or neuropathy: the Italian multicenter CRIMYNE study. J Neurol Neurosurg Psychiatry 79:838–841
Ali NA, O’Brien JM Jr, Hoffmann SP, Phillips G, Garland A, Finley JC, Almoosa K, Hejal R, Wolf KM, Lemeshow S, Connors AF Jr, Marsh CB, Midwest Critical Care Consortium (2008) Acquired weakness, handgrip strength, and mortality in critically ill patients. Am J Respir Crit Care Med 178:261–268
Hughes VA, Frontera WR, Wood M, Evans WJ, Dallal GE, Roubenoff R, Fiatarone Singh MA (2001) Longitudinal muscle strength changes in older adults: influence of muscle mass, physical activity, and health. J Gerontol A Biol Sci Med Sci 56:B209–B217
Steffensen BF, Lyager S, Werge B, Rahbek J, Mattsson E (2002) Physical capacity in non-ambulatory people with Duchenne muscular dystrophy or spinal muscular atrophy: a longitudinal study. Dev Med Child Neurol 44:623–632
Carin-Levy G, Greig C, Young A, Lewis S, Hannan J, Mead G (2006) Longitudinal changes in muscle strength and mass after acute stroke. Cerebrovasc Dis 21:201–207
De Jonghe B, Sharshar T, Lefaucheur JP, Authier FJ, Durand-Zaleski I, Boussarsar M, Cerf C, Renaud E, Mesrati F, Carlet J, Raphael JC, Outin H, Bastuji-Garin S, Groupe de Reflexion et d’Etude des Neuromyopathies en Reanimation (2002) Paresis acquired in the intensive care unit: a prospective multicenter study. JAMA 288:2859–2867
Medical Research Council/Guarantors of Brain (1986) Aids to the examination of the peripheral nervous system. Bailliere Tindall, London
Polard H, Lakay B, Tucker F, Watson E, Bablis P (2005) Interexaminer reliability of the deltoid and psoas muscle test. J Manipulative Physiol Ther 18:52–56
Gregson JM, Leathley MJ, Moore P, Smith TL, Sharma AK, Watkins CL (2000) Reliability of measure tones and muscle power in stroke patients. Age Aging 29:223–228
Florence JM, Pandya S, King WM, Robison JD, Signore LC, Wentzell M, Province MA (1984) Clinical trials in Duchenne dystrophy: standardization and evaluation of reliability procedures. Phys Ther 64:41–45
Kleyweg RP, Meche FGA, Schmitz PI (1991) Interobserver agreement in the assessment of muscle strength and functional abilities Guillain-Barre syndrome. Muscle Nerve 14:1103–1109
Needham DM, Dennison CR, Dowdy DW, Mendez-Tellez PA, Ciesla N, Desai SV, Sevransky J, Shanholtz C, Scharfstein D, Herridge MS, Pronovost PJ (2005) Study protocol: the improving care of acute lung injury patients (ICAP) study. Crit Care 10:R9
Shrout PE, Fleiss JL (1979) Intraclass correlations: uses in assessing rater reliability. Psychol Bull 86:420–427
Perry J, Weiss WB, Burnfield JM, Gronley JK (2004) The supine hip extensor manual muscle test: a reliability and validity study. Arch Phys Med Rehabil 85:1345–1350
Barr AE, Diamond BE, Wade CK, Harashima T, Pecorella WA, Potts CC, Rosenthal H, Fleiss JL, McMahon DJ (1991) Reliability of testing measures in Duchenne or Becker muscular dystrophy. Arch Phys Med Rehabil 72:315–319
Escolar DM, Henricson EK, Mayhew J, Florence J, Leshner R, Patel KM, Clemens PR (2001) Clinical evaluator reliability for quantitative and manual muscle testing measures of strength in children. Muscle Nerve 24:787–793
Caruso W, Leisman G (2000) A force/displacement analysis of muscle testing. Percept Mot Skills 91:683–692
Acknowledgments
This research is supported by the National Institutes of Health (Acute Lung Injury SCCOR grant P050 HL 73994). EF is supported by a Fellowship Award from the Canadian Institutes of Health Research and a Detweiler Traveling Fellowship from the Royal College of Physicians and Surgeons of Canada. DMN is supported by a Clinician-Scientist Award from the Canadian Institutes of Health Research. The funding bodies had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; and preparation, review, or approval of the manuscript.
Conflicts of interest statement
No potential conflicts of interest to disclose.
Author information
Authors and Affiliations
Corresponding author
Electronic supplementary material
Below is the link to the electronic supplementary material.
Rights and permissions
About this article
Cite this article
Fan, E., Ciesla, N.D., Truong, A.D. et al. Inter-rater reliability of manual muscle strength testing in ICU survivors and simulated patients. Intensive Care Med 36, 1038–1043 (2010). https://doi.org/10.1007/s00134-010-1796-6
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00134-010-1796-6