Abstract
There have been questions about the reliability of subjective rating scales used to assess valleculae residue from fluoroscopic images. The aim of this study was to assess interrater agreement on one such scale, and compare it with agreement using a new objective measurement scale. Five speech and language therapists rated 100 valleculae residue still images from 20 consecutive patients using standard clinical practice (i.e., subjective visual grading of the videofluoroscopy still and rating as none, mild, moderate, or severe). The images were rerated by the same clinicians using Picture Archiving Communication System measurement tools. The valleculae residue ratio relates the residue size to the size of an individual’s valleculae. A valleculae residue ratio scale was devised using a linear classifier, which defines the cutoff between grades of valleculae residue (none, mild, moderate, and severe). The new method proved at least as reliable as the traditional method; for interrater reliability, kappa = 0.73 vs. 0.73; for intrarater reliability, kappa = 0.87 vs. 0.85. The valleculae residue ratio is proposed as a new quick reliable method of quantifying residue where the Picture Archiving Communication System is available. We now wish to test the impact of this method where poor inter- and intrarater reliability exists.
Similar content being viewed by others
References
Barczi SR, Sullivan P, Robbins J: How should dysphagia care of older adults differ? Establishing optimal practice patterns. Semin Speech Lang 21(4):347–361, 2000
Lin L, Wu S, Chen H, Wang T, Chen M: Prevalence of impaired swallowing in institutionalized older people in Taiwan. J Am Geriatr Soc 50:1118–1123, 2002
Logemann JA: Manual for the videofluorographic study of swallowing. Austin, TX: Pro-Ed, 1993
Veis S, Logemann JA, Colangelo MS: Effects of three techniques on maximum posterior movement of the tongue base. Dysphagia 15:142–145, 2000
Logemann JA: Evaluation and treatment of swallowing disorders. Austin, TX: Pro-Ed, 1998
Eisenhuber E, Schima W, Schober E, Pokieser P, Stadler A, Scharitzer M, Oschatz E: Videofluoroscopic assessment of patients with dysphagia: pharyngeal retention is a predictive factor for aspiration. AJR Am J Roentgenol 178:393–398, 2002
Centers for Disease Control and Prevention: Pneumonia and influenza death rates – United States. MMWR Morb Mortal Wkly Rep 44:535–537, 1995
Niederman MS, McCombs JS, Unger AN, Kumar A, Popovian R: The cost of treating community-acquired pneumonia. Clin Therap 20:820–837, 1998
Palmer JB, Kuhlemeier KV, Tippett DC, Lynch C: A protocol for the videofluorographic swallowing study. Dysphagia 8:209–214, 1993
Ekberg O, Nylander G, Frans-Thomas F, Sjoberg S, Birch-Jensen M, Hillarp B: Interobserver variability in cineradiographic assessment of pharyngeal function during swallow. Dysphagia 3:46–48, 1988
Wilcox F, Liss JM, Siegel GM: Interjudge agreement in videofluoroscopic studies of swallowing. J Speech Hear Res 39:144–152, 1996
McCullough GH, Wertz R, Rosenbek JC, Mills RH, Webb WG, Ross KB: Inter- and intrajudge reliability for videofluoroscopic swallowing evaluation measures. Dysphagia 16:110–118, 2001
Stoeckli SJ, Thierry AGM, Seifert B, Martin-Harris BJW: Inter-rater reliability of videofluoroscopic swallow evaluation. Dysphagia 18:53–57, 2003
Kuhlemeier KV, Yates P, Palmer J: Intra- and inter-rater variations in the evaluation of videofluorographic swallowing studies. Dysphagia 13:142–147, 1998
Ott D: Observer variation in evaluation of videofluoroscopic swallowing studies: a continuing problem [editorial]. Dysphagia 13:148–150, 1998
Dejaeger E: Mechanisms involved in postdeglutition retention in the elderly. Dysphagia 12:63–67, 1997
Rosenbek JC, Robbins JA, Roecker EB, Coyle JL, Wood JL: A penetration-aspiration scale. Dysphagia 11:93–98, 1996
Galli J, Valenanzio V, Ottaviani F, D’Alatri L, Almadori G, D’Errico G, Serra F, De Rossi G, Paludetti G: Scintigraphic assessment of swallowing after horizontal supraglottic laryngectomy. J Otolaryngol 28:190–196, 1999
Shaw DW, Williams RBH, Cook IJ, Wallace KL, Weltman MB, Collins PJ, McKay E, Smart R, Simula ME: Oropharyngeal scintigraphy: a reliable technique for the quantitative evaluation of oral-pharyngeal swallowing. Dysphagia 19:36–42, 2004
Hind JA, Nicosia MA, Roecker EB, Carnes ML, Robbins J: Comparison of effortful and non-effortful swallows in healthy middle-aged and older adults. Arch Phys Med Rehabil 82:1661–1665, 2001
Han T, Nam-Jong P, Park JW: Quantifying swallowing function after stroke: A functional dysphagia scale based on videofluoroscopic studies. Arch Phys Med Rehabil 82:677–682, 2001
International Society of Optical Engineering: Proceeding of the first international conference and workshop on picture archiving communication systems. January 18th-21st (1982), Newport Beach, California, Published by Bellingham, Washington
Huang HK: PACS: basic principles and applications. New York: Wiley-Liss, 1999
Friedman JH: Regularized discriminant analysis. J Am Stat Assoc 84:165–175, 1989
Landis J, Koch G: The measurement of observer agreement for categorical data. Biometrics 33:159–174, 1977
Mathers-Schmidt BA, Kurlinski M: Dysphagia evaluation practices: inconsistencies in clinical assessment and instrumental examination decision-making. Dysphagia 18:114–125, 2003
NHS National Programme for Information Technology: Making IT work. 1:15, 2004 (available at: http://www.dh.gov.uk/assetRoot/04/07/71/57/04077157.pdf)
Ekberg O, Feinberg M: Altered swallowing function in elderly patients without dysphagia: radiologic findings in 56 cases AJR Am J Roentgenol 156:1181–1184, 1991
Cook IJ, Weltman MD, Wallace K, Shaw DW, McKay E, Smart RC, Butler SP: Influence of ageing on oral-pharyngeal bolus transit and clearance during swallowing: scintigraphic study. Am J Physiol 266:G972–G977, 1994
Marik PE, Kaplan D: Aspiration pneumonia and dysphagia in the elderly. Chest 124(1):328–336, 2003
Pedersen DR, Lamb CA, Dolan L, Ralston H, Weinstein S, Morcuende J: Radiographic measurements in development dysplasia of the hip. J Pediatr Orthop 24:156–160, 2004
Acknowledgments
The authors thank the 20 patients who volunteered to participate in this study; the five Speech and Language Pathologists who rated the stills; the five designated radiographers who captured the videofluoroscopy images; Dr. DeSai, Consultant Radiologist, Val Gleason, Superintendent Radiographer, and Mark Brennan, PACS technician, for their support throughout this challenging study; and Linda Templey, Director of Primary and Community Care, Durham and Chester-le-Street PCT (now assimilated into County Durham PCT) for agreeing to sponsor this research.
Author information
Authors and Affiliations
Corresponding author
Additional information
This work was supported by Durham and Chester-le-Street Primary Care Trust (now assimilated into County Durham Primary Care Trust). Work was performed at University Hospital North Durham, North Road, Durham, DH1 5TW, UK.
Rights and permissions
About this article
Cite this article
Dyer, J.C., Leslie, P. & Drinnan, M.J. Objective Computer-Based Assessment of Valleculae Residue – Is It Useful?. Dysphagia 23, 7–15 (2008). https://doi.org/10.1007/s00455-007-9088-1
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00455-007-9088-1