Abstract
Fibreoptic Endoscopic Evaluation of Swallowing (FEES) and Videofluoroscopic Swallow Studies (VFSS) are instrumental assessments of dysphagia which provide videos of the internal structures of swallowing. They are commonly regarded as ‘gold-standard’ assessments; however, there is no consensus regarding a gold-standard measure to analyse the video recordings that they produce. Measures require sound psychometric properties to be suitable for clinical or research purposes. To date, no review of psychometric properties of FEES and VFSS measures has been undertaken or formally reported. This review assessed the quality of the psychometric properties of visuoperceptual measures of FEES and VFSS. Electronic databases were searched for studies reporting on psychometric qualities of visuoperceptual measures which are used to analyse recordings from FEES and VFSS. All dates until February 2017 were included. The Consensus-based Standards for the selection of health Measurement Instruments (COSMIN) checklist was used to evaluate the methodical quality of studies. The measures’ overall quality was then assessed by combining COSMIN ratings with quality criteria. Forty-five studies, reporting on 39 measures, met the inclusion criteria for this review. Data about the measures’ psychometric properties were very limited. Twenty-one measures had information available about reliability only, while 18 had information on up to five of the possible nine psychometric properties categorised within the COSMIN framework. The majority of the FEES and VFSS measures’ psychometric properties were rated as ‘indeterminate’ overall, due to the small number of studies, issues with design, statistical analyses, and reporting practices of extant studies. There is insufficient evidence to recommend any individual measure included in this review as valid and reliable to interpret VFSS and FEES recordings. Further research, which utilises robust methodological design and reporting, is needed to examine the psychometric properties of measures for FEES and VFSS.
Similar content being viewed by others
References
Dodrill P, Gosa MM. Pediatric dysphagia: physiology, assessment, and management. Ann Nutr Metab. 2015;66(Suppl. 5):24–31.
Kalf J, De Swart B, Bloem B, Munneke M. Prevalence of oropharyngeal dysphagia in Parkinson’s disease: a meta-analysis. Parkinsonism Relat Disord. 2012;18(4):311–5.
Mercadante S, Aielli F, Adile C, Ferrera P, Valle A, Fusco F, et al. Prevalence of oral mucositis, dry mouth, and dysphagia in advanced cancer patients. Support Care Cancer. 2015;23(11):3249–55.
Takizawa C, Gemmell E, Kenworthy J, Speyer R. A systematic review of the prevalence of oropharyngeal dysphagia in stroke, Parkinson’s disease, Alzheimer’s disease, head injury, and pneumonia. Dysphagia. 2016;31(3):434–41.
Kertscher B, Speyer R, Fong E, Georgiou AM, Smith M. Prevalence of oropharyngeal dysphagia in the Netherlands: a telephone survey. Dysphagia. 2015;30(2):114–20.
Bhattacharyya N. The prevalence of dysphagia among adults in the United States. Otolaryngol-Head Neck Surg. 2014;151(5):765–9.
Holland G, Jayasekeran V, Pendleton N, Horan M, Jones M, Hamdy S. Prevalence and symptom profiling of oropharyngeal dysphagia in a community dwelling of an elderly population: a self-reporting questionnaire survey. Dis Esophagus. 2011;24(7):476–80.
Park Y-H, Han H-R, Oh B-M, Lee J, Park J-a YuSJ, et al. Prevalence and associated factors of dysphagia in nursing home residents. Geriatr Nurs. 2013;34(3):212–7.
Cichero JA, Heaton S, Bassett L. Triaging dysphagia: nurse screening for dysphagia in an acute hospital. J Clin Nurs. 2009;18(11):1649–59.
Yi S-H, Kim S-J, Huh J, Jun T-G, Cheon HJ, Kwon J-Y. Dysphagia in infants after open heart procedures. Am J Phys Med Rehabil. 2013;92(6):496–503.
DiBardino DM, Wunderink RG. Aspiration pneumonia: a review of modern trends. J Crit Care. 2015;30(1):40–8.
Komiya K, Ishii H, Umeki K, Mizunoe S, Okada F, Johkoh T, et al. Impact of aspiration pneumonia in patients with community-acquired pneumonia and healthcare-associated pneumonia: a multicenter retrospective cohort study. Respirology. 2013;18(3):514–21.
Garcia-Peris P, Parón L, Velasco C, De la Cuerda C, Camblor M, Bretón I, et al. Long-term prevalence of oropharyngeal dysphagia in head and neck cancer patients: impact on quality of life. Clin Nutr. 2007;26(6):710–7.
Leow LP, Huckabee M-L, Anderson T, Beckert L. The impact of dysphagia on quality of life in ageing and Parkinson’s disease as measured by the swallowing quality of life (SWAL-QOL) questionnaire. Dysphagia. 2010;25(3):216–20.
Verdonschot RJ, Baijens LW, Serroyen JL, Leue C, Kremer B. Symptoms of anxiety and depression assessed with the hospital anxiety and depression scale in patients with oropharyngeal dysphagia. J Psychosom Res. 2013;75(5):451–5.
Luker JA, Wall K, Bernhardt J, Edwards I, Grimmer-Somers K. Measuring the quality of dysphagia management practices following stroke: a systematic review. Int J Stroke. 2010;5(6):466–76.
Carnaby-Mann G, Lenius K. The bedside examination in dysphagia. Phys Med Rehabil Clin N Am. 2008;19(4):747–68.
McCullough G, Rosenbek J, Wertz R, McCoy S, Mann G, McCullough K. Utility of clinical swallowing examination measures for detecting aspiration post-stroke. J Speech Lang Hear Res. 2005;48(6):1280–93.
Langmore SE. History of fiberoptic endoscopic evaluation of swallowing for evaluation and management of pharyngeal dysphagia: changes over the years. Dysphagia. 2017;32(1):27–38.
Huckabee M-L, Macrae P, Lamvik K. Expanding instrumental options for dysphagia diagnosis and research: ultrasound and manometry. Folia Phoniatr Logop. 2015;67(6):269–84.
Karnell MP, Rogus NM. Comparison of clinician judgments and measurements of swallow response time: a preliminary report. J Speech Lang Hear Res. 2005;48(6):1269–79.
Dziewas R, Glahn J, Helfer C, Ickenstein G, Keller J, Ledl C, et al. Flexible endoscopic evaluation of swallowing (FEES) for neurogenic dysphagia: training curriculum of the German Society of Neurology and the German stroke society. BMC Med Educ. 2016;16(1):70.
Frowen JJ, Cotton SM, Perry AR. The stability, reliability, and validity of videofluoroscopy measures for patients with head and neck cancer. Dysphagia. 2008;23(4):348–63.
Rommel N, Hamdy S. Oropharyngeal dysphagia: manifestations and diagnosis. Nat Rev Gastroenterol Hepatol. 2016;13(1):49.
Rosenbek JC, Robbins JA, Roecker EB, Coyle JL, Wood JL. A penetration-aspiration scale. Dysphagia. 1996;11(2):93–8.
McCullough GH, Wertz RT, Rosenbek JC, Mills RH, Webb WG, Ross KB. Inter-and intrajudge reliability for videofluoroscopic swallowing evaluation measures. Dysphagia. 2001;16(2):110–8.
Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: an international Delphi study. Qual Life Res. 2010;19(4):539–49.
Terwee CB. An overview of systematic reviews of measurement properties of outcome measurement instruments that intend to measure (aspects of) health status or (health- related) quality of life. Department of Epidemiology and Biostatistics VU University Medical Center Amsterdam, the Netherlands: The COSMIN group. 2014.
Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Ann Intern Med. 2009;151(4):264–9.
Pearson WG, Molfenter SM, Smith ZM, Steele CM. Image-based measurement of post-swallow residue: the normalized residue ratio scale. Dysphagia. 2013;28(2):167–77.
Newman RD, Nightingale J. Improving patient access to videofluoroscopy services: role of the practitioner-led clinic. Radiography. 2011;17(4):280–3.
Mokkink LB, Terwee CB, Knol DL, Stratford PW, Alonso J, Patrick DL, et al. The COSMIN checklist for evaluating the methodological quality of studies on measurement properties: a clarification of its content. BMC Med Res Methodol. 2010;10(1):22.
Higgins JP, Green S. Cochrane Handbook for systematic reviews for interventions. New York: Wiley; 2008.
Centre for Reviews Dissemination. Systematic reviews: CRD’s guidance for undertaking reviews in health care. Layerthorpe, York: CRD University of York; 2009.
Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. International consensus on taxonomy, terminology and definitions of measurement properties for health related patient reported outcomes: results of the COSMIN study. J Clin Epidemol. 2010;63:737–45.
Terwee CB, Bot S, de Boer M, van der Windt D, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60:34–42.
Cordier R, Speyer R, Chen YW, Wilkes-Gillan S, Brown T, Bourke-Taylor H. Evaluating the psychometric quality of social skills measures: a systematic review. PLoS ONE. 2015;10(7):e0132299.
Schellingerhout JM, Verhagen AP, Heymans MW, Koes BW, de Vet H, Terwee CB. Measurement properties of disease-specific questionnaires in patients with neck pain: a systematic review. Qual Life Res. 2012;21:659–70.
Cordier R, Chen Y, Speyer R, Totino R, Doma K, Leicht A, et al. Child-report measures of occupational performance: a systematic review. PLoS ONE. 2016;11(1):1–24.
Doma K, Speyer R, Leicht A, Cordier R. Comparison of psychometric properties between usual-week and past-week self- reported physical activity questionnaires: a systematic review. Int J Behav Nutr Act. 2016. https://doi.org/10.1186/s12966-017-0470-6.
Marvin S, Gustafson S, Thibeault S. Detecting aspiration and penetration using FEES with and without food dye. Dysphagia. 2016;31(4):498–504.
Pilz W, Vanbelle S, Kremer B, van Hooren MR, van Becelaere T, Roodenburg N, et al. Observers’ agreement on measurements in fiberoptic endoscopic evaluation of swallowing. Dysphagia. 2016;31(2):180–7.
Rodriguez KH, Roth CR, Rees CJ, Belafsky PC. Reliability of the pharyngeal squeeze maneuver. Ann Otol Rhinol Laryngol. 2007;116(6):399–401.
Susa C, Kagaya H, Saitoh E, Baba M, Kanamori D, Mikushi S, et al. Classification of sequential swallowing types using videoendoscopy with high reproducibility and reliability. Am J Phys Med Rehabil. 2015;94(1):38–43.
Tohara H, Nakane A, Murata S, Mikushi S, Ouchi Y, Wakasugi Y, et al. Inter-and intra-rater reliability in fibroptic endoscopic evaluation of swallowing. J Oral Rehabil. 2010;37(12):884–91.
Warnecke T, Suttrup I, Schröder JB, Osada N, Oelenberg S, Hamacher C, et al. Levodopa responsiveness of dysphagia in advanced Parkinson’s disease and reliability testing of the FEES-Levodopa-test. Parkinsonism Relat Disord. 2016;28:100–6.
Bryant KN, Finnegan E, Berbaum K. VFS interjudge reliability using a free and directed search. Dysphagia. 2012;27(1):53–63.
Gibson E, Phyland D, Marschner I. Rater reliability of the modified barium swallow. Aust J Hum Commun Disord. 1995;23(2):54–60.
Gosa MM, Suiter DM, Kahane JC. Reliability for identification of a select set of temporal and physiologic features of infant swallows. Dysphagia. 2015;30(3):365–72.
Hind JA, Gensler G, Brandt DK, Gardner PJM, Blumenthal L, Gramigna GD, et al. Comparison of trained clinician ratings with expert ratings of aspiration on videofluoroscopic images from a randomized clinical trial. Dysphagia. 2009;24(2):211.
Lee JW, Randall DR, Evangelista LM, Kuhn MA, Belafsky PC. Subjective assessment of videofluoroscopic swallow studies. Otolaryngol-Head Neck Surg. 2017;156(5):901–5.
Leonard R, Kendall K. Dysphagia assessment and treatment planning: a team approach. Boston: Cengage Learning; 1997.
Mann G, Hankey GJ, Cameron D. Swallowing disorders following acute stroke: prevalence and diagnostic accuracy. Cerebrovasc Dis. 2000;10(5):380–6.
McCullough GH, Wertz RT, Rosenbek JC, Dinneen C. Clinicians’ preferences and practices in conducting clinical/bedside and videofluoroscopic swallowing examinations in an adult, neurogenic population. Am J Speech-Lang Pathol. 1999;8(2):149–63.
Miles A. Inter-rater reliability for speech–language therapists’ judgement of oesophageal abnormality during oesophageal visualization. Int J Lang Commun Disord. 2016. https://doi.org/10.1111/1460-6984.12283.
Power ML, Hamdy S, Goulermas JY, Tyrrell PJ, Turnbull I, Thompson DG. Predicting aspiration after hemispheric stroke from timing measures of oropharyngeal bolus flow and laryngeal closure. Dysphagia. 2009;24(3):257–64.
Price GJ, Jones CJ, Charlton RA, Allen C. A combined approach to the assessment of neurological dysphagia. Clin Otolaryngol. 1987;12(3):197–201.
Rommel N, Borgers C, Van Beckevoort D, Goeleven A, Dejaeger E, Omari TI. Bolus residue scale: an easy-to-use and reliable videofluoroscopic analysis tool to score bolus residue in patients with dysphagia. Int J Otolaryngol. 2015. https://doi.org/10.1155/2015/780197.
Scott AG. The development of a scale to assess swallowing function in motor neuron disease using videofluoroscopic techniques. Melbourne: La Trobe University; 1999.
Stoeckli SJ, Huisman TA, Seifert BA, Martin-Harris BJ. Interrater reliability of videofluoroscopic swallow evaluation. Dysphagia. 2003;18(1):53–7.
Kelly A, Leslie P, Beale T, Payten C, Drinnan M. Fibreoptic endoscopic evaluation of swallowing and videofluoroscopy: does examination type influence perception of pharyngeal residue severity? Clin Otolaryngol. 2006;31(5):425–32.
Nordin NA, Miles A, Allen J. Measuring competency development in objective evaluation of videofluoroscopic swallowing studies. Dysphagia. 2017;32(3):427–36.
Scott A, Perry A, Bench J. A study of interrater reliability when using videofluoroscopy as an assessment of swallowing. Dysphagia. 1998;13(4):223–7.
Donzelli J, Wesling M, Brady S, Craney M. Predictive value of accumulated oropharyngeal secretions for aspiration during video nasal endoscopic evaluation of the swallow. Annals of Otol Rhinol Laryngol. 2003;112(5):469–75.
Dziewas R, Warnecke T, Ölenberg S, Teismann I, Zimmermann J, Krämer C, et al. Towards a basic endoscopic assessment of swallowing in acute stroke–development and evaluation of a simple dysphagia score. Cerebrovasc Dis. 2008;26(1):41–7.
Kaneoka AS, Langmore SE, Krisciunas GP, Field K, Scheel R, McNally E, et al. The Boston residue and clearance scale: preliminary reliability and validity testing. Folia Phoniatr Logop. 2013;65(6):312–7.
Murray J, Langmore SE, Ginsberg S, Dostie A. The significance of accumulated oropharyngeal secretions and swallowing frequency in predicting aspiration. Dysphagia. 1996;11(2):99–103.
Neubauer PD, Rademaker AW, Leder SB. The Yale Pharyngeal Residue Severity Rating Scale: an anatomically defined and image-based tool. Dysphagia. 2015;30(5):521–8.
Daniels SK, Schroeder MF, McClain M, Corey DM. Dysphagia in stroke: development of a standard method to examine swallowing recovery. J Rehabil Res Dev. 2006;43(3):347.
Han TR, Paik N-J, Park JW. Quantifying swallowing function after stroke: a functional dysphagia scale based on videofluoroscopic studies. Arch Phys Med Rehabil. 2001;82(5):677–82.
Han TR, Paik N-J, Park J-W, Kwon BS. The prediction of persistent dysphagia beyond six months after stroke. Dysphagia. 2008;23(1):59–64.
Hutcheson KA, Barrow MP, Barringer DA, Knott JK, Lin HY, Weber RS, et al. Dynamic Imaging Grade of Swallowing Toxicity (DIGEST): scale development and validation. Cancer. 2017;123(1):62–70.
Martin-Harris B, Brodsky MB, Michel Y, Castell DO, Schleicher M, Sandidge J, et al. MBS measurement tool for swallow impairment—MBSImp: establishing a standard. Dysphagia. 2008;23(4):392–405.
Omari TI, Dejaeger E, Van Beckevoort D, Goeleven A, De Cock P, Hoffman I, et al. A novel method for the nonradiological assessment of ineffective swallowing. Am J Gastroenterol. 2011;106(10):1796–802.
Curtis JA, Laus J, Yung KC, Courey MS. Static endoscopic evaluation of swallowing: transoral endoscopy during clinical swallow evaluations. The Laryngoscope. 2016;126(10):2291–4.
Park WY, Lee TH, Ham NS, Park JW, Lee YG, Cho SJ, et al. Adding endoscopist-directed flexible endoscopic evaluation of swallowing to the videofluoroscopic swallowing study increased the detection rates of penetration, aspiration, and pharyngeal residue. Gut Liver. 2015;9(5):623.
Farneti D. Pooling score: an endoscopic model for evaluating severity of dysphagia. Acta Otorhinolaryngol Ital. 2008;28(3):135.
Colodny N. Interjudge and intrajudge reliabilities in fiberoptic endoscopic evaluation of swallowing (Fees®) using the penetration–aspiration Scale: a replication study. Dysphagia. 2002;17(4):308–15.
Farneti D, Fattori B, Nacci A, Mancini V, Simonelli M, Ruoppolo G, et al. The Pooling-score (P-score): inter-and intra-rater reliability in endoscopic assessment of the severity of dysphagia. Acta Otorhinolaryngol Ital. 2014;34(2):105.
Kim DH, Choi KH, Kim HM, Koo JH, Kim BR, Kim TW, et al. Inter-rater reliability of videofluoroscopic dysphagia scale. Ann Rehab Med. 2012;36(6):791–6.
Kim J, Oh B-M, Kim JY, Lee GJ, Lee SA, Han TR. Validation of the videofluoroscopic dysphagia scale in various etiologies. Dysphagia. 2014;29(4):438–43.
Kelly AM, Drinnan MJ, Leslie P. Assessing penetration and aspiration: how do videofluoroscopy and fiberoptic endoscopic evaluation of swallowing compare? The Laryngoscope. 2007;117(10):1723–7.
Butler SG, Markley L, Sanders B, Stuart A. Reliability of the penetration aspiration scale with flexible endoscopic evaluation of swallowing. Ann Otol Rhinol Laryngol. 2015;124(6):480–3.
Butler SG, Stuart A, Case LD, Rees C, Vitolins M, Kritchevsky SB. Effects of liquid type, delivery method, and bolus volume on penetration-aspiration scores in healthy older adults during flexible endoscopic evaluation of swallowing. Ann Otol Rhinol Laryngol. 2011;120(5):288–95.
Pluschinski P, Zaretsky E, Stöver T, Murray J, Sader R, Hey C. Validation of the secretion severity rating scale. Eur Arch Otorhinolaryngol. 2016;273(10):3215–8.
Gullung JL, Hill EG, Castell DO, Martin-Harris B. Oropharyngeal and Esophageal Swallowing Impairments: their association and the predictive value of the modified barium swallow impairment profile and combined multichannel intraluminal impedance—esophageal manometry. Ann Otol Rhinol Laryngol. 2012;121(11):738–45.
Logemann JA. Manual for the videofluorographic study of swallowing. Austin: Pro ed; 1993.
Ickenstein GW, Höhlig C, Prosiegel M, Koch H, Dziewas R, Bodechtel U, et al. Prediction of outcome in neurogenic oropharyngeal dysphagia within 72 hours of acute stroke. J Stroke Cerebrovas Dis. 2012;21(7):569–76.
van der Maarel-Wierink CD, Vanobbergen JN, Bronkhorst EM, Schols JM, de Baat C. Meta-analysis of dysphagia and aspiration pneumonia in frail elders. J Dent Res. 2011;90(12):1398–404.
Streiner DL, Norman GR, Cairney J. Item response theory. Health measurement scales: a practical guide to their development and use. Oxford: Oxford University Press; 2014.
Fan X. Item response theory and classical test theory: an empirical comparison of their item/person statistics. Educ Psychol Measur. 1998;58(3):357.
Duong M. Introduction to item response theory and its applications. Michigan: Michigan State University; 2004.
Edelen MO, Reeve BB. Applying item response theory (IRT) modeling to questionnaire development, evaluation, and refinement. Qual Life Res. 2007;16:5–18.
Reise SP, Ainsworth AT, Haviland MG. Item response theory: fundamentals, applications, and promise in psychological research. Curr Dir Psychol Sci. 2005;14(2):95–101.
Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes. J Clin Epidemiol. 2010;63(7):737–45.
Leonard RJ, Kendall KA, McKenzie S, Gonçalves MI, Walker A. Structural displacements in normal swallowing: a videofluoroscopic study. Dysphagia. 2000;15(3):146–52.
Acknowledgements
The first author completed this study as part of the requirements for the completion of a PhD under supervision of Associate Profesor Reinie Cordier, Associate Profesor Ted Brown, and Profesor Renée Speyer. The authors wish to acknowledge Curtin University and the Australian Federal Government for the Curtin University Postgraduate Scholarship (CUPS) and the Australian Government Research Training Program Stipend Scholarship. The authors of the study would like to thank Ms Amy Hodges, who assisted with abstract screening and instrument ratings.
Author information
Authors and Affiliations
Contributions
The authors KS, RC, TB and RS have conceived, designed, and performed the experiment, contributed materials/analysis tools and to the writing of the paper. The authors KS and RS have analysed the data.
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Ethical Approval
This article does not contain any studies with human participants performed by any of the authors.
Additional information
PROSPERO Registration No: CRD42017060032.
Electronic supplementary material
Below is the link to the electronic supplementary material.
Rights and permissions
About this article
Cite this article
Swan, K., Cordier, R., Brown, T. et al. Psychometric Properties of Visuoperceptual Measures of Videofluoroscopic and Fibre-Endoscopic Evaluations of Swallowing: A Systematic Review. Dysphagia 34, 2–33 (2019). https://doi.org/10.1007/s00455-018-9918-3
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00455-018-9918-3