Abstract
Clinical interpretation of videofluoroscopic swallow study (VFSS) has often been criticized for its poor objectivity and inter-rater agreement. In order to address this, objective VFSS measures have been developed, reported and demonstrated to be valid and reliable. However, widespread clinical implementation is lacking. Reasons cited include lack of training and excessive time taken to perform measures. This study investigated competency development in selected standardized objective VFSS measures among speech-language pathologists (SLPs) naive to quantitative measurement. Six novice (no VFSS experience) and four experienced (2–10 years of VFSS experience) SLPs participated in 4 h of training in how to perform selected objective VFSS measures including pharyngeal constriction ratio, maximum pharyngoesophageal opening, pharyngoesophageal opening duration, airway closure duration and total pharyngeal transit time. Each week for eight weeks, participants were asked to independently measure and report three VFSS of patients affected by stroke. By week 8, all SLPs, irrespective of prior experience level, were able to achieve 80% accuracy in measures in comparison to the consensus of three expert clinicians. SLPs’ mean time for completion reduced from 50 min in week 1–25 min in week 8. Inter-rater agreement for measures improved across the eight-week period (range ICC = −31.05 to .60 in week 1 to ICC = .71 to .98 in week 8). There was high agreement in location of impairment and consequent management recommendations by week 8. In conclusion, SLPs can reliably learn and incorporate objective VFSS measures within a reasonable time frame. Level of experience has limited influence on the learning curve.
Similar content being viewed by others
References
Martin-Harris B, Brodsky MB, Michel Y, Castell DO, Schleicher M, Sandidge J, et al. MBS measurement tool for swallow impairment—MBSImp: establishing a standard. Dysphagia. 2008;23(4):392–405. doi:10.1007/s00455-008-9185-9.
Bingjie L, Tong Z, Xinting S, Jianmin X, Guijun J. Quantitative videofluoroscopic analysis of penetration-aspiration in post-stroke patients. Neurol India. 2010;58(1):42–7. doi:10.4103/0028-3886.60395.
Dyer JC, Leslie P, Drinnan MJ. Objective computer-based assessment of valleculae residue—is it useful? Dysphagia. 2008;23(1):7–15. doi:10.1007/s00455-007-9088-1.
Huang Y, Tseng F, Tsai S, Lin C, Chou Y, Lew HL. The use of the gaussian curve fitting method for scintigraphic measurements of the swallowing process in healthy subjects: implications for evaluation of dysphagia. Arch Phys Med Rehabil. 2006;87(11):1526–9. doi:10.1016/j.apmr.2006.08.324.
Wilcox F, Liss JM, Siegel GM. Interjudge agreement in videofluoroscopic studies of swallowing. J Speech Language Hear Res. 1996;39(1):144–52. doi:10.1044/jshr.3901.144.
Kuhlemeier K, Yates P, Palmer J. Intra-and interrater variation in the evaluation of videofluorographic swallowing studies. Dysphagia. 1998;13(3):142–7. doi:10.1007/PL00009564.
McCullough GH, Wertz RT, Rosenbek JC, Mills RH, Webb WG, Ross KB. Inter- and intra-judge reliability for videofluoroscopic swallowing evaluation measures. Dysphagia. 2001;16(2):110–8. doi:10.1007/PL00021291.
Rosenbek JC, Robbins JA, Roecker EB, Coyle JL, Wood JL. A penetration-aspiration scale. Dysphagia. 1996;11(2):93–8. doi:10.1007/BF00417897.
Stoeckli SJ, Huisman TA, Seifert BA, Martin-Harris BJ. Interrater reliability of videofluoroscopic swallow evaluation. Dysphagia. 2003;18(1):53–7. doi:10.1007/s00455-002-0085-0.
Hind JA, Gensler G, Brandt DK, Gardner PJM, Blumenthal L, Gramigna GD, et al. Comparison of trained clinician ratings with expert ratings of aspiration on videofluoroscopic images from a randomized clinical trial. Dysphagia. 2009;24(2):211–7.
Leonard R, Kendall K. Dysphagia assessment and treatment planning: a team approach. 3rd ed. San Diego: Plural Publishing; 2014.
Miles A, Ting A, Leonard R, Allen J. Applying objectivity to VFS interpretation: objective measures of swallowing physiology. Dysphagia, 29. Platform presentation at Dysphagia Research Society Meeting and Post-Graduate Course, March 5–8, 2014, Nashville; 2014. p. 743.
Leonard RJ, Kendall KA, McKenzie S, Gonçalves MI, Walker A. Structural displacements in normal swallowing: a videofluoroscopic study. Dysphagia. 2000;15(3):146–52. doi:10.1007/s004550010017.
Ryan RM, Mims V, Koestner R. Relation of reward contingency and interpersonal context to intrinsic motivation: a review and test using cognitive evaluation theory. J Pers Soc Psychol. 1983;45:736–50.
Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33(1):159–74. doi:10.2307/2529310.
Fleiss JL, Cohen J. The equivalence of weighted kappa and the intraclass correlation coefficient as measures of reliability. Educ Psychol Measur. 1973;33(3):613–9. doi:10.1177/001316447303300309.
Tsuda S, Scott D, Doyle J, Jones DB. Surgical skills training and simulation. Curr Probl Surg. 2009;46(4):271–370.
Daley BJ. Novice to expert: an exploration of how professionals learn. Adult Educ Q. 1999;49(4):133–47. doi:10.1177/074171369904900401.
Dreyfus SE, Dreyfus HL (1980) A five-stage model of the mental activities involved in directed skill acquisition (No. ORC-80-2). California Univ Berkeley Operations Research Center. http://www.dtic.mil/dtic/tr/fulltext/u2/a084551.pdf. Accessed 1 Jan 2016.
Eraut M. Developing professional knowledge and competence. London, Washington D.C.: The Falmer Press; 1994.
Wainwright SF, Shepard KF, Harman LB, Stephens J. Novice and experienced physical therapist clinicians: a comparison of how reflection is used to inform the clinical decision-making process. Phys Ther. 2010;90(1):75–88. doi:10.2522/ptj.20090077.
Grantcharov TP, Bardram L, Funch-Jensen P, Rosenberg J. Learning curves and impact of previous operative experience on performance on a virtual reality simulator to test laparoscopic surgical skills. Am J Surg. 2003;185(2):146–9. doi:10.1016/S0002-9610(02)01213-8.
Unsworth CA. The clinical reasoning of novice and expert occupational therapists. Scand J Occup Ther. 2001;8(4):163–73. doi:10.1080/110381201317166522.
Palmer A, Graville D. Improving the reliability of interpretation of the modified barium swallow study. Paper presented at the Sixteenth Annual Dysphagia Research Society Meeting, Isle of Palms; 2008.
Scott A, Perry A, Bench J. A study of interrater reliability when using videofluoroscopy as an assessment of swallowing. Dysphagia. 1998;13(4):223–7. doi:10.1007/PL00009576.
Burns CL, Keir B, Ward EC, Hill AJ, Farrell A, Phillips N, et al. A dynamic image quality evaluation of videofluoroscopy images: considerations for telepractice applications. Dysphagia. 2015;30(4):473–81. doi:10.1007/s00455-015-9626-1.
Logemann JA, Lazarus CL, Keeley SP, Sanchez A, Rademaker AW. Effectiveness of four hours of education in interpretation of radiographic studies. Dysphagia. 2000;15(4):180–3. doi:10.1007/s004550000025.
Deci EL, Vallerand RJ, Pelletier LG, Ryan RM. Motivation and education: the self-determination perspective. Educ Psychol. 1991;26(3–4):325–46. doi:10.1080/00461520.1991.9653137.
Struthers CW, Perry RP, Menec VH. An examination of the relationship among academic stress, coping, motivation, and performance in college. Res High Educ. 2000;41(5):581–92. doi:10.1023/A:1007094931292.
Peladeau-Pigeon M, Steele CM. Technical aspects of a videofluoroscopic swallowing study. Can J Speech Lang Pathol Audiol. 2013;37:216–26.
Eng J. Sample size estimation: how many individuals should be studied? 1. Radiology. 2003;227(2):309–13. doi:10.1148/radiol.2272012051.
Ionan AC, Polley MC, McShane LM, Dobbin KK. Comparison of confidence interval methods for an intra-class correlation coefficient (ICC). BMC Med Res Methodol. 2014;14(1):121. doi:10.1186/1471-2288-14-121.
Zou G. Sample size formulas for estimating intraclass correlation coefficients with precision and assurance. Stat Med. 2012;31(29):3972–81. doi:10.1002/sim.5466.
Yip H, Leonard R, Belafsky PC. Can a fluoroscopic estimation of pharyngeal constriction predict aspiration? Otolaryngol Head Neck Surg. 2006;135(2):215–7.
Acknowledgements
Thank you to all the speech-language pathologists who participated in the research. The authors would like to acknowledge Dr. Rebecca Leonard and thank her for providing guidance and the videos for this study.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflicts of interest
The authors have nothing to declare. This work has not been published elsewhere. All authors have contributed to the study and are accountable for accuracy and integrity. The authors agree to the copyright conditions of this journal.
Rights and permissions
About this article
Cite this article
Nordin, N.A., Miles, A. & Allen, J. Measuring Competency Development in Objective Evaluation of Videofluoroscopic Swallowing Studies. Dysphagia 32, 427–436 (2017). https://doi.org/10.1007/s00455-016-9776-9
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00455-016-9776-9