Skip to main content

Measuring Competency Development in Objective Evaluation of Videofluoroscopic Swallowing Studies

Dysphagia volume 32, pages 427–436 (2017)Cite this article

Abstract

Clinical interpretation of videofluoroscopic swallow study (VFSS) has often been criticized for its poor objectivity and inter-rater agreement. In order to address this, objective VFSS measures have been developed, reported and demonstrated to be valid and reliable. However, widespread clinical implementation is lacking. Reasons cited include lack of training and excessive time taken to perform measures. This study investigated competency development in selected standardized objective VFSS measures among speech-language pathologists (SLPs) naive to quantitative measurement. Six novice (no VFSS experience) and four experienced (2–10 years of VFSS experience) SLPs participated in 4 h of training in how to perform selected objective VFSS measures including pharyngeal constriction ratio, maximum pharyngoesophageal opening, pharyngoesophageal opening duration, airway closure duration and total pharyngeal transit time. Each week for eight weeks, participants were asked to independently measure and report three VFSS of patients affected by stroke. By week 8, all SLPs, irrespective of prior experience level, were able to achieve 80% accuracy in measures in comparison to the consensus of three expert clinicians. SLPs’ mean time for completion reduced from 50 min in week 1–25 min in week 8. Inter-rater agreement for measures improved across the eight-week period (range ICC = −31.05 to .60 in week 1 to ICC = .71 to .98 in week 8). There was high agreement in location of impairment and consequent management recommendations by week 8. In conclusion, SLPs can reliably learn and incorporate objective VFSS measures within a reasonable time frame. Level of experience has limited influence on the learning curve.

This is a preview of subscription content, access via your institution.

Access options

Buy single article

Instant access to the full article PDF.

43,34 €

Price includes VAT (Finland)
Tax calculation will be finalised during checkout.

Fig. 1
Fig. 2
Fig. 3
Fig. 4

References

  1. Martin-Harris B, Brodsky MB, Michel Y, Castell DO, Schleicher M, Sandidge J, et al. MBS measurement tool for swallow impairment—MBSImp: establishing a standard. Dysphagia. 2008;23(4):392–405. doi:10.1007/s00455-008-9185-9.

    Article  PubMed  PubMed Central  Google Scholar 

  2. Bingjie L, Tong Z, Xinting S, Jianmin X, Guijun J. Quantitative videofluoroscopic analysis of penetration-aspiration in post-stroke patients. Neurol India. 2010;58(1):42–7. doi:10.4103/0028-3886.60395.

    Article  PubMed  Google Scholar 

  3. Dyer JC, Leslie P, Drinnan MJ. Objective computer-based assessment of valleculae residue—is it useful? Dysphagia. 2008;23(1):7–15. doi:10.1007/s00455-007-9088-1.

    Article  PubMed  Google Scholar 

  4. Huang Y, Tseng F, Tsai S, Lin C, Chou Y, Lew HL. The use of the gaussian curve fitting method for scintigraphic measurements of the swallowing process in healthy subjects: implications for evaluation of dysphagia. Arch Phys Med Rehabil. 2006;87(11):1526–9. doi:10.1016/j.apmr.2006.08.324.

    Article  PubMed  Google Scholar 

  5. Wilcox F, Liss JM, Siegel GM. Interjudge agreement in videofluoroscopic studies of swallowing. J Speech Language Hear Res. 1996;39(1):144–52. doi:10.1044/jshr.3901.144.

    CAS  Article  Google Scholar 

  6. Kuhlemeier K, Yates P, Palmer J. Intra-and interrater variation in the evaluation of videofluorographic swallowing studies. Dysphagia. 1998;13(3):142–7. doi:10.1007/PL00009564.

    CAS  Article  PubMed  Google Scholar 

  7. McCullough GH, Wertz RT, Rosenbek JC, Mills RH, Webb WG, Ross KB. Inter- and intra-judge reliability for videofluoroscopic swallowing evaluation measures. Dysphagia. 2001;16(2):110–8. doi:10.1007/PL00021291.

    CAS  Article  PubMed  Google Scholar 

  8. Rosenbek JC, Robbins JA, Roecker EB, Coyle JL, Wood JL. A penetration-aspiration scale. Dysphagia. 1996;11(2):93–8. doi:10.1007/BF00417897.

    CAS  Article  PubMed  Google Scholar 

  9. Stoeckli SJ, Huisman TA, Seifert BA, Martin-Harris BJ. Interrater reliability of videofluoroscopic swallow evaluation. Dysphagia. 2003;18(1):53–7. doi:10.1007/s00455-002-0085-0.

    Article  PubMed  Google Scholar 

  10. Hind JA, Gensler G, Brandt DK, Gardner PJM, Blumenthal L, Gramigna GD, et al. Comparison of trained clinician ratings with expert ratings of aspiration on videofluoroscopic images from a randomized clinical trial. Dysphagia. 2009;24(2):211–7.

    Article  PubMed  Google Scholar 

  11. Leonard R, Kendall K. Dysphagia assessment and treatment planning: a team approach. 3rd ed. San Diego: Plural Publishing; 2014.

    Google Scholar 

  12. Miles A, Ting A, Leonard R, Allen J. Applying objectivity to VFS interpretation: objective measures of swallowing physiology. Dysphagia, 29. Platform presentation at Dysphagia Research Society Meeting and Post-Graduate Course, March 5–8, 2014, Nashville; 2014. p. 743.

  13. Leonard RJ, Kendall KA, McKenzie S, Gonçalves MI, Walker A. Structural displacements in normal swallowing: a videofluoroscopic study. Dysphagia. 2000;15(3):146–52. doi:10.1007/s004550010017.

    CAS  Article  PubMed  Google Scholar 

  14. Ryan RM, Mims V, Koestner R. Relation of reward contingency and interpersonal context to intrinsic motivation: a review and test using cognitive evaluation theory. J Pers Soc Psychol. 1983;45:736–50.

    Article  Google Scholar 

  15. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33(1):159–74. doi:10.2307/2529310.

    Google Scholar 

  16. Fleiss JL, Cohen J. The equivalence of weighted kappa and the intraclass correlation coefficient as measures of reliability. Educ Psychol Measur. 1973;33(3):613–9. doi:10.1177/001316447303300309.

    Article  Google Scholar 

  17. Tsuda S, Scott D, Doyle J, Jones DB. Surgical skills training and simulation. Curr Probl Surg. 2009;46(4):271–370.

    Article  PubMed  Google Scholar 

  18. Daley BJ. Novice to expert: an exploration of how professionals learn. Adult Educ Q. 1999;49(4):133–47. doi:10.1177/074171369904900401.

    Article  Google Scholar 

  19. Dreyfus SE, Dreyfus HL (1980) A five-stage model of the mental activities involved in directed skill acquisition (No. ORC-80-2). California Univ Berkeley Operations Research Center. http://www.dtic.mil/dtic/tr/fulltext/u2/a084551.pdf. Accessed 1 Jan 2016.

  20. Eraut M. Developing professional knowledge and competence. London, Washington D.C.: The Falmer Press; 1994.

    Google Scholar 

  21. Wainwright SF, Shepard KF, Harman LB, Stephens J. Novice and experienced physical therapist clinicians: a comparison of how reflection is used to inform the clinical decision-making process. Phys Ther. 2010;90(1):75–88. doi:10.2522/ptj.20090077.

    Article  PubMed  Google Scholar 

  22. Grantcharov TP, Bardram L, Funch-Jensen P, Rosenberg J. Learning curves and impact of previous operative experience on performance on a virtual reality simulator to test laparoscopic surgical skills. Am J Surg. 2003;185(2):146–9. doi:10.1016/S0002-9610(02)01213-8.

    Article  PubMed  Google Scholar 

  23. Unsworth CA. The clinical reasoning of novice and expert occupational therapists. Scand J Occup Ther. 2001;8(4):163–73. doi:10.1080/110381201317166522.

    Article  Google Scholar 

  24. Palmer A, Graville D. Improving the reliability of interpretation of the modified barium swallow study. Paper presented at the Sixteenth Annual Dysphagia Research Society Meeting, Isle of Palms; 2008.

  25. Scott A, Perry A, Bench J. A study of interrater reliability when using videofluoroscopy as an assessment of swallowing. Dysphagia. 1998;13(4):223–7. doi:10.1007/PL00009576.

    CAS  Article  PubMed  Google Scholar 

  26. Burns CL, Keir B, Ward EC, Hill AJ, Farrell A, Phillips N, et al. A dynamic image quality evaluation of videofluoroscopy images: considerations for telepractice applications. Dysphagia. 2015;30(4):473–81. doi:10.1007/s00455-015-9626-1.

    Article  PubMed  Google Scholar 

  27. Logemann JA, Lazarus CL, Keeley SP, Sanchez A, Rademaker AW. Effectiveness of four hours of education in interpretation of radiographic studies. Dysphagia. 2000;15(4):180–3. doi:10.1007/s004550000025.

    CAS  Article  PubMed  Google Scholar 

  28. Deci EL, Vallerand RJ, Pelletier LG, Ryan RM. Motivation and education: the self-determination perspective. Educ Psychol. 1991;26(3–4):325–46. doi:10.1080/00461520.1991.9653137.

    Article  Google Scholar 

  29. Struthers CW, Perry RP, Menec VH. An examination of the relationship among academic stress, coping, motivation, and performance in college. Res High Educ. 2000;41(5):581–92. doi:10.1023/A:1007094931292.

    Article  Google Scholar 

  30. Peladeau-Pigeon M, Steele CM. Technical aspects of a videofluoroscopic swallowing study. Can J Speech Lang Pathol Audiol. 2013;37:216–26.

    Google Scholar 

  31. Eng J. Sample size estimation: how many individuals should be studied? 1. Radiology. 2003;227(2):309–13. doi:10.1148/radiol.2272012051.

    Article  PubMed  Google Scholar 

  32. Ionan AC, Polley MC, McShane LM, Dobbin KK. Comparison of confidence interval methods for an intra-class correlation coefficient (ICC). BMC Med Res Methodol. 2014;14(1):121. doi:10.1186/1471-2288-14-121.

    Article  PubMed  PubMed Central  Google Scholar 

  33. Zou G. Sample size formulas for estimating intraclass correlation coefficients with precision and assurance. Stat Med. 2012;31(29):3972–81. doi:10.1002/sim.5466.

    CAS  Article  PubMed  Google Scholar 

  34. Yip H, Leonard R, Belafsky PC. Can a fluoroscopic estimation of pharyngeal constriction predict aspiration? Otolaryngol Head Neck Surg. 2006;135(2):215–7.

    Article  Google Scholar 

Download references

Acknowledgements

Thank you to all the speech-language pathologists who participated in the research. The authors would like to acknowledge Dr. Rebecca Leonard and thank her for providing guidance and the videos for this study.

Author information

Affiliations

  1. Speech Science, School of Psychology, The University of Auckland, Auckland, New Zealand

    Natrah Ahmad Nordin, Anna Miles & Jacqui Allen

  2. Otorhinolaryngology, Waitemata District Health Board, Auckland, New Zealand

    Jacqui Allen

Authors
  1. Natrah Ahmad Nordin
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Anna Miles
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jacqui Allen
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Anna Miles.

Ethics declarations

Conflicts of interest

The authors have nothing to declare. This work has not been published elsewhere. All authors have contributed to the study and are accountable for accuracy and integrity. The authors agree to the copyright conditions of this journal.

Appendices

Appendix 1

See Table 5.

Table 5 VFSS objective measures
Full size table

Appendix 2

See Table 6.

Table 6 Standardized interpretation sheet
Full size table

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Nordin, N.A., Miles, A. & Allen, J. Measuring Competency Development in Objective Evaluation of Videofluoroscopic Swallowing Studies. Dysphagia 32, 427–436 (2017). https://doi.org/10.1007/s00455-016-9776-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00455-016-9776-9

Keywords

  • Dysphagia
  • Deglutition
  • Deglutition disorders
  • Videofluoroscopic study of swallowing
  • VFSS
  • Modified barium swallow
  • MBS
  • Competency
  • Inter-rater reliability