Skip to main content
SpringerLink
Log in

Quantifying tics: Best practices and design considerations for video-based tic coding in research

  • Original Manuscript
  • Published:
Behavior Research Methods Aims and scope Submit manuscript

Abstract

Tic disorders (TD), including Tourette Syndrome, are characterized by involuntary, repetitive movements and/or vocalizations that can lead to persistent disability and impairment across the lifespan. Existing research demonstrates that video-based behavioral coding (VBBC) methods can be used to reliably quantify tics, enabling a more objective approach to tic measurement above and beyond standardly used TD questionnaires. VBBC is becoming more popular given the ease and ubiquity of obtaining patient videos. However, rigor and reproducibility of this work has been limited by undescribed and unstandardized approaches to using VBBC methods in TD research. The current paper describes “best practices” for VBBC in TD research, which have been tested and refined in our research over the past 15+ years, including considerations for data acquisition, coding implementation, interrater reliability demonstration, and methods reporting. We also address ethical considerations for researchers using this method.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

Data availability

Data--Not applicable.

References

  • American Psychiatric Association. (2013). Diagnostic and Statistical Manual of Mental Disorders (DSM-5®). American Psychiatric Pub.

  • Bakeman, R., & Quera, V. (2011). Sequential Analysis and Observational Methods for the Behavioral Sciences. Cambridge University Press.

    Book  Google Scholar 

  • Barnea, M., Benaroya-Milshtein, N., Gilboa-Sechtman, E., Woods, D. W., Piacentini, J., Fennig, S., Apter, A., & Steinberg, T. (2016). Subjective versus objective measures of tic severity in Tourette syndrome – The influence of environment. In Psychiatry Research (Vol. 242, pp. 204–209). https://doi.org/10.1016/j.psychres.2016.05.047

  • Beeler, P., Jensen, N. O., Kim, S., Robichaux-Viehoever, A., Schlaggar, B. L., Greene, D. J., Black, K. J., & Chakrabarty, R. K. (2022). Fractality of tics as a quantitative assessment tool for Tourette syndrome. Journal of the Royal Society, Interface / the Royal Society, 19(187), 20210742.

    Article  Google Scholar 

  • Black, K. J., Black, E. R., Greene, D. J., & Schlaggar, B. L. (2016). Provisional Tic Disorder: What to tell parents when their child first starts ticcing. F1000Research, 5, 696.

  • Black, K. J., Kim, S., Yang, N. Y., & Greene, D. J. (2021). Course of tic disorders over the lifespan. Current Developmental Disorders Reports, 8(2), 121–132.

    Article  PubMed  PubMed Central  Google Scholar 

  • Brabson, L. A., Brown, J. L., Capriotti, M. R., Ramanujam, K., Himle, M. B., Nicotra, C. M., Ostrander, R., Kelly, L. M., Grados, M. A., Walkup, J. T., Perry-Parrish, C., Reynolds, E. K., Hankinson, J. C., & Specht, M. W. (2016). Patterned changes in urge ratings with tic suppression in youth with chronic tic disorders. Journal of Behavior Therapy and Experimental Psychiatry, 50, 162–170.

    Article  PubMed  Google Scholar 

  • Brandt, V. C., Beck, C., Sajin, V., Baaske, M. K., Bäumer, T., Beste, C., Anders, S., & Münchau, A. (2016). Temporal relationship between premonitory urges and tics in Gilles de la Tourette syndrome. Cortex, 77, 24–37.

    Article  PubMed  Google Scholar 

  • Broyles, L. M., Tate, J. A., & Happ, M. B. (2008). Videorecording in clinical research: Mapping the ethical terrain. Nursing Research, 57(1), 59–63.

    Article  PubMed  Google Scholar 

  • Brügge, N. S., Sallandt, G. M., Schappert, R., Li, F., Siekmann, A., Grzegorzek, M., Bäumer, T., Frings, C., Beste, C., Stenger, R., Roessner, V., Fudickar, S., Handels, H., & Münchau, A. (2023). Automated motor tic detection: A machine learning approach. Movement Disorders: Official Journal of the Movement Disorder Society, 38(7), 1327–1335.

    Article  PubMed  Google Scholar 

  • MnTiC Lab. (2020). TST task video [video file]. YouTube. https://youtu.be/7-d_62nqKrk

  • Capriotti, M. R., Brandt, B. C., Turkel, J. E., Lee, H.-J., & Woods, D. W. (2014). Negative reinforcement and premonitory urges in youth with Tourette syndrome: An experimental evaluation. Behavior Modification, 38(2), 276–296.

    Article  PubMed  Google Scholar 

  • Capriotti, M. R., Turkel, J. E., Johnson, R. A., Espil, F. M., & Woods, D. W. (2017). Comparing fixed-amount and progressive-amount DRO Schedules for tic suppression in youth with chronic tic disorders. Journal of Applied Behavior Analysis, 50(1), 106–120.

    Article  PubMed  Google Scholar 

  • Chorney, J. M., McMurtry, C. M., Chambers, C. T., & Bakeman, R. (2015). Developing and modifying behavioral coding schemes in pediatric psychology: A practical guide. Journal of Pediatric Psychology, 40(1), 154–164.

    Article  PubMed  Google Scholar 

  • Conelea, C. A., Ramanujam, K., Walther, M. R., Freeman, J. B., & Garcia, A. M. (2014). Is there a relationship between tic frequency and physiological arousal? Examination in a sample of children with co-occurring tic and anxiety disorders. Behavior Modification, 38(2), 217–234.

    Article  PubMed  PubMed Central  Google Scholar 

  • Conelea, C. A., Wellen, B., Woods, D. W., Greene, D. J., Black, K. J., Specht, M., Himle, M. B., Lee, H.-J., & Capriotti, M. (2018). Patterns and predictors of tic suppressibility in youth with tic disorders. Frontiers in Psychiatry / Frontiers Research Foundation, 9, 188.

    Article  Google Scholar 

  • Conelea, C. A., & Woods, D. W. (2008). Examining the impact of distraction on tic suppression in children and adolescents with Tourette syndrome. Behaviour Research and Therapy, 46(11), 1193–1200.

    Article  PubMed  Google Scholar 

  • Conelea & Woods (2008) https://sciences.ucf.edu/psychology/childrenslearningclinic/wp-content/uploads/sites/24/2013/08/Conelea-Tourette-context-factors.pdf

  • Conelea, C. A., Woods, D. W., & Brandt, B. C. (2011). The impact of a stress induction task on tic frequencies in youth with Tourette syndrome. Behaviour Research and Therapy, 49(8), 492–497.

    Article  PubMed  Google Scholar 

  • Conway, M. (2014). Ethical issues in using twitter for public health surveillance and research: Developing a taxonomy of ethical concepts from the research literature. J Med Internet Res, 16, e290

    Article  PubMed  PubMed Central  Google Scholar 

  • Datavyu Team, T. (2014). Datavyu: A video coding tool. New York University New York.

  • Ekman, P., & Friesen, W. V. (2019). Facial Action Coding System. In PsycTESTS Dataset. https://doi.org/10.1037/t27734-000

    Article  Google Scholar 

  • Ethical issues in using social media for health and health care research (https://doi.org/10.1016/j.healthpol.2013.02.006)

  • Ganos, C. (2021). Tics and tic-like phenomena-old questions on a grand new scale invited editorial on TikTok and tics. Movement Disorders Clinical Practice, 8(8), 1198–1199.

    Article  PubMed  PubMed Central  Google Scholar 

  • Garris, J., & Quigg, M. (2021). The female Tourette patient: Sex differences in Tourette disorder. Neuroscience and Biobehavioral Reviews, 129, 261–268.

    Article  PubMed  Google Scholar 

  • Geiger, R. S., Cope, D., Ip, J., Lotosh, M., Shah, A., Weng, J., & Tang, R. (2021). “Garbage in, garbage out” revisited: What do machine learning application papers report about human-labeled training data? Quantitative Science Studies, 2(3), 795–827.

    Article  Google Scholar 

  • Girard, J. M., & Cohn, J. F. (2016). A Primer on Observational Measurement. Assessment, 23(4), 404–413.

    PubMed  Google Scholar 

  • Goetz, C. G., Pappert, E. J., Louis, E. D., Raman, R., & Leurgans, S. (1999). Advantages of a modified scoring method for the Rush Video-Based Tic Rating Scale. Movement Disorders: Official Journal of the Movement Disorder Society, 14(3), 502–506.

    Article  CAS  PubMed  Google Scholar 

  • Goetz, C. G., Tanner, C. M., Wilson, R. S., & Shannon, K. M. (1987). A rating scale for Gilles de la Tourette’s syndrome: Description, reliability, and validity data. Neurology, 37(9), 1542–1544.

    Article  CAS  PubMed  Google Scholar 

  • Greene, D. J., Koller, J. M., Robichaux-Viehoever, A., Bihun, E. C., Schlaggar, B. L., & Black, K. J. (2015). Reward enhances tic suppression in children within months of tic disorder onset. Developmental cognitive neuroscience, 11, 65–74.

    Article  PubMed  Google Scholar 

  • Haidet, K. K., Tate, J., Divirgilio-Thomas, D., Kolanowski, A., & Happ, M. B. (2009). Methods to improve reliability of video-recorded behavioral data. Research in Nursing & Health, 32(4), 465–474.

    Article  Google Scholar 

  • Hallgren, K. A. (2012). Computing inter-rater reliability for observational data: An overview and tutorial. Tutorials in Quantitative Methods for Psychology, 8(1), 23–34.

    Article  PubMed  PubMed Central  Google Scholar 

  • Heyman, R. E., Lorber, M. F., Eddy, J. M., & West, T. V. (2014). Behavioral observation and coding. Handbook of Research Methods in Social and Personality Psychology., 2nd Ed., 2, 345–372.

  • Himle, M. B., Chang, S., Woods, D. W., Pearlman, A., Buzzella, B., Bunaciu, L., & Piacentini, J. C. (2006). Establishing the feasibility of direct observation in the assessment of tics in children with chronic tic disorders. Journal of Applied Behavior Analysis, 39(4), 429–440.

    Article  PubMed  PubMed Central  Google Scholar 

  • Himle, M.B. , Woods, D.W. ,  Bunaciu, L. Evaluating the role of contingency in differentially reinforced tic suppression J. Appl. Behav. Anal., 41 (2008), pp. 285-289

  • Himle, M. B., Woods, D. W., Conelea, C. A., Bauer, C. C., & Rice, K. A. (2007). Investigating the effects of tic suppression on premonitory urge ratings in children and adolescents with Tourette’s syndrome. Behaviour research and therapy, 45(12), 2964–2976.

    Article  PubMed  Google Scholar 

  • Hoyt, W. T. (2000). Rater bias in psychological research: When is it a problem and what can we do about it? Psychological Methods, 5(1), 64–86.

    Article  CAS  PubMed  Google Scholar 

  • Kazdin, A. E. (2021). Research Design in Clinical Psychology. Cambridge University Press.

    Book  Google Scholar 

  • Lyon, G. J., Samar, S. M., Conelea, C., Trujillo, M. R., Lipinski, C. M., Bauer, C. C., Brandt, B. C., Kemp, J. J., Lawrence, Z. E., Howard, J., Castellanos, F. X., Woods, D., & Coffey, B. J. (2010). Testing tic suppression: comparing the effects of dexmethylphenidate to no medication in children and adolescents with attention-deficit/hyperactivity disorder and Tourette’s disorder. Journal of Child and Adolescent Psychopharmacology, 20(4), 283–289.

    Article  PubMed  PubMed Central  Google Scholar 

  • Martin, R. F. K., Leppink-Shands, P., Tlachac, M., DuBois, M., Conelea, C., Jacob, S., Morellas, V., Morris, T., & Papanikolopoulos, N. (2021). The use of immersive environments for the early detection and treatment of neuropsychiatric disorders. Frontiers in Digital Health, 2, 40.

    Article  Google Scholar 

  • Members of the MDS Committee on Rating Scales Development. (2017). Systematic review of severity scales and screening instruments for tics: Critique and recommendations. Movement Disorders: Official Journal of the Movement Disorder Society, 32(3), 467–473.

    Article  PubMed  Google Scholar 

  • Mikal, J., Hurst, S., & Conway, M. (2016). Ethical issues in using Twitter for population-level depression monitoring: A qualitative study. BMC Medical Ethics, 17, Article 22. https://doi.org/10.1186/s12910-016-0105-5

  • Mining social media data: How are research sponsors and researchers addressing the ethical challenges? https://doi.org/10.1177/1747016117738559

  • Müller-Vahl, K. R., Riemann, L., & Bokemeyer, S. (2014). Tourette patients’ misbelief of a tic rebound is due to overall difficulties in reliable tic rating. Journal of Psychosomatic Research, 76(6), 472–476.

    Article  PubMed  Google Scholar 

  • Nagai, Y., Cavanna, A., & Critchley, H. D. (2009). Influence of sympathetic autonomic arousal on tics: Implications for a therapeutic behavioral intervention for Tourette syndrome. Journal of Psychosomatic Research, 67(6), 599–605.

    Article  PubMed  Google Scholar 

  • Neuhaus, F., & Webmoor, T. (2012). Agile ethics for massified research and visualization. Information, Communication & Society, 15(1), 43–65. https://doi.org/10.1080/1369118X.2011.616519

    Article  Google Scholar 

  • Nixon, E., Glazebrook, C., Hollis, C., & Jackson, G. M. (2014). Reduced tic symptomatology in Tourette syndrome after an acute bout of exercise: An observational study. Behavior Modification, 38(2), 235–263.

    Article  PubMed  Google Scholar 

  • Olvera, C., Stebbins, G. T., Goetz, C. G., & Kompoliti, K. (2021). TikTok tics: A pandemic within a pandemic. Movement Disorders Clinical Practice, mdc3.13316. https://doi.org/10.1002/mdc3.13316

  • Pesch, M. H., & Lumeng, J. C. (2017). Methodological considerations for observational coding of eating and feeding behaviors in children and their families. The International Journal of Behavioral Nutrition and Physical Activity, 14(1), 170.

    Article  PubMed  PubMed Central  Google Scholar 

  • Piacentini, J., Himle, M. B., Chang, S., Baruch, D. E., Buzzella, B. A., Pearlman, A., & Woods, D. W. (2006). Reactivity of tic observation procedures to situation and setting. Journal of Abnormal Child Psychology, 34(5), 649–658.

    Article  PubMed  Google Scholar 

  • Slife, B. D., Wright, C. D., & Yanchar, S. C. (2016). Using operational definitions in research: A best-practices approach. The Journal of Mind and Behavior, 37(2), 119–139.

    Google Scholar 

  • Specht, M. W., Woods, D. W., Nicotra, C. M., Kelly, L. M., Ricketts, E. J., Conelea, C. A., Grados, M. A., Ostrander, R. S., & Walkup, J. T. (2013). Effects of tic suppression: ability to suppress, rebound, negative reinforcement, and habituation to the premonitory urge. Behaviour Research and Therapy, 51(1), 24–30.

    Article  PubMed  Google Scholar 

  • Ueda, K., & Black, K. J. (2021). A comprehensive review of tic disorders in children. Journal of Clinical Medicine Research, 10(11). https://doi.org/10.3390/jcm10112479

  • van der Stouwe, A. M. M., Tuitert, I., Giotis, I., Calon, J., Gannamani, R., Dalenberg, J. R., van der Veen, S., Klamer, M. R., Telea, A. C., & Tijssen, M. A. J. (2021). Next move in movement disorders (NEMO): Developing a computer-aided classification tool for hyperkinetic movement disorders. BMJ Open, 11(10), e055068.

    Article  PubMed  PubMed Central  Google Scholar 

  • Woods, D. W., Walther, M. R., Bauer, C. C., Kemp, J. J., & Conelea, C. A. (2009). The development of stimulus control over tics: a potential explanation for contextually-based variability in the symptoms of Tourette syndrome. Behaviour Research and Therapy, 47(1), 41–47.

    Article  PubMed  Google Scholar 

  • Woods, D.W. , Himle, M.B. Creating tic suppression: Comparing the effects of verbal instruction to differential reinforcement. J. Appl. Behav. Anal., 37 (2004), pp. 417-420

  • Yoder, P. J., Lloyd, B., & Symons, F. J. (2018). Observational Measurement of Behavior. Brookes Publishing.

  • Zea Vera, A., Bruce, A., Garris, J., Tochen, L., Bhatia, P., Lehman, R. K., Lopez, W., Wu, S. W., & Gilbert, D. L. (2022). The phenomenology of tics and tic-like behavior in TikTok. Pediatric Neurology, 130, 14–20.

    Article  PubMed  Google Scholar 

Download references

Funding

Support for this project included funding from the National Institutes of Health (R61 MH123754, R01NS131314, T32DA037183) and Minnesota Robotics Institute.

Author information

Authors and Affiliations

  1. Department of Psychiatry and Behavioral Sciences, University of Minnesota, Minneapolis, MN, USA

    Megan DuBois, Kerry Houlihan, Brittany Raab, Alison Pryor, Mia Kellman, Mayella Brinker, Brianna Wellen & Christine Conelea

  2. Masonic Institute for the Developing Brain, University of Minnesota, Minneapolis, MN, USA

    Megan DuBois, Kerry Houlihan, Brittany Raab, Alison Pryor, Mia Kellman, Mayella Brinker, Brianna Wellen & Christine Conelea

  3. Psychology Department, San Jose State University, San Jose, CA, 95192, USA

    Matthew Capriotti

Authors
  1. Megan DuBois
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Kerry Houlihan
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Brittany Raab
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Alison Pryor
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Mia Kellman
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Mayella Brinker
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Brianna Wellen
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Matthew Capriotti
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Christine Conelea
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Christine Conelea.

Ethics declarations

Conflicts of interest

The authors have no competing interests to declare.

Ethics approval

Not applicable. A partially obscured image in the supplemental material came from a publicly posted video for a project determined to be exempt by the University of Minnesota Institutional Review Board.

Consent to participate

Not applicable

Open practices statement

This paper did not present any specific data or experiments. Examples of materials that can be used as part of tic coding are included in the Supplement.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

Below is the link to the electronic supplementary material.

Supplementary file1 (DOCX 469 KB)

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

DuBois, M., Houlihan, K., Raab, B. et al. Quantifying tics: Best practices and design considerations for video-based tic coding in research. Behav Res (2024). https://doi.org/10.3758/s13428-024-02383-7

Download citation

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.3758/s13428-024-02383-7

Keywords

Search

Navigation