Skip to main content

Advertisement

Log in

Identifying Effective Motivational Interviewing Communication Sequences Using Automated Pattern Analysis

  • Research Article
  • Published:
Journal of Healthcare Informatics Research Aims and scope Submit manuscript

Abstract

Motivational interviewing (MI) is an evidence-based strategy for communicating with patients about behavior change. Although there is strong empirical evidence linking “MI-consistent” counselor behaviors and patient motivational statements (i.e., “change talk”), the specific counselor communication behaviors effective for eliciting patient change talk vary by treatment context and, thus, are a subject of ongoing research. An integral part of this research is the sequential analysis of pre-coded MI transcripts. In this paper, we evaluate the empirical effectiveness of the Hidden Markov Model, a probabilistic generative model for sequence data, for modeling sequences of behavior codes and closed frequent pattern mining, a method to identify frequently occurring sequential patterns of behavior codes in MI communication sequences to inform MI practice. We conducted experiments with 1,360 communication sequences from 37 transcribed audio recordings of weight loss counseling sessions with African-American adolescents with obesity and their caregivers. Transcripts had been previously annotated with patient-counselor behavior codes using a specialized codebook. Empirical results indicate that Hidden Markov Model and closed frequent pattern mining techniques can identify counselor communication strategies that are effective at eliciting patients’ motivational statements to guide clinical practice.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2

Similar content being viewed by others

Notes

  1. we used the implementation in the hmmlearn package publicly available at http://hmmlearn.readthedocs.io/

References

  1. Miller WR, Rollnick S (2013) Motivational interviewing: helping people change 3. Guilford publications, New York

    Google Scholar 

  2. Miller WR, Rose GS (2009) Toward a theory of motivational interviewing. Amer Psychol 64(6):527

    Article  Google Scholar 

  3. Amrhein PC (2004) How does motivational interviewing work? What client talk reveals. J Cogn Psychother 18(4):323–336

    Article  Google Scholar 

  4. Apodaca T, Longabaugh R (2009) Mechanisms of change in motivational interviewing: a review and preliminary evaluation of the evidence. Addiction 104(5):705–715

    Article  Google Scholar 

  5. Walker D, Stephens R, Rowland J, Roffman R (2011) The influence of client behavior during motivational interviewing on marijuana treatment outcome. Addict Behav 36(6):669–673

    Article  Google Scholar 

  6. Magill M, Gaume J, Apodaca T, Walthers J, Mastroleo NR, Borsari B, Longabaugh R (2014) The technical hypothesis of motivational interviewing: a meta-analysis of mi’s key causal model. J Consult Clin Psychol 82(6):973

    Article  Google Scholar 

  7. Bakeman R, Gottman JM (1997) Observing interaction: an introduction to sequential analysis. Cambridge University Press, Cambridge

    Book  Google Scholar 

  8. Bakeman R, Quera V (2011) Sequential analysis and observational methods for the behavioral sciences. Cambridge University Press, Cambridge

    Book  MATH  Google Scholar 

  9. Moyers T, Martin T (2006) Therapist influence on client language during motivational interviewing sessions. J Subst Abuse Treat 30(3):245–251

    Article  Google Scholar 

  10. Moyers T, Martin T, Houck J, Christopher P, Tonigan JS (2009) From in-session behaviors to drinking outcomes: a causal chain for motivational interviewing. J Consult Clin Psychol 77(6):1113

    Article  Google Scholar 

  11. Gaume J, Gmel G, Faouzi M, Daeppen J-B (2008) Counsellor behaviours and patient language during brief motivational interventions: a sequential analysis of speech. Addiction 103(11):1793–1800

    Article  Google Scholar 

  12. Gaume J, Bertholet N, Faouzi M, Gmel G, Daeppen J-B (2010) Counselor motivational interviewing skills and young adult change talk articulation during brief motivational interventions. J Subst Abuse Treat 39(3):272–281

    Article  Google Scholar 

  13. Glynn L, Houck J, Moyers T, Bryan A, Montanaro E (2014) Are change talk and sustain talk “contagious” in groups? sequential probabilities and safer-sex outcomes in alcohol-and marijuana-using adolescents. Alcohol Clin Exp Res 38:328A

    Google Scholar 

  14. Carcone A, Naar-King S, Brogan K, Albrecht T, Barton E, Foster T, Martin T, Marshall S (2013) Provider communication behaviors that predict motivation to change in black adolescents with obesity. J Dev Behav Pediatr: JDBP 34(8):599

    Article  Google Scholar 

  15. Jacques-Tiura AJ, Carcone A, Naar S, Brogan Hartlieb K, Albrecht TL, Barton E (2016) Building motivation in african american caregivers of adolescents with obesity: application of sequential analysis. J Pediatr Psychol 42(2):131–141

    Google Scholar 

  16. Catley D, Harris KJ, Mayo MS, Hall S, Okuyemi KS, Boardman T, Ahluwalia JS (2006) Adherence to principles of motivational interviewing and client within-session behavior. Behav Cogn Psychother 34(1):43–56

    Article  Google Scholar 

  17. Thrasher AD, Golin CE, Earp JAL, Tien H, Porter C, Howie L (2006) Motivational interviewing to support antiretroviral therapy adherence: the role of quality counseling. Patient Educ Couns 62(1):64–71

    Article  Google Scholar 

  18. McCambridge J, Day M, Thomas BA, Strang J (2011) Fidelity to motivational interviewing and subsequent cannabis cessation among adolescents. Addict Behav 36(7):749–754

    Article  Google Scholar 

  19. Kotov A, Idalski Carcone A, Dong M, et al (2014) Towards automatic coding of interview transcripts for public health research. In: Proceedings of the Big Data Analytic Technology For Bioinformatics and Health Informatics Workshop (KDD-BHI) in conjunction with ACM SIGKDD Conference on Knowledge Discovery and Data Mining, New York

  20. Gaut G, Steyvers M, Imel Z, Atkins D, Smyth P (2017) Content coding of psychotherapy transcripts using labeled topic models. IEEE J Biomed Health Inf 21(2):476–487

    Article  Google Scholar 

  21. Imel Z, Steyvers M, Atkins D (2015) Computational psychotherapy research: scaling up the evaluation of patient–provider interactions. Psychotherapy 52(1):19

    Article  Google Scholar 

  22. Kotov A, Hasan M, Carcone A, Dong M, Naar-King S, BroganHartlieb K (2015) Interpretable probabilistic latent variable models for automatic annotation of clinical text. In: AMIA Annual Symposium Proceedings. American Medical Informatics Association, vol 2015, pp 785

  23. Atkins D, Steyvers M, Imel Z, Smyth P (2014) Scaling up the evaluation of psychotherapy: evaluating motivational interviewing fidelity via statistical text classification. Implement Sci 9(1):49

    Article  Google Scholar 

  24. Hasan M, Kotov A, Carcone A, Dong M, Naar S, Hartlieb K (2016) A study of the effectiveness of machine learning methods for classification of clinical interview fragments into a large number of categories. J Biomed Inf 62:21–31

    Article  Google Scholar 

  25. Can D, Marín RA, Georgiou PG, Imel Z, Atkins D, Narayanan SS (2016) “It sounds like...”: a natural language processing approach to detecting counselor reflections in motivational interviewing. J Couns Psychol 63(3):343

    Article  Google Scholar 

  26. Pérez-Rosas V, Mihalcea R, Resnicow K, Singh S, Ann L, Goggin KJ, Catley D (2017a) Predicting counselor behaviors in motivational interviewing encounters. Inproceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 1. Long Pap 1:1128–1137

    Google Scholar 

  27. Pérez-Rosas V, Mihalcea R, Resnicow K, Singh S, An L (2017b) Understanding and predicting empathic behavior in counseling therapy. In: Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), vol 1, pp 1426– 1435

  28. Tanana M, Hallgren K, Imel Z, Atkins D, Smyth P, Srikumar V (2015) Recursive neural networks for coding therapist and patient behavior in motivational interviewing. In: Proceedings of the 2nd Workshop on Computational Linguistics and Clinical Psychology: From Linguistic Signal to Clinical Reality, pp 71–79

  29. Tanana M, Hallgren KA, Imel Z, Atkins D, Srikumar V (2016) A comparison of natural language processing methods for automated coding of motivational interviewing. J Subst Abuse Treat 65:43–50

    Article  Google Scholar 

  30. Tausczik YR, Pennebaker JW (2010) The psychological meaning of words: Liwc and computerized text analysis methods. J Lang Soc Psychol 29(1):24–54

    Article  Google Scholar 

  31. Hasan M, Kotov A, Carcone A, Dong M, Naar S (2018) Predicting the outcome of patient-provider communication sequences using recurrent neural networks and probabilistic models. AMIA Summits Transl Sci Proc 2017:64–73

    Google Scholar 

  32. Rabiner LR (1989) A tutorial on hidden Markov models and selected applications in speech recognition. Proc IEEE 77(2):257–286

    Article  Google Scholar 

  33. Uğuz H, Arslan A, Türkoğlu İ (2007) A biomedical system based on hidden Markov model for diagnosis of the heart valve diseases. Pattern Recogn Lett 28(4):395–404

    Article  Google Scholar 

  34. Amrhein PC, Miller WR, Yahne CE, Palmer M, Fulcher L (2003) Client commitment language during motivational interviewing predicts drug use outcomes. J Consult Clin Psychol 71(5):862

    Article  Google Scholar 

  35. Baldi P, Chauvin Y, Hunkapiller T, McClure MA (1994) Hidden markov models of biological primary sequence information. Proc Natl Acad Sci 91(3):1059–1063

    Article  Google Scholar 

  36. Aggarwal CC, Han J (2014) Frequent pattern mining. Springer, Berlin

    Book  MATH  Google Scholar 

  37. Agrawal R, Srikant R, et al (1994) Fast algorithms for mining association rules. In: Proceedings of 20th international conference very large data bases, VLDB, vol 1215, pp 487–499

  38. Abdullah U, Ahmad J, Ahmed A (2008) Analysis of effectiveness of apriori algorithm in medical billing data mining. In: 2008. ICET 2008. 4th International Conference on Emerging Technologies. IEEE, pp 327–331

  39. Olukunle A, Ehikioya S (2002) A fast algorithm for mining association rules in medical image data. In: 2002. IEEE CCECE 2002. Canadian Conference on Electrical and Computer Engineering. IEEE, vol 2, pp 1181–1187

  40. Bethel CL, Hall LO, Goldgof D (2006) Mining for implications in medical data. In: 2006. ICPR 2006. 18th International Conference on Pattern Recognition. IEEE, vol 1, pp 1212–1215

  41. Wright AP, Wright AT, McCoy AB, Sittig DF (2015) The use of sequential pattern mining to predict next prescribed medications. J Biomed Inf 53:73–80

    Article  Google Scholar 

  42. Deshpande M, Kuramochi M, Wale N, Karypis G (2005) Frequent substructure-based approaches for classifying chemical compounds. IEEE Trans Knowl Data Eng 17(8):1036–1050

    Article  Google Scholar 

  43. Leach AR, Gillet VJ (2007) An introduction to chemoinformatics. Springer Science & Business Media, Berlin

    Book  Google Scholar 

  44. Zhang S, Wang JT (2008) Discovering frequent agreement subtrees from phylogenetic data. IEEE Trans Knowl Data Eng 20(1):68–82

    Article  Google Scholar 

  45. Srivastava J, Cooley R, Deshpande M, Tan P-N (2000) Web usage mining: discovery and applications of usage patterns from web data. Acm Sigkdd Explor Newsl 1(2):12–23

    Article  Google Scholar 

  46. Aggarwal CC (2015) Outlier analysis. In: Data mining. Springer, pp 237–263

  47. Pasquier N, Bastide Y, Taouil R, Lakhal L (1999) Discovering frequent closed itemsets for association rules. In: International Conference on Database Theory. Springer, pp 398–416

  48. Grahne G, Zhu J (2005) Fast algorithms for frequent itemset mining using fp-trees. IEEE Trans Knowl Data Eng 17(10):1347–1362

    Article  Google Scholar 

  49. Bertholet N, Faouzi M, Gmel G, Gaume J, Daeppen J-B (2010) Change talk sequence during brief motivational intervention, towards or away from drinking. Addiction 105(12):2106–2112

    Article  Google Scholar 

  50. Martin T, Moyers T, Houck J, Christopher P, Miller WR (2005) Motivational interviewing sequential code for observing process exchanges (mi-scope) coder’s manual. Retrieved March, 16, 2009

  51. Moyers T, Martin T, Manuel JK, Hendrickson SM, Miller WR (2005) Assessing competence in the use of motivational interviewing. J Subst Abuse Treat 28(1):19–26

    Article  Google Scholar 

  52. Apodaca T, Manuel JK, Moyers T, Amrhein P (2007) Motivational interviewing with significant others (miso) coding manual. Unpublished manuscript

  53. Fournier-Viger P, Gomariz A, Gueniche T, Soltani A, Wu C-W, Tseng VS (2014) Spmf: a java open-source pattern mining library. J Mach Learn Res 15(1):3389–3393

    MATH  Google Scholar 

  54. Fournier-Viger P, Lin JC-W, Gomariz A, Gueniche T, Soltani A, Deng Z, Lam HT (2016) The spmf open-source data mining library version 2. In: Joint European conference on machine learning and knowledge discovery in databases. Springer, pp 36–40

  55. Han J, Pei J, Yin Y (2000) Mining frequent patterns without candidate generation. In ACM sigmod record. ACM, vol 29, pp 1–12

  56. Moradi M, Ghadiri N (2017) Quantifying the informativeness for biomedical literature summarization: An itemset mining method. Comput Methods Programs Biomed 146:77–89

    Article  Google Scholar 

  57. Liu B, Hsu W, Ma Y (1999) Mining association rules with multiple minimum supports. In: Proceedings of the fifth ACM SIGKDD international conference on Knowledge discovery and data mining. ACM, pp 337–341

  58. Douaihy A, Kelly TM, Gold MA (2015) Motivational interviewing: a guide for medical trainees. Oxford University Press, USA

    Google Scholar 

  59. Carcone A, Kotov A, Hasan M, Dong M, Eggly S, Hartlieb K, Alexander G, Lu M, Naar S (2018) Using natural language processing to understand the antecedents of behavior change. In: Annals Of Behavioral Medicine, vol 52, pp S422–S422

Download references

Acknowledgements

We would like to thank the student assistants in the Department of Family Medicine and Public Health Sciences at Wayne State University School of Medicine for their help in developing the training dataset. The authors would like to thank Lisa Todd, JD, MA, for her thoughtful feedback and clinical expertise in the interpretation of these data.

Funding

This study was supported by a grant from the National Institutes of Health, NIDDK R21DK108071, Carcone and Kotov, MPIs.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Mehedi Hasan.

Ethics declarations

Conflict of Interest

The authors declare that they have no conflict of interest.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hasan, M., Carcone, A.I., Naar, S. et al. Identifying Effective Motivational Interviewing Communication Sequences Using Automated Pattern Analysis. J Healthc Inform Res 3, 86–106 (2019). https://doi.org/10.1007/s41666-018-0037-6

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s41666-018-0037-6

Keywords

Navigation