Abstract
Motivational interviewing (MI) is an evidence-based strategy for communicating with patients about behavior change. Although there is strong empirical evidence linking “MI-consistent” counselor behaviors and patient motivational statements (i.e., “change talk”), the specific counselor communication behaviors effective for eliciting patient change talk vary by treatment context and, thus, are a subject of ongoing research. An integral part of this research is the sequential analysis of pre-coded MI transcripts. In this paper, we evaluate the empirical effectiveness of the Hidden Markov Model, a probabilistic generative model for sequence data, for modeling sequences of behavior codes and closed frequent pattern mining, a method to identify frequently occurring sequential patterns of behavior codes in MI communication sequences to inform MI practice. We conducted experiments with 1,360 communication sequences from 37 transcribed audio recordings of weight loss counseling sessions with African-American adolescents with obesity and their caregivers. Transcripts had been previously annotated with patient-counselor behavior codes using a specialized codebook. Empirical results indicate that Hidden Markov Model and closed frequent pattern mining techniques can identify counselor communication strategies that are effective at eliciting patients’ motivational statements to guide clinical practice.
Similar content being viewed by others
Notes
we used the implementation in the hmmlearn package publicly available at http://hmmlearn.readthedocs.io/
References
Miller WR, Rollnick S (2013) Motivational interviewing: helping people change 3. Guilford publications, New York
Miller WR, Rose GS (2009) Toward a theory of motivational interviewing. Amer Psychol 64(6):527
Amrhein PC (2004) How does motivational interviewing work? What client talk reveals. J Cogn Psychother 18(4):323–336
Apodaca T, Longabaugh R (2009) Mechanisms of change in motivational interviewing: a review and preliminary evaluation of the evidence. Addiction 104(5):705–715
Walker D, Stephens R, Rowland J, Roffman R (2011) The influence of client behavior during motivational interviewing on marijuana treatment outcome. Addict Behav 36(6):669–673
Magill M, Gaume J, Apodaca T, Walthers J, Mastroleo NR, Borsari B, Longabaugh R (2014) The technical hypothesis of motivational interviewing: a meta-analysis of mi’s key causal model. J Consult Clin Psychol 82(6):973
Bakeman R, Gottman JM (1997) Observing interaction: an introduction to sequential analysis. Cambridge University Press, Cambridge
Bakeman R, Quera V (2011) Sequential analysis and observational methods for the behavioral sciences. Cambridge University Press, Cambridge
Moyers T, Martin T (2006) Therapist influence on client language during motivational interviewing sessions. J Subst Abuse Treat 30(3):245–251
Moyers T, Martin T, Houck J, Christopher P, Tonigan JS (2009) From in-session behaviors to drinking outcomes: a causal chain for motivational interviewing. J Consult Clin Psychol 77(6):1113
Gaume J, Gmel G, Faouzi M, Daeppen J-B (2008) Counsellor behaviours and patient language during brief motivational interventions: a sequential analysis of speech. Addiction 103(11):1793–1800
Gaume J, Bertholet N, Faouzi M, Gmel G, Daeppen J-B (2010) Counselor motivational interviewing skills and young adult change talk articulation during brief motivational interventions. J Subst Abuse Treat 39(3):272–281
Glynn L, Houck J, Moyers T, Bryan A, Montanaro E (2014) Are change talk and sustain talk “contagious” in groups? sequential probabilities and safer-sex outcomes in alcohol-and marijuana-using adolescents. Alcohol Clin Exp Res 38:328A
Carcone A, Naar-King S, Brogan K, Albrecht T, Barton E, Foster T, Martin T, Marshall S (2013) Provider communication behaviors that predict motivation to change in black adolescents with obesity. J Dev Behav Pediatr: JDBP 34(8):599
Jacques-Tiura AJ, Carcone A, Naar S, Brogan Hartlieb K, Albrecht TL, Barton E (2016) Building motivation in african american caregivers of adolescents with obesity: application of sequential analysis. J Pediatr Psychol 42(2):131–141
Catley D, Harris KJ, Mayo MS, Hall S, Okuyemi KS, Boardman T, Ahluwalia JS (2006) Adherence to principles of motivational interviewing and client within-session behavior. Behav Cogn Psychother 34(1):43–56
Thrasher AD, Golin CE, Earp JAL, Tien H, Porter C, Howie L (2006) Motivational interviewing to support antiretroviral therapy adherence: the role of quality counseling. Patient Educ Couns 62(1):64–71
McCambridge J, Day M, Thomas BA, Strang J (2011) Fidelity to motivational interviewing and subsequent cannabis cessation among adolescents. Addict Behav 36(7):749–754
Kotov A, Idalski Carcone A, Dong M, et al (2014) Towards automatic coding of interview transcripts for public health research. In: Proceedings of the Big Data Analytic Technology For Bioinformatics and Health Informatics Workshop (KDD-BHI) in conjunction with ACM SIGKDD Conference on Knowledge Discovery and Data Mining, New York
Gaut G, Steyvers M, Imel Z, Atkins D, Smyth P (2017) Content coding of psychotherapy transcripts using labeled topic models. IEEE J Biomed Health Inf 21(2):476–487
Imel Z, Steyvers M, Atkins D (2015) Computational psychotherapy research: scaling up the evaluation of patient–provider interactions. Psychotherapy 52(1):19
Kotov A, Hasan M, Carcone A, Dong M, Naar-King S, BroganHartlieb K (2015) Interpretable probabilistic latent variable models for automatic annotation of clinical text. In: AMIA Annual Symposium Proceedings. American Medical Informatics Association, vol 2015, pp 785
Atkins D, Steyvers M, Imel Z, Smyth P (2014) Scaling up the evaluation of psychotherapy: evaluating motivational interviewing fidelity via statistical text classification. Implement Sci 9(1):49
Hasan M, Kotov A, Carcone A, Dong M, Naar S, Hartlieb K (2016) A study of the effectiveness of machine learning methods for classification of clinical interview fragments into a large number of categories. J Biomed Inf 62:21–31
Can D, Marín RA, Georgiou PG, Imel Z, Atkins D, Narayanan SS (2016) “It sounds like...”: a natural language processing approach to detecting counselor reflections in motivational interviewing. J Couns Psychol 63(3):343
Pérez-Rosas V, Mihalcea R, Resnicow K, Singh S, Ann L, Goggin KJ, Catley D (2017a) Predicting counselor behaviors in motivational interviewing encounters. Inproceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 1. Long Pap 1:1128–1137
Pérez-Rosas V, Mihalcea R, Resnicow K, Singh S, An L (2017b) Understanding and predicting empathic behavior in counseling therapy. In: Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), vol 1, pp 1426– 1435
Tanana M, Hallgren K, Imel Z, Atkins D, Smyth P, Srikumar V (2015) Recursive neural networks for coding therapist and patient behavior in motivational interviewing. In: Proceedings of the 2nd Workshop on Computational Linguistics and Clinical Psychology: From Linguistic Signal to Clinical Reality, pp 71–79
Tanana M, Hallgren KA, Imel Z, Atkins D, Srikumar V (2016) A comparison of natural language processing methods for automated coding of motivational interviewing. J Subst Abuse Treat 65:43–50
Tausczik YR, Pennebaker JW (2010) The psychological meaning of words: Liwc and computerized text analysis methods. J Lang Soc Psychol 29(1):24–54
Hasan M, Kotov A, Carcone A, Dong M, Naar S (2018) Predicting the outcome of patient-provider communication sequences using recurrent neural networks and probabilistic models. AMIA Summits Transl Sci Proc 2017:64–73
Rabiner LR (1989) A tutorial on hidden Markov models and selected applications in speech recognition. Proc IEEE 77(2):257–286
Uğuz H, Arslan A, Türkoğlu İ (2007) A biomedical system based on hidden Markov model for diagnosis of the heart valve diseases. Pattern Recogn Lett 28(4):395–404
Amrhein PC, Miller WR, Yahne CE, Palmer M, Fulcher L (2003) Client commitment language during motivational interviewing predicts drug use outcomes. J Consult Clin Psychol 71(5):862
Baldi P, Chauvin Y, Hunkapiller T, McClure MA (1994) Hidden markov models of biological primary sequence information. Proc Natl Acad Sci 91(3):1059–1063
Aggarwal CC, Han J (2014) Frequent pattern mining. Springer, Berlin
Agrawal R, Srikant R, et al (1994) Fast algorithms for mining association rules. In: Proceedings of 20th international conference very large data bases, VLDB, vol 1215, pp 487–499
Abdullah U, Ahmad J, Ahmed A (2008) Analysis of effectiveness of apriori algorithm in medical billing data mining. In: 2008. ICET 2008. 4th International Conference on Emerging Technologies. IEEE, pp 327–331
Olukunle A, Ehikioya S (2002) A fast algorithm for mining association rules in medical image data. In: 2002. IEEE CCECE 2002. Canadian Conference on Electrical and Computer Engineering. IEEE, vol 2, pp 1181–1187
Bethel CL, Hall LO, Goldgof D (2006) Mining for implications in medical data. In: 2006. ICPR 2006. 18th International Conference on Pattern Recognition. IEEE, vol 1, pp 1212–1215
Wright AP, Wright AT, McCoy AB, Sittig DF (2015) The use of sequential pattern mining to predict next prescribed medications. J Biomed Inf 53:73–80
Deshpande M, Kuramochi M, Wale N, Karypis G (2005) Frequent substructure-based approaches for classifying chemical compounds. IEEE Trans Knowl Data Eng 17(8):1036–1050
Leach AR, Gillet VJ (2007) An introduction to chemoinformatics. Springer Science & Business Media, Berlin
Zhang S, Wang JT (2008) Discovering frequent agreement subtrees from phylogenetic data. IEEE Trans Knowl Data Eng 20(1):68–82
Srivastava J, Cooley R, Deshpande M, Tan P-N (2000) Web usage mining: discovery and applications of usage patterns from web data. Acm Sigkdd Explor Newsl 1(2):12–23
Aggarwal CC (2015) Outlier analysis. In: Data mining. Springer, pp 237–263
Pasquier N, Bastide Y, Taouil R, Lakhal L (1999) Discovering frequent closed itemsets for association rules. In: International Conference on Database Theory. Springer, pp 398–416
Grahne G, Zhu J (2005) Fast algorithms for frequent itemset mining using fp-trees. IEEE Trans Knowl Data Eng 17(10):1347–1362
Bertholet N, Faouzi M, Gmel G, Gaume J, Daeppen J-B (2010) Change talk sequence during brief motivational intervention, towards or away from drinking. Addiction 105(12):2106–2112
Martin T, Moyers T, Houck J, Christopher P, Miller WR (2005) Motivational interviewing sequential code for observing process exchanges (mi-scope) coder’s manual. Retrieved March, 16, 2009
Moyers T, Martin T, Manuel JK, Hendrickson SM, Miller WR (2005) Assessing competence in the use of motivational interviewing. J Subst Abuse Treat 28(1):19–26
Apodaca T, Manuel JK, Moyers T, Amrhein P (2007) Motivational interviewing with significant others (miso) coding manual. Unpublished manuscript
Fournier-Viger P, Gomariz A, Gueniche T, Soltani A, Wu C-W, Tseng VS (2014) Spmf: a java open-source pattern mining library. J Mach Learn Res 15(1):3389–3393
Fournier-Viger P, Lin JC-W, Gomariz A, Gueniche T, Soltani A, Deng Z, Lam HT (2016) The spmf open-source data mining library version 2. In: Joint European conference on machine learning and knowledge discovery in databases. Springer, pp 36–40
Han J, Pei J, Yin Y (2000) Mining frequent patterns without candidate generation. In ACM sigmod record. ACM, vol 29, pp 1–12
Moradi M, Ghadiri N (2017) Quantifying the informativeness for biomedical literature summarization: An itemset mining method. Comput Methods Programs Biomed 146:77–89
Liu B, Hsu W, Ma Y (1999) Mining association rules with multiple minimum supports. In: Proceedings of the fifth ACM SIGKDD international conference on Knowledge discovery and data mining. ACM, pp 337–341
Douaihy A, Kelly TM, Gold MA (2015) Motivational interviewing: a guide for medical trainees. Oxford University Press, USA
Carcone A, Kotov A, Hasan M, Dong M, Eggly S, Hartlieb K, Alexander G, Lu M, Naar S (2018) Using natural language processing to understand the antecedents of behavior change. In: Annals Of Behavioral Medicine, vol 52, pp S422–S422
Acknowledgements
We would like to thank the student assistants in the Department of Family Medicine and Public Health Sciences at Wayne State University School of Medicine for their help in developing the training dataset. The authors would like to thank Lisa Todd, JD, MA, for her thoughtful feedback and clinical expertise in the interpretation of these data.
Funding
This study was supported by a grant from the National Institutes of Health, NIDDK R21DK108071, Carcone and Kotov, MPIs.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of Interest
The authors declare that they have no conflict of interest.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Hasan, M., Carcone, A.I., Naar, S. et al. Identifying Effective Motivational Interviewing Communication Sequences Using Automated Pattern Analysis. J Healthc Inform Res 3, 86–106 (2019). https://doi.org/10.1007/s41666-018-0037-6
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s41666-018-0037-6