Abstract
The term adaptive intervention has been used in behavioral medicine to describe operationalized and individually tailored strategies for prevention and treatment of chronic, relapsing disorders. Control systems engineering offers an attractive means for designing and implementing adaptive behavioral interventions that feature intensive measurement and frequent decision-making over time. This is illustrated in this paper for the case of a low-dose naltrexone treatment intervention for fibromyalgia. System identification methods from engineering are used to estimate dynamical models from daily diary reports completed by participants. These dynamical models then form part of a model predictive control algorithm which systematically decides on treatment dosages based on measurements obtained under real-life conditions involving noise, disturbances, and uncertainty. The effectiveness and implications of this approach for behavioral interventions (in general) and pain treatment (in particular) are demonstrated using informative simulations.
Similar content being viewed by others
References
Hamburg MA, Collins FS. The path to personalized medicine. N Engl J Med. 2010;363(4):301-304.
Wellstead P, Bullinger E, Kalamatianos D, Mason O, Verwoerd M. The role of control and system theory in systems biology. Annu Rev Control. 2008;32(1):33-47.
Collins LM, Murphy SA, Bierman KL. A conceptual framework for adaptive preventive interventions. Prev Sci. 2004;5:185-196.
Åström K, Murray R. Feedback Systems: An Introduction for Scientists and Engineers. Princeton: Princeton University Press; 2009.
Chakraborty B, Murphy SA. Dynamic treatment regimes. Annu Rev Stat Appl. 2014;1(1):447-464.
Riley WT, Rivera DE, Atienza AA, Nilsen W, Allison SM, Mermelstein R. Health behavior models in the age of mobile interventions: are our theories up to the task? Transl Behav Med. 2011;1:53-71.
Rivera DE. Optimized behavioral interventions: what does system identification and control engineering have to offer? In: Proceedings of 16th IFAC Symposium on System Identification; 2012: 882–893.
Rivera DE, Pew MD, Collins LM. Using engineering control principles to inform the design of adaptive interventions: a conceptual introduction. Drug Alcohol Depend. 2007;88(Supplement 2):S31-S40. Customizing Treatment to the Patient: Adaptive Treatment Strategies.
Zafra-Cabeza A, Rivera DE, Collins LM, Ridao MA, Camacho EF. A risk-based model predictive control approach to adaptive interventions in behavioral health. IEEE Trans Control Syst Technol. 2011;19(4):891-901.
Boissevain MD, McCain GA. Toward an integrated understanding of fibromyalgia syndrome. I. Medical and pathophysiological aspects. Pain. 1991;45(3):227-238.
Younger J, Mackey S. Fibromyalgia symptoms are reduced by low-dose naltrexone: a pilot study. Pain Med. 2009;10(4):663-672.
Younger J, Noor N, McCue R, Mackey S. Low-dose naltrexone for the treatment of fibromyalgia: findings of a small, randomized, double-blind, placebo-controlled, counterbalanced, crossover trial assessing daily pain levels. Arthritis Rheum. 2013;65(2):529-538.
Ljung L. System Identification: Theory for the User. 2nd ed. Upper Saddle River: Prentice Hall; 1999.
Molenaar P, Campbell C. The new person-specific paradigm in psychology. Curr Dir Psychol Sci. 2009;18:112-117.
Velicer W. Applying idiographic research methods: two examples. In: Proceedings of the 8th International Conference on Teaching Statistics; 2010.
Nandola NN, Rivera DE. An improved formulation of hybrid model predictive control with application to production-inventory systems. IEEE Trans Control Syst Technol. 2013;21(1):121-135.
Pina AA, Holly LE, Zerr AA, Rivera DE. A personalized and control systems engineering conceptual approach to target childhood anxiety in the contexts of cultural diversity. J Clin Child Adolesc Psychol. 2014;43(3):442-453.
Davison DE, Vanderwater R, Zhou K. A control-theory reward-based approach to behavior modification in the presence of social-norm pressure and conformity pressure. In: Proceedings of the 2012 American Control Conference; 2012: 4076–4052.
Hekler EB, Buman MP, Poothakandiyil N, et al. Exploring behavioral markers of long-term physical activity maintenance: a case study of system identification modeling within a behavioral intervention. Health Educ Behav. 2013;40(1 suppl):51S-62S.
Navarro-Barrientos JE, Rivera DE, Collins LM. A dynamical model for describing behavioural interventions for weight loss and body composition change. Math Comput Model Dyn Syst. 2011;17(2):183-203.
Dong Y, Rivera DE, Thomas DM, Navarro-Barrientos JE, Downs DS, Savage JS, Collins LM. A dynamical systems model for improving gestational weight gain behavioral interventions. In: Proceedings of the 2012 American Control Conference; 2012: 4059–4064.
Dong Y, Rivera DE, Downs DS, Savage JS, Thomas DM, Collins LM. Hybrid model predictive control for optimizing gestational weight gain behavioral interventions. In: Proceedings of the 2013 American Control Conference; 2013: 1973–1978.
Savage JS, Downs DS, Dong Y, Rivera DE. Control systems engineering for optimizing a prenatal weight gain intervention to regulate infant birth weight. Am J Public Health. 2014;104(7):1247-1254.
Dong Y, Deshpande S, Rivera DE, Downs DS, Savage JS. Hybrid model predictive control for sequential decision policies in adaptive behavioral interventions. In: Proceedings of the 2014 American Control Conference; 2014: 4198–4203.
Timms KP, Rivera DE, Collins LM, Piper ME. A dynamical systems approach to understanding self-regulation in smoking cessation behavior change. Nicotine Tob Res. 2014;16(Suppl 2):S159-S168.
Timms KP, Rivera DE, Collins LM, Piper ME. Continuous-time system identification of a smoking cessation intervention. Int J Control. 2014;87(7):1423-1437.
Timms KP, Rivera DE, Piper ME, Collins LM. A hybrid model predictive control strategy for optimizing a smoking cessation intervention. In: Proceedings of the 2014 American Control Conference; 2014: 2389–2394.
Trail JB, Collins LM, Rivera DE, Li R, Piper ME, Baker TB. Functional data analysis for dynamical system identification of behavioral processes. Psychol Methods. 2014;19(2):175-187.
Ogata K. Modern Control Engineering. Upper Saddle River: Prentice Hall; 2001.
Ogunnaike BA, Ray WH. Process Dynamics, Modeling, and Control. Oxford: Oxford University Press; 1994.
Wolfe F, Clauw D, Fitzcharles M, et al. The American College of Rheumatology preliminary diagnostic criteria for fibromyalgia and measurement of symptom severity. Arthritis Care Res. 2010;62:600-610.
Wolfe F, Smythe HA, Yunus M, et al. The American College of Rheumatology 1990 criteria for the classification of fibromyalgia: report of the multicenter criteria committee. Arthritis Rheum. 1990;33:160-172.
Perrot S. Fibromyalgia syndrome: a relevant recent construction of an ancient condition? Curr Opin Support Palliat Care. 2008;2(2):122-127.
Lee YC, Nassikas NJ, Clauw DJ. The role of the central nervous system in the generation and maintenance of chronic pain in rheumatoid arthritis, osteoarthritis and fibromyalgia. Arthritis Res Ther. 2011;13(2):211.
Mattiloi TM, Milne B, Cahill C. Ultra-low dose naltrexone attenuates chronic morphine-induced gliosis in rats. Mol Pain. 2010;6(22):1-11.
Deshpande S. A control engineering approach for designing an optimized treatment plan for fibromyalgia. Master’s thesis, Electrical Engineering, Arizona State University, USA; 2011.
Gevers M, Miskovic L, Bonvin D, Karimi A. Identification of multi-input systems: variance analysis and input design issues. Automatica. 2006;42(4):559-572.
The Mathworks. System Identification Toolbox, MATLAB User Manual for version R2009b; 2009.
Garnier H, Young PC. The advantages of directly identifying continuous-time transfer function models in practical applications. Int J Control. 2014;87(7):1319-1338.
Hekler EB, Klasnja P, Froehlich JE, Buman MP. Mind the theoretical gap: Interpreting, using, and developing behavioral theory in HCI research. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI ’13; 2013: 3307–3316.
Martin CA, Rivera DE, Riley WT, Hekler EB, Buman MP, Adams MA, King AC. A dynamical systems model of social cognitive theory. In: Proceedings of the 2014 American Control Conference; 2014: 2407–2412.
Skogestad S, Postlethwaite I. Multivariable Feedback Control: Analysis and Design. Hoboken: Wiley; 1996.
Qin SJ, Badgwell TA. A survey of industrial model predictive control technology. Control Eng Pract. 2003;11(7):733-764.
Deshpande S, Nandola NN, Rivera DE, Younger J. A control engineering approach for designing an optimized treatment plan for fibromyalgia. In: Proceedings of the 2011 American Control Conference; 2011: 4798–4803.
Lee H, Buckingham B, Wilson D, Bequette B. A closed-loop artificial pancreas using model predictive control and a sliding meal size estimator. J Diabetes Sci Tech. 2009;3(5):1082-1090.
Wang Y, Dassau E, Doyle F. Closed-loop control of artificial pancreatic β-cell in type 1 diabetes mellitus using model predictive iterative learning control. IEEE Trans Biomed Eng. 2010;57(2):211-219.
Zurakowski R, Teel AR. A model predictive control based scheduling method for HIV therapy. J Theor Biol. 2006;238(2):368-382.
Lee JH, Yu ZH. Tuning of model predictive controllers for robust performance. Comput Chem Eng. 1994;18(1):15-37.
Wang W, Rivera DE. Model predictive control for tactical decision-making in semiconductor manufacturing supply chain management. IEEE Trans Control Syst Technol. 2008;16(5):841-855.
Deshpande S. Optimal input signal design for data-centric identification and control with applications to behavioral health and medicine. Ph.D. thesis, Electrical Engineering, Arizona State University, USA; 2014.
Nilsen W, Pavel M. Moving behavioral theories into the 21st century: technological advancements for improving quality of life. IEEE Pulse. 2013;4(5):25-28.
Hersen M, Barlow DH. Single-Case Experimental Designs: Strategies for Studying Behavior Change. Oxford: Pergamon; 1976.
Lillie EO, Patay B, Diamant J, Issell B, Topol EJ, Schork NJ. The n-of-1 clinical trial: the ultimate strategy for individualizing medicine? Personal Med. 2011;8(2):161-173.
Dallery J, Cassidy RN, Raiff BR. Single-case experimental designs to evaluate novel technology-based health interventions. J Med Internet Res. 2013;15(2):1-17.
Deshpande S, Rivera DE, Younger J. Towards patient-friendly input signal design for optimized pain treatment interventions. In: Proceedings of the 16th IFAC Symposium on System Identification; 2012: 1311–1316.
Acknowledgments
Support for this work has been provided by the Office of Behavioral and Social Sciences Research (OBSSR) of the National Institutes of Health (NIH) and the National Institute on Drug Abuse (NIDA) through grants R21 DA024266 and K25 DA021173. The content is solely the responsibility of the authors and does not necessarily represent the official views of OBSSR, NIDA, or the NIH. J. W. Younger received support from the American Fibromyalgia Syndrome Association (AFSA). Insights provided by L. M. Collins and J. Trail of the Methodology Center, Penn State University during the conduct of this research are greatly appreciated.
Conflict of interest and adherence to ethical standards statement
The authors have no conflicts of interest to disclose. This paper presented a de-identified secondary data and simulation analysis of two previously executed clinical studies performed in accordance to ethical standards and protection for human subjects.
Author information
Authors and Affiliations
Corresponding author
Additional information
Implications
Practice: Adaptive interventions based on control systems engineering principles represent a valuable practical approach for personalizing and optimizing treatment in behavioral interventions that feature intensive data collection and frequent decision-making.
Research: Dynamical systems and control engineering provide a powerful, broad-based methodological framework for modeling and decision-making in behavioral settings that can serve to benefit modern time-varying, adaptive interventions.
Policy: Adaptive, time-varying interventions based on control systems engineering can substantially improve individual treatment outcomes while lowering costs and reducing negative effects.
About this article
Cite this article
Deshpande, S., Rivera, D.E., Younger, J.W. et al. A control systems engineering approach for adaptive behavioral interventions: illustration with a fibromyalgia intervention. Behav. Med. Pract. Policy Res. 4, 275–289 (2014). https://doi.org/10.1007/s13142-014-0282-z
Published:
Issue Date:
DOI: https://doi.org/10.1007/s13142-014-0282-z