Skip to main content

Advertisement

SpringerLink
Log in

A survey of cyber-physical system implementations of real-time personalized interventions

  • Original Research
  • Published:
Journal of Ambient Intelligence and Humanized Computing Aims and scope Submit manuscript

Abstract

Advances in sensor technology and machine learning as well as the widespread use of smartphones are shifting the focus of healthcare. Emerging paradigms such as cyber-physical systems (CPSs) make possible the transition from reactive to preventive care. CPSs can be implemented to achieve effective mobile health solutions and to provide sophisticated new mechanisms to monitor an individual’s state in real-time via the use of sensors and mobile devices. Despite the significant potential impact of such systems, their implementation poses a range of complex technical challenges. This article surveys the state-of-the-art in implementations of CPSs for real-time personalized interventions. A general three layer architecture which can be used to consider current implementations is first presented along with a description of its main components. We also propose a three level taxonomy in accordance with the system capabilities. Then, the principal technical challenges, human-machine interaction challenges and future directions are discussed. Fifteen of the state-of-the-art implementations are qualitatively evaluated in terms of sensor capabilities, just-in-time reaction, interruptibility, and adherence, among other characteristics. By reviewing the state-of-the-art of the systems that have been built to-date, the focus of the review is to summarize current technical challenges and future opportunities for both future CPS implementers and behavioral scientists designing CPS for personalized interventions.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

References

  • Añazco EV, Lopez PR, Lee S, Byun K, Kim TS (2018) Smoking activity recognition using a single wrist imu and deep learning light. In: Proceedings of the 2nd international conference on digital signal processing, pp 48–51

  • Bae S, Chung T, Ferreira D, Dey AK, Suffoletto B (2018) Mobile phone sensors and supervised machine learning to identify alcohol use events in young adults: implications for just-in-time adaptive interventions. Addict Behav 83:42–47

    Article  Google Scholar 

  • Boruvka A, Almirall D, Witkiewitz K, Murphy SA (2017) Assessing time-varying causal effect moderation in mobile health. J Am Stat Assoc 113(523):1112–1121

    Article  MathSciNet  Google Scholar 

  • Cerrada CJ, Dzubur E, Blackman KC, Mays V, Shoptaw S, Huh J (2017) Development of a just-in-time adaptive intervention for smoking cessation among korean american emerging adults. Int J Behav Med 24(5):665–672

    Article  Google Scholar 

  • Cheung KL, Durusu D, Sui X, de Vries H (2019) How recommender systems could support and enhance computer-tailored digital health programs: a scoping review. Digitalhealth 5:1–19

    Google Scholar 

  • Cho Y, Bianchi-Berthouze N, Julier SJ (2017) Deepbreath: Deep learning of breathing patterns for automatic stress recognition using low-cost thermal imaging in unconstrained settings. In: 2017 Seventh international conference on affective computing and intelligent interaction (ACII), IEEE, pp 456–463

  • Clarke A, Steele R (2015) Smartphone-based public health information systems: anonymity, privacy and intervention. J Assoc Inf Sci Technol 66(12):2596–2608

    Article  Google Scholar 

  • Clarke S, Jaimes LG, Labrador MA (2017) mstress: A mobile recommender system for just-in-time interventions for stress. In: Consumer communications and networking conference (CCNC), 2017 14th IEEE Annual, IEEE, pp 1–5

  • Collins LM, Murphy SA, Bierman KL (2004) A conceptual framework for adaptive preventive interventions. Prev Sci 5(3):185–196

    Article  Google Scholar 

  • Crandall AS, Cook DJ (2016) Current state of the art of smart environments and labs from an ambient assisted living point of view. In: Active and assisted living: technologies and applications, pp 11–28

  • Eadie M, Steele RJ (2017) Non-invasive blood glucose monitoring and data analytics. In: Proceedings of the International Conference on Compute and Data Analysis, pp 138–142

  • Ertin E, Stohs N, Kumar S, Raij A, al’Absi M, Shah S (2011) Autosense: unobtrusively wearable sensor suite for inferring the onset, causality, and consequences of stress in the field. In: Proceedings of the 9th ACM conference on embedded networked sensor systems, ACM, pp 274–287

  • Facchinetti A (2016) Continuous glucose monitoring sensors: past, present and future algorithmic challenges. Sensors 16(12):2093

    Article  Google Scholar 

  • Gao J, Baskar S, Teng D, al’Absi M, Kumar S, Ertin E (2017) A new direction for biosensing: Rf sensors for monitoring cardio-pulmonary function. In: Mobile Health, Springer, pp 289–312

  • Goldstein SP, Evans BC, Flack D, Juarascio A, Manasse S, Zhang F, Forman EM (2017) Return of the jitai: Applying a just-in-time adaptive intervention framework to the development of m-health solutions for addictive behaviors. Int J Behav Med 24(5):673–682

    Article  Google Scholar 

  • Gulzar MA, Interlandi M, Condie T, Kim M (2017) Debugging big data analytics in spark with bigdebug. In: Proceedings of the 2017 ACM international conference on management of data, pp 1627–1630

  • Heron KE (2011) Ecological Momentary Intervention [EMI]: incorporating mobile technology into a disordered eating treatment program for college women. Syracuse University

    Google Scholar 

  • Heron KE, Smyth JM (2010) Ecological Momentary Interventions: incorporating mobile technology into psychosocial and health behaviour treatments. Br J Health Psychol 15(1):1–39

    Article  Google Scholar 

  • Hockey R (2013) The psychology of fatigue: work, effort and control. Cambridge University Press

    Book  Google Scholar 

  • Interlandi M, Ekmekji A, Shah K, Gulzar MA, Tetali SD, Kim M, Millstein T, Condie T (2018) Adding data provenance support to apache spark. VLDB J 27(5):595–615

    Article  Google Scholar 

  • Jaimes LG, Llofriu M, Raij A (2014) A stress-free life: just-in-time interventions for stress via real-time forecasting and intervention adaptation. In: Proceedings of the 9th international conference on body area networks, pp 197–203

  • Jaimes LG, Llofriu M, Raij A (2015a) Calma, an algorithm framework for mobile just in time interventions. In: SoutheastCon 2015, IEEE, pp 1–5

  • Jaimes LG, Llofriu M, Raij A (2015b) Preventer, a selection mechanism for just-in-time preventive interventions. IEEE Trans Affect Comput 7(3):243–257

    Article  Google Scholar 

  • Jaimes LG, Llofriu M, Raij A (2016) Preventer, a selection mechanism for just-in-time preventive interventions. IEEE Trans Affect Comput 7(3):243–257

    Article  Google Scholar 

  • Klasnja P, Hekler EB, Shiffman S, Boruvka A, Almirall D, Tewari A, Murphy SA (2015) Microrandomized trials: an experimental design for developing just-in-time adaptive interventions. Health Psychol 34(S):1220

    Article  Google Scholar 

  • Korinek EV, Phatak SS, Martin CA, Freigoun MT, RiveraDE Adams MA, Klasnja P, Buman MP, Hekler EB (2018) Adaptive step goals and rewards: a longitudinal growthmodel of daily steps for a smartphone-based walking intervention. J Behav Med 41(1):74–86

    Article  Google Scholar 

  • Lara OD, Labrador MA (2012) A survey on human activity recognition using wearable sensors. IEEE Commun Surv Tutor 15(3):1192–1209

    Article  Google Scholar 

  • Lara OD, Labrador MA (2013) A survey on human activity recognition using wearable sensors. IEEE Commun Surv Tutor 15(3):1192–1209

    Article  Google Scholar 

  • Larson EC, Saba E, Kaiser S, Goel M, Patel SN (2017) Pulmonary monitoring using smartphones. In: Mobile Health, Springer, pp 239–264

  • Lei H, Tewari A, Murphy SA (2017) An actor-critic contextual bandit algorithm for personalized mobile health interventions. arXiv preprint arXiv:170609090

  • Liu YY, Moreno A, Li S, Li F, Song L, Rehg JM (2017) Learning continuous-time hidden markov models for event data. In: Mobile Health, Springer, pp 361–387

  • Lu H, Frauendorfer D, Rabbi M, Mast MS, Chittaranjan GT, Campbell AT, Gatica-Perez D, Choudhury T (2012) Stresssense: Detecting stress in unconstrained acoustic environments using smartphones. In: Proceedings of the 2012 ACM conference on ubiquitous computing, ACM, pp 351–360

  • Luers B, Klasnja P, Murphy S (2019) Standardized effect sizes for preventive mobile health interventions in micro-randomized trials. Prev Sci 20(1):100–109

    Article  Google Scholar 

  • MacLean D, Roseway A, Czerwinski M (2013) Moodwings: a wearable biofeedback device for real-time stress intervention. In: Proceedings of the 6th international conference on PErvasive technologies related to assistive environments, ACM, p 66

  • Maltzahn C, Jhala A, Mateas M, Whitehead J (2014) Gamification of private digital data archive management. In: Proceedings of the first international workshop on gamification for information retrieval, ACM, pp 33–37

  • McClain AD, Otten JJ, Hekler EB, Gardner CD (2013) Adherence to a low-fat vs. low-carbohydrate diet differs by insulin resistance status. Diabetes Obes Metab 15(1):87–90

    Article  Google Scholar 

  • Mishra V, Lowens B, Lord S, Caine K, Kotz D (2017) Investigating contextual cues as indicators for ema delivery. In: Proceedings of the 2017 ACM international joint conference on pervasive and ubiquitous computing and proceedings of the 2017 ACM international symposium on wearable computers, ACM, pp 935–940

  • Mohr DC, Tomasino KN, Lattie EG, Palac HL, Kwasny MJ, Weingardt K, Karr CJ, Kaiser SM, Rossom RC, Bardsley LR et al (2017) Intellicare: an eclectic, skills-based app suite for the treatment of depression and anxiety. J Med Internet Res 19(1):e10

    Article  Google Scholar 

  • Morrison LG, Hargood C, Pejovic V, Geraghty AW, Lloyd S, Goodman N, Michaelides DT, Weston A, Musolesi M, Weal MJ et al (2017) The effect of timing and frequency of push notifications on usage of a smartphone-based stress management intervention: An exploratory trial. PLoS One 12(1):e0169162

    Article  Google Scholar 

  • Murphy SA (2003) Optimal dynamic treatment regimes. J Roy Stat Soc 65(2):331–355

    Article  MathSciNet  MATH  Google Scholar 

  • Murray TWC (2016) Towards computational human behavior modeling for just-in-time adaptive interventions. PhD thesis, University of South Florida

  • Nahum-Shani I, Smith SN, Tewari A, Witkiewitz K, Collins LM, Spring B, Murphy S (2014) Just in time adaptive interventions (jitais): an organizing framework for ongoing health behavior support. Methodology Center technical report (14–126)

  • Nahum-Shani I, Smith SN, Spring BJ, Collins LM, Witkiewitz K, Tewari A, Murphy SA (2018) Just-in-timeadaptive interventions (jitais) in mobile health: key components and design principles for ongoing health behavior support. Ann Behav Med 52(6):446–462

    Article  Google Scholar 

  • Nazari G, Bobos P, MacDermid JC, Sinden KE, Richardson J, Tang A (2018) Psychometric properties of the zephyr bioharness device: a systematic review. BMC Sports Sci Med Rehabil 10(1):6

    Article  Google Scholar 

  • Ordóñez FJ, Roggen D (2016) Deep convolutional and lstm recurrent neural networks for multimodal wearable activity recognition. Sensors 16(1):115

    Article  Google Scholar 

  • Parate A, Ganesan D (2017) Detecting eating and smoking behaviors using smartwatches. In: Mobile Health, Springer, pp 175–201

  • Paredes P, Chan M (2011) Calmmenow: exploratory research and design of stress mitigating mobile interventions. In: CHI’11 extended abstracts on human factors in computing systems, ACM, pp 1699–1704

  • Paredes P, Gilad-Bachrach R, Czerwinski M, Roseway A, Rowan K, Hernandez J (2014) Poptherapy: coping with stress through pop-culture. In: Proceedings of the 8th international conference on pervasive computing technologies for healthcare, ICST (Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering), pp 109–117

  • Pejovic V, Musolesi M (2014) Interruptme: designing intelligent prompting mechanisms for pervasive applications. In: Proceedings of the 2014 ACM international joint conference on pervasive and ubiquitous computing, ACM, pp 897–908

  • Perera C, Zaslavsky A, Christen P, Georgakopoulos D (2014) Context aware computing for the internet of things: a survey. IEEE Commun Surv Tutor 16(1):414–454

    Article  Google Scholar 

  • Petersen C, DeMuro P (2015) Legal and regulatory considerations associated with use of patient-generated health data from social media and mobile health (mhealth) devices. Appl Clin Inf 6(1):16

    Article  Google Scholar 

  • Plarre K, Raij A, Hossain SM, Ali AA, Nakajima M, Al’absi M, Ertin E, Kamarck T, Kumar S, Scott M, et al. (2011) Continuous inference of psychological stress from sensory measurements collected in the natural environment. In: Information Processing in Sensor Networks (IPSN), 2011 10th International Conference on, IEEE, pp 97–108

  • Plews DJ, Scott B, Altini M, Wood M, Kilding AE, Laursen PB (2017) Comparison of heart-rate-variability recording with smartphone photoplethysmography, polar h7 cheststrap, and electrocardiography. Int J Sports Physiol Perform 12(10):1324–1328

    Article  Google Scholar 

  • Rehg JM, Murphy SA, Kumar S (2017) Mobile Health: sensors, analytic methods, and applications. Springer

    Book  Google Scholar 

  • Rivera DE (2012) Optimized behavioral interventions: What does system identification and control engineering have to offer? IFAC Proc Volumes 45(16):882–893

    Article  Google Scholar 

  • Rodenburg FJ, Sawada Y, Hayashi N (2019) Improving rnn performance by modelling informative missingness with combined indicators. Appl Sci 9(8):1623

    Article  Google Scholar 

  • Saleheen N, Ali AA, Hossain SM, Sarker H, Chatterjee S, Marlin B, Ertin E, Al’Absi M, Kumar S (2015) puffmarker: a multi-sensor approach for pinpointing the timing of first lapse in smoking cessation. In: Proceedings of the 2015 ACM international joint conference on pervasive and ubiquitous computing, ACM, pp 999–1010

  • Sano A, Johns P, Czerwinski M (2017) Designing opportune stress intervention delivery timing using multi-modal data. In: 2017 Seventh international conference on affective computing and intelligent interaction (ACII), IEEE, pp 346–353

  • Santos A, Macedo J, Costa A, Nicolau MJ (2014) Internet of things and smart objects for m-health monitoring and control. Procedia Technol 16:1351–1360

    Article  Google Scholar 

  • Sarker H, Sharmin M, Ali AA, Rahman MM, Bari R, Hossain SM, Kumar S (2014) Assessing the availability of users to engage in just-in-time intervention in the natural environment. In: Proceedings of the 2014 ACM international joint conference on pervasive and ubiquitous computing, ACM, pp 909–920

  • Sarker IH, Kabir MA, Colman A, Han J (2016) Predicting how you respond to phone calls: towards discovering temporal behavioral rules. In: Proceedings of the 28th Australian conference on computer-human interaction, ACM, pp 421–425

  • Shiffman S, Stone AA, Hufford MR (2008) Ecological Momentary Assessment. Annu Rev Clin Psychol 4:1–32

    Article  Google Scholar 

  • Smith SN, Lee AJ, Hall K, Seewald NJ, Boruvka A, Murphy SA, Klasnja P (2017) Design lessons from a micro-randomized pilot study in mobile health. In: Mobile Health, Springer, pp 59–82

  • Soley R et al (2000) Model driven architecture. OMG White Paper 308(308):5

    Google Scholar 

  • Steele R (2015) An overview of the state of the art of automated capture of dietary intake information. Crit Rev Food Sci Nutr 55(13):1929–1938

    Article  Google Scholar 

  • Steele R, Lo A, Secombe C, Wong YK (2009) Elderly persons’ perception and acceptance of using wireless sensor networks to assist healthcare. Int J Med Informatics 78(12):788–801

    Article  Google Scholar 

  • Stothart C, Mitchum A, Yehnert C (2015) The attentional cost of receiving a cell phone notification. J Exp Psychol Hum Percept Perform 41(4):893

    Article  Google Scholar 

  • Sutton RS, Barto AG (2018) Reinforcement learning: An introduction. MIT press

  • Swan M (2012) Sensor mania! the internet of things, wearable computing, objective metrics, and the quantified self 2.0. J Sens Actuat Netw 1(3):217–253

    Article  Google Scholar 

  • Teikari P, Najjar RP, Schmetterer L, Milea D (2019) Embedded deep learning in ophthalmology: making ophthalmic imaging smarter. Therapeutic Adv Ophthalmol 11:2515841419827172

    Article  Google Scholar 

  • Thomas JG, Bond DS (2015) Behavioral response to a just-in-time adaptive intervention (jitai) to reduce sedentary behavior in obese adults: Implications for jitai optimization. Health Psychol 34(S):1261

    Article  Google Scholar 

  • Thomaz E (2016) Automatic eating detection in real-world settings with commodity sensing. PhD thesis, Georgia Institute of Technology

  • Thomaz E, Essa IA, Abowd GD (2017) Challenges and opportunities in automated detection of eating activity. In: Mobile Health, Springer, pp 151–174

  • Upadhyay U, De A, Gomez-Rodrizuez M (2018) Deep reinforcement learning of marked temporal point processes. In: Proceedings of the 32nd international conference on neural information processing systems, pp 3172–3182

  • Wang Y, Ashktorab M, Chang HI, Wu X, Pottie G, Kaiser W (2017) Wearable motion sensing devices and algorithms for precise healthcare diagnostics and guidance. In: Mobile Health, Springer, pp 203–218

  • Yadav A, Soriano Marcolino L, Rice E, Petering R, Winetrobe H, Rhoades H, Tambe M, Carmichael H (2015) Psinet-an online pomdp solver for hiv prevention in homeless populations

  • Yom-Tov E, Feraru G, Kozdoba M, Mannor S, Tennen-holtz M, Hochberg I (2017) Encouraging physical activity in patients with diabetes: intervention using a reinforce-ment learning system. J Med Internet Res 19(10):e338

    Article  Google Scholar 

  • Yuan F, Gao X, Lindqvist J (2017) How busy are you?: Predicting the interruptibility intensity of mobile users. In: Proceedings of the 2017 CHI conference on human factors in computing systems, ACM, pp 5346–5360

  • Zaharia M, Chowdhury M, Franklin MJ, Shenker S, Stoica I et al (2010) Spark: cluster computing with working sets. HotCloud 10(10–10):95

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Florida Polytechnic University, Lakeland, USA

    Robert Steele, Trevor Hillsgrove, Navid Khoshavi & Luis G. Jaimes

Authors
  1. Robert Steele
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Trevor Hillsgrove
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Navid Khoshavi
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Luis G. Jaimes
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Luis G. Jaimes.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Steele, R., Hillsgrove, T., Khoshavi, N. et al. A survey of cyber-physical system implementations of real-time personalized interventions. J Ambient Intell Human Comput 13, 2325–2342 (2022). https://doi.org/10.1007/s12652-021-03263-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12652-021-03263-0

Keywords

Search

Navigation