Sleep behavior assessment via smartwatch and stigmergic receptive fields

  • Antonio L. Alfeo
  • Paolo Barsocchi
  • Mario G. C. A. Cimino
  • Davide La Rosa
  • Filippo Palumbo
  • Gigliola Vaglini
Original Article

Abstract

Sleep behavior is a key factor in maintaining good physiological and psychological health. A well-known approach to monitor sleep is polysomnography. However, it is costly and intrusive, which may disturb sleep. Consequently, polysomnography is not suitable for sleep behavior analysis. Other approaches are based on actigraphy and sleep diary. Although being a good source of information for sleep quality assessment, sleep diaries can be affected by cognitive bias related to subject’s sleep perception, while actigraphy overestimates sleep periods and night-time disturbance compared to sleep diaries. Machine learning techniques can improve the objectivity and reliability of the observations. However, since signal morphology vary widely between people, conventional machine learning is complex to set up. In this regard, we present an adaptive, reliable, and innovative computational approach to provide per-night assessment of sleep behavior to the end-user. We exploit heartbeat rate and wrist acceleration data, gathered via smartwatch, in order to identify subject’s sleep behavioral pattern. More specifically, heartbeat rate and wrist motion samples are processed via computational stigmergy, a bio-inspired scalar and temporal aggregation of samples. Stigmergy associates each sample to a digital pheromone deposit (mark) defined in a mono-dimensional space and characterized by evaporation over time. As a consequence, samples close in terms of time and intensity are aggregated into functional structures called trails. The stigmergic trails allow to compute the similarity between time series on different temporal scales, to support classification or clustering processes. The overall computing schema includes a parametric optimization for adapting the structural parameters to individual sleep dynamics. The outcome is a similarity between sleep nights of the same subject, to generate clusters of nights with different quality levels. Experimental results are shown for three real-world subjects. The resulting similarity is also compared with the dynamic time warping, a popular similarity measure for time series.

Keywords

Sleep monitoring Smartwatch Stigmergy Neural receptive field 

References

  1. 1.
    Åkerstedt T, Hume K, Minors D, Waterhouse J (1994) The meaning of good sleep: a longitudinal study of polysomnography and subjective sleep quality. J Sleep Res 3(3):152–158CrossRefGoogle Scholar
  2. 2.
    Cimino AL, Alfeo MGCAGV (2017) Measuring physical activity of older adults via smartwatch and stigmergic receptive fields. In: INSTICC the 6th international conference on pattern recognition applications and methods (ICPRAM 2017), pp 724–730Google Scholar
  3. 3.
    Allen J (2007) Photoplethysmography and its application in clinical physiological measurement. Physiol Measur 28(3):R1CrossRefGoogle Scholar
  4. 4.
    American Sleep Disorders Association et al (1995) Practice parameters for the use of actigraphy in the clinical assessment of sleep disorders. Sleep 18(4):285–287CrossRefGoogle Scholar
  5. 5.
    Ansari N, Hou ES, Zhu BO, Chen JG (1996) Adaptive fusion by reinforcement learning for distributed detection systems. IEEE Trans Aerosp Electron Syst 32(2):524–531CrossRefGoogle Scholar
  6. 6.
    Avvenuti M, Cesarini D, Cimino MG (2013) Mars, a multi-agent system for assessing rowers’ coordination via motion-based stigmergy. Sensors 13(9):12,218–12,243CrossRefGoogle Scholar
  7. 7.
    Barbon G, Margolis M, Palumbo F, Raimondi F, Weldin N (2016) Taking Arduino to the internet of things: the ASIP programming model. Comput CommunGoogle Scholar
  8. 8.
    Barsocchi P, Cimino MG, Ferro E, Lazzeri A, Palumbo F, Vaglini G (2015) Monitoring elderly behavior via indoor position-based stigmergy. Pervasive Mob Comput 23:26–42CrossRefGoogle Scholar
  9. 9.
    Barsocchi P, Ferro E, Fortunati L, Mavilia F, Palumbo F (2014) EMS@CNR: an energy monitoring sensor network infrastructure for in-building location-based services. In: 2014 International conference on high performance computing & simulation (HPCS). IEEE, pp 857–862Google Scholar
  10. 10.
    Bernardeschi C, Cimino MG, Domenici A, Vaglini G (2016) Using smartwatch sensors to support the acquisition of sleep quality data for supervised machine learning. In: The 6th EAI international conference on wireless mobile communication and healthcare (MOBIHEALTH 2016). EAI, pp 1–8Google Scholar
  11. 11.
    Blackwell T, Redline S, Ancoli-Israel S, Schneider JL, Surovec S, Johnson NL, Cauley JA, Stone KL (2008) Comparison of sleep parameters from actigraphy and polysomnography in older women: the SOF study. Sleep-New York Then Westchester- 31(2):283Google Scholar
  12. 12.
    Bootzin RR, Engle-Friedman M (1981) The assessment of insomnia. Behav Assess 3(2):107–126Google Scholar
  13. 13.
    Borazio M, Berlin E, Kücükyildiz N, Scholl P, Van Laerhoven K (2014) Towards benchmarked sleep detection with wrist-worn sensing units. In: 2014 IEEE international conference on healthcare informatics (ICHI). IEEE, pp 125–134Google Scholar
  14. 14.
    Bottou L (2010) Large-scale machine learning with stochastic gradient descent. In: Proceedings of COMPSTAT’2010. Springer, pp 177–186Google Scholar
  15. 15.
    Chen Z, Lin M, Chen F, Lane ND, Cardone G, Wang R, Li T, Chen Y, Choudhury T, Campbell AT (2013) Unobtrusive sleep monitoring using smartphones. In: 2013 7th International conference on pervasive computing technologies for healthcare and workshops. IEEE, pp 145–152Google Scholar
  16. 16.
    Chesson A, Ferber RA, Fry J M, Grigg-Damberger M, Hartse K, Hurwitz T, Johnson S, Littner M, Kader G, Rosen G et al (1997) Practice parameters for the indications for polysomnography and related procedures. Sleep 20(6):406–422CrossRefGoogle Scholar
  17. 17.
    Choi DJ, Choi MS, Kang SJ (2016) A wearable device platform for the estimation of sleep quality using simultaneously motion tracking and pulse oximetry. In: 2016 IEEE international conference on consumer electronics (ICCE). IEEE, pp 49–50Google Scholar
  18. 18.
    Cimino MG, Lazzeri A, Vaglini G (2015) Improving the analysis of context-aware information via marker-based stigmergy and differential evolution. In: International conference on artificial intelligence and soft computing. Springer, pp 341–352Google Scholar
  19. 19.
    Cimino MG, Lazzerini B, Marcelloni F (2006) A novel approach to fuzzy clustering based on a dissimilarity relation extracted from data using a TS system. Pattern Recog 39(11):2077–2091CrossRefMATHGoogle Scholar
  20. 20.
    Cola G, Avvenuti M, Musso F, Vecchio A (2016) Gait-based authentication using a wrist-worn device. In: Proceedings of the 13th international conference on mobile and ubiquitous systems: computing, networking and services. ACM, pp 208–217Google Scholar
  21. 21.
    Cola G, Avvenuti M, Vecchio A, Yang GZ, Lo B (2015) An on-node processing approach for anomaly detection in gait. IEEE Sensors J 15(11):6640–6649CrossRefGoogle Scholar
  22. 22.
    Cooper G, Herskovits E (1992) A Bayesian method for the induction of probabilistic networks from data. Mach Learn 9(4):309–347MATHGoogle Scholar
  23. 23.
    Di Rienzo M, Vaini E, Lombardi P (2015) Wearable monitoring: a project for the unobtrusive investigation of sleep physiology aboard the international space station. In: 2015 computing in cardiology conference (CinC). IEEE, pp 125–128Google Scholar
  24. 24.
    Ding H, Trajcevski G, Scheuermann P, Wang X, Keogh E (2008) Querying and mining of time series data: experimental comparison of representations and distance measures. Proc VLDB Endow 1(2):1542–1552CrossRefGoogle Scholar
  25. 25.
    Esling P, Agon C (2012) Time-series data mining. ACM Comput Surv (CSUR) 45(1):12CrossRefMATHGoogle Scholar
  26. 26.
    Espie CA, Lindsay WR, Espie LC (1989) Use of the Sleep Assessment Device (Kelley and Lichstein, 1980) to validate insomniacs’ self-report of sleep pattern. J Psychopathol Behav Assess 11(1):71–79CrossRefGoogle Scholar
  27. 27.
    Fabeck G, Mathar R (2008) Kernel-based learning of decision fusion in wireless sensor networks. In: 2008 11th international conference on information fusion. IEEE, pp 1–7Google Scholar
  28. 28.
    Figo D, Diniz PC, Ferreira DR, Cardoso JM (2010) Preprocessing techniques for context recognition from accelerometer data. Pers Ubiquit Comput 14(7):645–662CrossRefGoogle Scholar
  29. 29.
    Frankel B, Coursey R, Buchbinder R, Snyder F (1976) Recorded and reported sleep in primary chronic insomnia. Arch Gen Psychiat 33:615–23CrossRefGoogle Scholar
  30. 30.
    Gjoreski M, Gjoreski H, Luṡtrek M, Gams M (2016) How accurately can your wrist device recognize daily activities and detect falls? Sensors 16(6):800CrossRefGoogle Scholar
  31. 31.
    Haescher M, Trimpop J, Bieber G, Urban B (2016) Smartmove: a smartwatch algorithm to distinguish between high-and low-amplitude motions as well as doffed-states by utilizing noise and sleep. In: Proceedings of the 3rd international workshop on sensor-based activity recognition and interaction. ACM, p 1Google Scholar
  32. 32.
    Hager GD (2012) Task-directed sensor fusion and planning: a computational approach, vol 99. Springer Science & Business MediaGoogle Scholar
  33. 33.
    Hall M, Frank E, Holmes G, Pfahringer B, Reutemann P, Witten IH (2009) The WEKA data mining software: an update. ACM SIGKDD Explor Newslett 11(1):10–18CrossRefGoogle Scholar
  34. 34.
    Heath MT (2002) Scientific computing: an introductory survey, vol 2. McGraw-Hill, New YorkGoogle Scholar
  35. 35.
    Hossain MA, Atrey PK, El Saddik A (2009) Learning multisensor confidence using a reward-and-punishment mechanism. IEEE Trans Instrum Meas 58(5):1525–1534CrossRefGoogle Scholar
  36. 36.
    Huang X, Oviatt S (2005) Toward adaptive information fusion in multimodal systems. In: International workshop on machine learning for multimodal interaction. Springer, pp 15– 27Google Scholar
  37. 37.
    Jeong CW, Joo SC, Jeong YS (2013) Sleeping situation monitoring system in ubiquitous environments. Person Ubiq Comput 17(7):1357–1364MathSciNetCrossRefGoogle Scholar
  38. 38.
    Johns MW et al (1991) A new method for measuring daytime sleepiness: the Epworth sleepiness scale. Sleep 14(6):540– 545CrossRefGoogle Scholar
  39. 39.
    Khaleghi B, Khamis A, Karray FO, Razavi SN (2013) Multisensor data fusion: a review of the state-of-the-art. Inform Fus 14(1):28–44CrossRefGoogle Scholar
  40. 40.
    Kohavi R (1995) The power of decision tables. In: European conference on machine learning. Springer, pp 174–189Google Scholar
  41. 41.
    Liang Z, Ploderer B, Liu W, Nagata Y, Bailey J, Kulik L, Li Y (2016) Sleepexplorer: a visualization tool to make sense of correlations between personal sleep data and contextual factors. Pers Ubiquit Comput 20(6):985–1000CrossRefGoogle Scholar
  42. 42.
    Lockley SW, Skene DJ, Arendt J (1999) Comparison between subjective and actigraphic measurement of sleep and sleep rhythms. J Sleep Res 8(3):175–183CrossRefGoogle Scholar
  43. 43.
    Majoe D, Bonhof P, Kaegi-Trachsel T, Gutknecht J, Widmer L (2010) Stress and sleep quality estimation from a smart wearable sensor. In: 2010 5th international conference on pervasive computing and applications (ICPCA). IEEE, pp 14–19Google Scholar
  44. 44.
    Mannheimer PD, Cascini J, Fein ME, Nierlich SL (1997) Wavelength selection for low-saturation pulse oximetry. IEEE Trans Biomed Eng 44(3):148–158CrossRefGoogle Scholar
  45. 45.
    Maquet P (2001) The role of sleep in learning and memory. Science 294(5544):1048–1052CrossRefGoogle Scholar
  46. 46.
    Metsis V, Kosmopoulos D, Athitsos V, Makedon F (2014) Non-invasive analysis of sleep patterns via multimodal sensor input. Person Ubiquit Comput 18(1):19–26CrossRefGoogle Scholar
  47. 47.
    Miwa H, Sasahara SI, Matsui T (2007) Roll-over detection and sleep quality measurement using a wearable sensor. In: 2007 29th annual international conference of the IEEE engineering in medicine and biology society. IEEE, pp 1507–1510Google Scholar
  48. 48.
    Monk T, Buysse D, Kennedy K, Potts J, DeGrazia J, Miewald J (2003) Measuring sleep habits without using a diary: the sleep timing questionnaire (STQ). Sleep 26(2):208–12CrossRefGoogle Scholar
  49. 49.
    Ohayon MM, Carskadon MA, Guilleminault C, Vitiello MV (2004) Meta-analysis of quantitative sleep parameters from childhood to old age in healthy individuals: developing normative sleep values across the human lifespan. Sleep-New York Then Westchester- 27:1255–1274Google Scholar
  50. 50.
    Ong AA, Gillespie MB (2016) Overview of smartphone applications for sleep analysis. World J Otorhinolaryngol-Head Neck Surg 2(1):45–49CrossRefGoogle Scholar
  51. 51.
    Palumbo F, Gallicchio C, Pucci R, Micheli A (2016) Human activity recognition using multisensor data fusion based on reservoir computing. J Ambient Intell Smart Environ 8(2):87–107CrossRefGoogle Scholar
  52. 52.
    Palumbo F, La Rosa D, Chessa S (2014) Gp-m: mobile middleware infrastructure for ambient assisted living. In: 2014 IEEE symposium on computers and communications (ISCC). IEEE, pp 1–6Google Scholar
  53. 53.
    Phan D, Siong LY, Pathirana PN, Seneviratne A (2015) Smartwatch: performance evaluation for long-term heart rate monitoring. In: 2015 International symposium on bioelectronics and bioinformatics (ISBB). IEEE, pp 144–147Google Scholar
  54. 54.
    Preece SJ, Goulermas JY, Kenney LP, Howard D (2009) A comparison of feature extraction methods for the classification of dynamic activities from accelerometer data. IEEE Trans Biomed Eng 56(3):871–879CrossRefGoogle Scholar
  55. 55.
    Quinlan JR (1986) Induction of decision trees. Mach Learn 1:81–106Google Scholar
  56. 56.
    Sadeh A (2011) The role and validity of actigraphy in sleep medicine: an update. Sleep Med Rev 15(4):259–267CrossRefGoogle Scholar
  57. 57.
    Sadeh A, Hauri PJ, Kripke DF, Lavie P (1995) The role of actigraphy in the evaluation of sleep disorders. Sleep 18(4):288–302CrossRefGoogle Scholar
  58. 58.
    Shaeffer DK (2013) MEMS inertial sensors: a tutorial overview. IEEE Commun Mag 51(4):100–109CrossRefGoogle Scholar
  59. 59.
    Shalev-Shwartz S, Singer Y, Srebro N (2007) Pegasos: primal estimated sub-gradient solver for SVM. In: Proceedings of the 24th international conference on machine learning. ACM, pp 807–814Google Scholar
  60. 60.
    Snoek J, Larochelle H, Adams RP (2012) Practical Bayesian optimization of machine learning algorithms. In: Advances in neural information processing systems, pp 2951–2959Google Scholar
  61. 61.
    Vernon D, Metta G, Sandini G (2007) A survey of artificial cognitive systems: implications for the autonomous development of mental capabilities in computational agents. IEEE Trans Evol Comput 11(2):151–180CrossRefGoogle Scholar
  62. 62.
    Wilson KG, Watson ST, Currie SR (1998) Daily diary and ambulatory activity monitoring of sleep in patients with insomnia associated with chronic musculoskeletal pain. Pain 75(1):75–84CrossRefGoogle Scholar
  63. 63.
    de Zambotti M, Baker FC, Willoughby AR, Godino JG, Wing D, Patrick K, Colrain IM (2016) Measures of sleep and cardiac functioning during sleep using a multi-sensory commercially-available wristband in adolescents. Physiol Behav 158:143–149Google Scholar
  64. 64.
    de Zambotti M, Claudatos S, Inkelis S, Colrain IM, Baker FC (2015) Evaluation of a consumer fitness-tracking device to assess sleep in adults. Chronobiol Int 32(7):1024–1028Google Scholar
  65. 65.
    Zhang X, Liu J, Du Y, Lv T (2011) A novel clustering method on time series data. Expert Syst Appl 38(9):11,891–11,900CrossRefGoogle Scholar

Copyright information

© Springer-Verlag London Ltd. 2017

Authors and Affiliations

  • Antonio L. Alfeo
    • 1
  • Paolo Barsocchi
    • 2
  • Mario G. C. A. Cimino
    • 1
  • Davide La Rosa
    • 2
  • Filippo Palumbo
    • 2
  • Gigliola Vaglini
    • 1
  1. 1.Department of Information EngineeringUniversity of PisaPisaItaly
  2. 2.National Research CouncilInstitute of Information Science and TechnologiesPisaItaly

Personalised recommendations