Skip to main content
SpringerLink
Log in

SleepLess: personalized sleep monitoring using smartphones and semi-supervised learning

  • Original Research
  • Published:
CSI Transactions on ICT Aims and scope Submit manuscript

Abstract

Sleep affects our bodily functions and is critical in promoting every individual’s well-being. To that end, sleep health monitoring research has gained interest recently, including coupling data-driven AI techniques with mHealth adaptations of wearable, smartphone, and contactless-sensing modalities. Regardless, prior works, by and large, require gathering sufficient ground truth data to develop personalized and highly accurate sleep prediction models. This requirement inherently presents a challenge of such models underperforming when inferring sleep on new users without labeled data. In this paper, we propose SleepLess, which uses a semi-supervised learning pipeline over unlabeled data sensed from the user’s smartphone network activity to develop personalized models and detect their sleep duration for the night. Specifically, it uses a pre-trained model on an existing set of users to produce pseudo labels for unlabeled data of a new user and achieves personalization by fine-tuning over selectively picking the pseudo labels. Our IRB-approved user study found SleepLess model yielding around 96% accuracy, between 12–27 min of sleep time error and 18–25 min of wake time error. Comparison against other approaches that sought to predict with fewer labeled data found SleepLess, similarly yielding best performance. Our study demonstrates the feasibility of achieving personalized sleep prediction models by utilizing unlabeled data extracted from network activity of users’ smartphones, using a semi-supervised approach.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Algorithm 1
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13

Similar content being viewed by others

Notes

  1. Our approach can be applied to other types of phone activity data such as screen activity. Here, phone activity data is represented by network activity rate.

References

  1. Ohayon MM (2011) Epidemiological overview of sleep disorders in the general population. Sleep Med Res 2(1):1–9

    Article  Google Scholar 

  2. Krueger PM, Friedman EM (2009) Sleep duration in the United States: a cross-sectional population-based study. Am J Epidemiol 169(9):1052–1063

    Article  Google Scholar 

  3. Google I (2022). https://www.fitbit.com/global/be/products/trackers/inspire. Accessed 27 Oct 2022

  4. inc (2022). https://ouraring.com/. Accessed 27 Oct 2022

  5. Rahman T, Adams AT, Ravichandran RV, Zhang M, Patel SN, Kientz JA, Choudhury T (2015) Dopplesleep: a contactless unobtrusive sleep sensing system using short-range Doppler radar. In: Proceedings of the 2015 ACM international joint conference on pervasive and ubiquitous computing, pp 39–50

  6. Google I (2022). https://support.google.com/googlenest/answer/10388741?hl=en. Accessed 27 Oct 2022

  7. Amazon I (2022). https://www.amazon.com/Paschar-LLC-Walabot-Sleep-Tracker/dp/B07C2HRYSX. Accessed 27 Oct 2022

  8. Dixon M, Schneider L, Yu J, Hsu J, Pathak A, Shin D, Lee RS, Malhotra MR, Mixter K, McConnell M, Taylor J, Patel S (2021) Sleep-wake detection with a contactless, bedside radar sleep sensing system. Technical report

  9. Abdullah S, Matthews M, Murnane EL, Gay G, Choudhury T (2014) Towards circadian computing: “early to bed and early to rise” makes some of us unhealthy and sleep deprived. In: Proceedings of the 2014 ACM international joint conference on pervasive and ubiquitous computing, pp 673–684

  10. Zakaria C, Yilmaz G, Mammen P, Chee M, Shenoy P, Balan R (2022) Sleepmore: sleep prediction at scale via multi-device wifi sensing. arXiv preprint arXiv:2210.14152

  11. Zhao Y, Liu H, Li H, Barnaghi P, Haddadi H (2020) Semi-supervised federated learning for activity recognition. arXiv preprint arXiv:2011.00851

  12. Trivedi A, Zakaria C, Balan R, Becker A, Corey G, Shenoy P (2021) Wifitrace: network-based contact tracing for infectious diseases using passive wifi sensing. In: Proceedings of the ACM on interactive, mobile, wearable and ubiquitous technologies, vol 5(1), pp 1–26

  13. Min JK, Doryab A, Wiese J, Amini S, Zimmerman J, Hong JI (2014) Toss’n’turn: smartphone as sleep and sleep quality detector. In: Proceedings of the SIGCHI conference on human factors in computing systems, pp 477–486

  14. inc A (2023). https://developers.google.com/location-context/sleep. Accessed 17 Aug 2023

  15. inc (2023). http://autosleep.tantsissa.com/home. Accessed 17 Aug 2023

  16. rise (2023). https://www.risescience.com/. Accessed 17 Aug 2023

  17. Mammen PM, Zakaria C, Molom-Ochir T, Trivedi A, Shenoy P, Balan R (2021) Wisleep: inferring sleep duration at scale using passive wifi sensing. arXiv preprint arXiv:2102.03690

  18. Dhamija AR, Günther M, Boult T (2018) Reducing network agnostophobia. In: Advances in neural information processing systems, vol 31

  19. Python I (2022). https://www.python.org/. Accessed 27 Oct 2022

  20. keras I (2022). https://keras.io/. Accessed 27 Oct 2022

  21. Saeb S, Cybulski TR, Schueller SM, Kording KP, Mohr DC et al (2017) Scalable passive sleep monitoring using mobile phones: opportunities and obstacles. J Med Int Res 19(4):118

    Google Scholar 

  22. Chen M, Du Y, Zhang Y, Qian S, Wang C (2022) Semi-supervised learning with multi-head co-training. In: Proceedings of the AAAI conference on artificial intelligence, vol 36, pp 6278–6286

  23. Bhattacharya S, Nurmi P, Hammerla N, Plötz T (2014) Using unlabeled data in a sparse-coding framework for human activity recognition. Pervasive Mob Comput 15:242–262

    Article  Google Scholar 

  24. Haoran B, Guanze L (2021) Semi-supervised end-to-end automatic sleep stage classification based on pseudo-label. In: 2021 IEEE international conference on power electronics, computer applications (ICPECA), pp. 83–87. IEEE

  25. Zhang C, Yu W, Li Y, Sun H, Zhang Y, De Vos M (2022) Cms2-net: semi-supervised sleep staging for diverse obstructive sleep apnea severity. IEEE J Biomed Health Inform 26(7):3447–3457

    Article  Google Scholar 

  26. Li Y, Peng C, Zhang Y, Zhang Y, Lo B (2022) Adversarial learning for semi-supervised pediatric sleep staging with single-EEG channel. Methods 204:84–91

    Article  Google Scholar 

  27. Munk AM, Olesen KV, Gangstad SW, Hansen LK (2018) Semi-supervised sleep-stage scoring based on single channel EEG. In: 2018 IEEE international conference on acoustics, speech and signal processing (ICASSP), pp 2551–2555. IEEE

  28. Gu W, Shangguan L, Yang Z, Liu Y (2015) Sleep hunter: towards fine grained sleep stage tracking with smartphones. IEEE Trans Mob Comput 15(6):1514–1527

    Article  Google Scholar 

  29. Hao T, Xing G, Zhou G (2013) isleep: unobtrusive sleep quality monitoring using smartphones. In: Proceedings of the 11th ACM conference on embedded networked sensor systems, pp 1–14

  30. Ren Y, Wang C, Yang J, Chen Y (2015) Fine-grained sleep monitoring: hearing your breathing with smartphones. In: 2015 IEEE conference on computer communications (INFOCOM), pp 1194–1202. IEEE

  31. Cuttone A, Bakgaard P, Sekara V, Jonsson H, Larsen JE, Lehmann S (2017) Sensiblesleep: a bayesian model for learning sleep patterns from smartphone events. PloS One 12(1):e0169901

    Article  Google Scholar 

  32. Zhenyu C, Lane N, Cardone G, Lin M, Choudhury T, Campbell A (2013) Unobtrusive sleep monitoring using smartphones. In: Proceedings of pervasive health

  33. Wang R, Chen F, Chen Z, Li T, Harari G, Tignor S, Zhou X, Ben-Zeev D, Campbell AT (2014) Studentlife: assessing mental health, academic performance and behavioral trends of college students using smartphones. In: Proceedings of the 2014 ACM international joint conference on pervasive and ubiquitous computing, pp 3–14

  34. Wang X, Huang R, Yang C, Mao S (2021) Smartphone sonar-based contact-free respiration rate monitoring. ACM Trans Comput Healthc 2(2):1–26

    Article  Google Scholar 

  35. Tiron R, Lyon G, Kilroy H, Osman A, Kelly N, O’Mahony N, Lopes C, Coffey S, McMahon S, Wren M et al (2020) Screening for obstructive sleep apnea with novel hybrid acoustic smartphone app technology. J Thorac Dis 12(8):4476

    Article  Google Scholar 

  36. Kim DH, Kim SW, Hwang SH (2022) Diagnostic value of smartphone in obstructive sleep apnea syndrome: a systematic review and meta-analysis. PLoS ONE 17(5):0268585

    Article  Google Scholar 

  37. Hofman JM, Sharma A, Watts DJ (2017) Prediction and explanation in social systems. Science 355(6324):486–488

    Article  Google Scholar 

  38. Rundo JV, Downey R III (2019) Polysomnography. Handb Clin Neurol 160:381–392

    Article  Google Scholar 

  39. inc A (2022). https://www.apple.com/watch/. Accessed 27 Oct 2022

  40. Witt DR, Kellogg RA, Snyder MP, Dunn J (2019) Windows into human health through wearables data analytics. Curr Opin Biomed Eng 9:28–46

    Article  Google Scholar 

  41. Lee YS, Pathirana PN, Steinfort CL, Caelli T (2014) Monitoring and analysis of respiratory patterns using microwave Doppler radar. IEEE J Transl Eng Health Med 2:1–12

    Article  Google Scholar 

  42. Gu C, Li C (2015) Assessment of human respiration patterns via noncontact sensing using Doppler multi-radar system. Sensors 15(3):6383–6398

    Article  Google Scholar 

  43. Lin F, Zhuang Y, Song C, Wang A, Li Y, Gu C, Li C, Xu W (2016) Sleepsense: a noncontact and cost-effective sleep monitoring system. IEEE Trans Biomed Circuits Syst 11(1):189–202

    Article  Google Scholar 

  44. Hong H, Zhang L, Zhao H, Chu H, Gu C, Brown M, Zhu X, Li C (2019) Microwave sensing and sleep: noncontact sleep-monitoring technology with microwave biomedical radar. IEEE Microw Mag 20(8):18–29

    Article  Google Scholar 

  45. De Zambotti M, Cellini N, Goldstone A, Colrain IM, Baker FC (2019) Wearable sleep technology in clinical and research settings. Med Sci Sports Exerc 51(7):1538

    Article  Google Scholar 

  46. Yalniz IZ, Jégou H, Chen K, Paluri M, Mahajan D (2019) Billion-scale semi-supervised learning for image classification. arXiv preprint arXiv:1905.00546

  47. Zou Y, Yu Z, Kumar B, Wang J (2018) Unsupervised domain adaptation for semantic segmentation via class-balanced self-training. In: Proceedings of the European conference on computer vision (ECCV), pp 289–305

  48. Zhang C, Bengio S, Hardt M, Recht B, Vinyals O (2021) Understanding deep learning (still) requires rethinking generalization. Commun ACM 64(3):107–115

    Article  Google Scholar 

  49. Zhou Z-H, Li M (2010) Semi-supervised learning by disagreement. Knowl Inf Syst 24(3):415–439

    Article  Google Scholar 

  50. Wang W, Zhou ZH (2007) Analyzing co-training style algorithms. In: European conference on machine learning, pp 454–465. Springer

  51. Guan D, Yuan W, Lee YK, Gavrilov A, Lee S (2007) Activity recognition based on semi-supervised learning. In: 13th IEEE international conference on embedded and real-time computing systems and applications (RTCSA 2007), pp 469–475. IEEE

  52. Faridee AZM, Chakma A, Misra A, Roy N (2022) Strangan: adversarially-learnt spatial transformer for scalable human activity recognition. Smart Health 23:100226

    Article  Google Scholar 

  53. Gogna A, Majumdar A (2016) Semi supervised autoencoder. In: International conference on neural information processing, pp 82–89. Springer

Download references

Author information

Authors and Affiliations

  1. University of Massachusetts Amherst, Amherst, USA

    Priyanka Mary Mammen & Prashant Shenoy

  2. University of Toronto, Toronto, Canada

    Camellia Zakaria

Authors
  1. Priyanka Mary Mammen
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Camellia Zakaria
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Prashant Shenoy
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Priyanka Mary Mammen.

Ethics declarations

Conflict of interest

On behalf of all authors, the corresponding author states that there is no conflict of interest.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Mammen, P.M., Zakaria, C. & Shenoy, P. SleepLess: personalized sleep monitoring using smartphones and semi-supervised learning. CSIT 11, 203–219 (2023). https://doi.org/10.1007/s40012-023-00389-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s40012-023-00389-8

Keywords

Search

Navigation