Skip to main content

Wearable Sensor-Based Framework for the Detection of Daily Living Activities Utilizing In-Depth Features

  • Conference paper
  • First Online:
Machine Learning, Image Processing, Network Security and Data Sciences

Part of the book series: Lecture Notes in Electrical Engineering ((LNEE,volume 946))

  • 767 Accesses

Abstract

This paper implements the physical activity recognition model on 13 (sitting, standing, ironing, etc.) daily living activities using a 2D convolutional neural network (CNN). The model has outperformed the existing methods for the PAMAP2 and WISDM datasets. The various machine learning models are also implemented. These are SVM, Naïve Bayes, decision tree, and random forest. Average accuracy, F1 score, precision, and recall are the performance metrics used to evaluate the results. It is found in overall findings that convolutional neural networks have detected all the activities very precisely and accurately where machine learning models felt difficulty in classifying more accurately a particular activity. This difficulty of these machine learning models is addressed in this research by introducing CNN features in the training of machine learning models. Mean accuracy of 99.13 and 99.18% is achieved with convolutional neural network and Naïve Bayes with CNN features, respectively, for the PAMAP2 dataset. Mean accuracy of 98.01 and 98.09% is achieved with convolutional neural network and Naïve Bayes with CNN features, respectively, for the WISDM dataset.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 189.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 249.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 249.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Gu F, Khoshelham K, Valaee S, Shang J, Zhang R (2018) Locomotion activity recognition using stacked denoising autoencoders. IEEE Internet Things J 5(3):2085–2093. https://doi.org/10.1109/JIOT.2018.2823084

  2. Wang J, Chen Y, Hao S, Peng X, Hu L (2019) Deep learning for sensor-based activity recognition: a survey. Pattern Recogn Lett 119:3–11. https://doi.org/10.1016/j.patrec.2018.02.010

  3. Yu S, Chen H, Brown RA (2018) Hidden Markov model-based fall detection with motion sensor orientation calibration: a case for real-life home monitoring. IEEE J Biomed Heal Inform 22(6):1847–1853. https://doi.org/10.1109/JBHI.2017.2782079

  4. Townsend D, Knoefel F, Goubran R (2011) Privacy versus autonomy: a tradeoff model for smart home monitoring technologies. In: Proceedings of the annual international conference of the IEEE engineering in medicine and biology society. EMBS, pp 4749–4752. https://doi.org/10.1109/IEMBS.2011.6091176

  5. Gani MO et al (2019) A light weight smartphone based human activity recognition system with high accuracy. J Netw Comput Appl 141:59–72. https://doi.org/10.1016/j.jnca.2019.05.001

  6. John D, Sasaki J, Staudenmayer J, Mavilia M, Freedson PS (2013) Comparison of raw acceleration from the genea and actigraphTM GT3X + activity monitors. Sensors (Switzerland) 13(11):14754–14763. https://doi.org/10.3390/s131114754

  7. Montoye AHK et al (2018) Raw and count data comparability of hip-worn ActiGraph GT3X+ and link accelerometers. Med Sci Sports Exerc 50(5):1103–1112. https://doi.org/10.1249/MSS.0000000000001534

  8. Blanke U, Schiele B (2010) Remember and transfer what you have learned—recognizing composite activities based on activity spotting

    Google Scholar 

  9. Bulling A, Blanke U, Schiele B (2014) A tutorial on human activity recognition using body-worn inertial sensors. ACM Comput Surv 46(3):1–33. https://doi.org/10.1145/2499621

  10. Khan A, Hammerla N, Mellor S, Plötz T (2016) Optimising sampling rates for accelerometer-based human activity recognition. Pattern Recogn Lett 73:33–40. https://doi.org/10.1016/j.patrec.2016.01.001

  11. Blum AL, Langley P (1997) Artificial intelligence selection of relevant features and examples in machine. Artif Intell 97(1–2):245–271

    Article  MATH  Google Scholar 

  12. Gheyas IA, Smith LS (2010) Feature subset selection in large dimensionality domains. Pattern Recogn 43(1):5–13. https://doi.org/10.1016/j.patcog.2009.06.009

  13. Singh KP, Basant N, Gupta S (2011) Support vector machines in water quality management. Anal Chim Acta 703(2):152–162. https://doi.org/10.1016/j.aca.2011.07.027

  14. Preece SJ, Goulermas JY, Kenney LPJ, Howard D (2009) A comparison of different feature generation methods in activity classification.pdf 56(3):871–879

    Google Scholar 

  15. Guyon I, Gunn S, Nikravesh M, Zadeh LA (2008) Feature extraction: foundations and applications, vol 207. Springer

    Google Scholar 

  16. Liu Y, Zheng YF (2006) FS_SFS: a novel feature selection method for support vector machines. Pattern Recogn 39(7):1333–1345. https://doi.org/10.1016/j.patcog.2005.10.006

  17. Famili A, Shen WM, Weber R, Simoudis E (1997) Data preprocessing and intelligent data analysis. Intell Data Anal 1(1):3–23. https://doi.org/10.3233/IDA-1997-1102

  18. Liao C, Li S, Luo Z (2006) Gene selection for cancer classification using Wilcoxon rank sum test and support vector machine. In: 2006 international conference on computational intelligence and security ICCIAS 2006, vol 1, pp 368–373. https://doi.org/10.1109/ICCIAS.2006.294156

  19. Jin X, Xu A, Bie R, Guo P (2006) Machine learning techniques and chi-square feature selection for cancer classification using SAGE gene expression profiles. Lecture notes computer science (including subseries lecture notes artificial intelligence lecture notes bioinformatics), vol 3916 LNBI, pp 106–115. https://doi.org/10.1007/11691730_11

  20. Hua J, Tembe W, Dougherty ER (2008) Feature selection in the classification of high-dimension data. Department of Electrical & Computer Engineering, Texas A & M University, College Station, TX 77843, USA, pp 1–2

    Google Scholar 

  21. Biesiada J, Duch W (2007) Feature selection for high-dimensional data—a Pearson redundancy based filter. Adv Soft Comput 45:242–249. https://doi.org/10.1007/978-3-540-75175-5_30

  22. Peng H, Long F, Ding C (2005) Feature selection based on mutual information: criteria of max-dependency, max-relevance, and min-redundancy. IEEE Trans Pattern Anal Mach Intell 27(8):1226–1238. https://doi.org/10.1109/TPAMI.2005.159

  23. Rocchi L, Chiari L, Cappello A (2004) Feature selection of stabilometric parameters based on principal component analysis. Med Biol Eng Comput 42(1):71–79. https://doi.org/10.1007/BF02351013

  24. Peng J-X, Ferguson S, Rafferty K, Kelly PD (2011) An efficient feature selection method for mobile devices with application to activity recognition. Neurocomputing 74(17):3543–3552. https://doi.org/10.1016/j.neucom.2011.06.023

  25. Wang X, Yang J, Teng X, Xia W, Jensen R (2007) Feature selection based on rough sets and particle swarm optimization. Pattern Recogn Lett 28(4):459–471. https://doi.org/10.1016/j.patrec.2006.09.003

  26. Coley DA (1999) Writing a genetic algorithm. In: An introduction to genetic algorithms for scientists and engineers, pp 93–112. https://doi.org/10.1142/9789812386359_0005

  27. Sun L, Zhang D, Li B, Guo B, Li S (2010) Activity recognition on an accelerometer embedded mobile phone with varying positions and orientations. In: International conference on ubiquitous intelligence and computing, pp 548–562

    Google Scholar 

  28. Ayu MA, Mantoro T, Matin AFA, Basamh SSO (2011) Recognizing user activity based on accelerometer data from a mobile phone. In: ISCI 2011—2011 IEEE symposium on computers & informatics, pp 617–621. https://doi.org/10.1109/ISCI.2011.5958987

  29. Lau SL, David K (2010) Movement recognition using the accelerometer in smartphones. In: 2010 future network and mobile summit, pp 1–9

    Google Scholar 

  30. Bao L, Intille SS (2004) Activity recognition from user-annotated acceleration data BT—UbiComp 2002: ubiquitous computing. In: UbiComp 2002 Ubiquitous Computer, vol 3001, Chapter 1, pp 1–17

    Google Scholar 

  31. Yang AY, Iyengar S, Sastry S, Bajcsy R, Kuryloski P, Jafari R (2008) Distributed segmentation and classification of human actions using a wearable motion sensor network. In: 2008 IEEE computer society conference on computer vision and pattern recognition workshops (CVPRW). https://doi.org/10.1109/CVPRW.2008.4563176

  32. Uddin MZ, Khaksar W, Torresen J (2017) Facial expression recognition using salient features and convolutional neural network. IEEE Access 5:26146–26161. https://doi.org/10.1109/ACCESS.2017.2777003

  33. Uddin MZ, Hassan MM, Almogren A, Alamri A, Alrubaian M, Fortino G (2017) Facial expression recognition utilizing local direction-based robust features and deep belief network. IEEE Access 5:4525–4536. https://doi.org/10.1109/ACCESS.2017.2676238

  34. Kiranyaz S, Ince T, Gabbouj M (2016) Real-time patient-specific ECG classification by 1-D convolutional neural networks. IEEE Trans Biomed Eng 63(3):664–675. https://doi.org/10.1109/TBME.2015.2468589

  35. Cornacchia M, Ozcan K, Zheng Y, Velipasalar S (2017) A survey on activity detection and classification using wearable sensors. IEEE Sens J 17(2):386–403. https://doi.org/10.1109/JSEN.2016.2628346

  36. Ferrari A, Micucci D, Mobilio M, Napoletano P (2020) On the personalization of classification models for human activity recognition. IEEE Access 8:32066–32079. https://doi.org/10.1109/ACCESS.2020.2973425

  37. Zhang Y, Gao J, Zhou H (2020) Breeds classification with deep convolutional neural network. In: ACM international conference on machine learning and computing, pp 145–151. https://doi.org/10.1145/3383972.3383975

  38. Yann L, Yoshua B (1995) Convolutional networks for images, speech, and time-series 4:2571–2575

    Google Scholar 

  39. Kim SY, Han HG, Kim JW, Lee S, Kim TW (2017) A hand gesture recognition sensor using reflected impulses. IEEE Sens J 17(10):2975–2976. https://doi.org/10.1109/JSEN.2017.2679220

  40. Mario MO (2019) Human activity recognition based on single sensor square HV acceleration images and convolutional neural networks. IEEE Sens J 19(4):1487–1498. https://doi.org/10.1109/JSEN.2018.2882943

  41. Kim KG (2019) Deep learning book review. Nature 29(7553):1–73

    Google Scholar 

  42. Reiss A, Stricker D (2012) Pamap2 physical activity monitoring data set. UCI ML repository

    Google Scholar 

  43. Turk M, Pentland A (1991) Eigedces for recognition. J Cogn Neurosci 3(1)

    Google Scholar 

  44. Moghaddam B, Pentland A (1997) Probabilistic visual learning for object representation for object representation 19(7):696–710

    Google Scholar 

  45. Kirby M, Sirovich L (1990) Application of the Karhunen-Loéve procedure for the characterization of human faces. IEEE Trans Pattern Anal Mach Intell 12(1):103–108. https://doi.org/10.1109/34.41390

  46. Chen Y, Shen C (2017) Performance analysis of smartphone-sensor behavior for human activity recognition. IEEE Access 5:3095–3110. https://doi.org/10.1109/ACCESS.2017.2676168

  47. Berchtold M, Budde M, Schmidtke HR, Beigl M (2010) An extensible modular recognition concept that makes activity recognition practical. Lecture notes computer science (including subseries lecture notes artificial intelligence lecture notes bioinformatics), vol 6359 LNAI, pp 400–409. https://doi.org/10.1007/978-3-642-16111-7_46

  48. Wenfeng L, Longjin W, Daojin Y, Heng Y (2014) Fuzzy recognition of abnormal body behaviors based on motion feature analysis. J Huazhong Univ Sci Technol (Natural Sci Ed) 7:17

    Google Scholar 

  49. Tapia EM et al (2007) Real-time recognition of physical activities and their intensities using wireless accelerometers and a heart rate monitor. In: Proceedings—international symposium on wearable computers ISWC, pp 37–40. https://doi.org/10.1109/ISWC.2007.4373774

  50. Chen Z, Zhu Q, Soh YC, Zhang L (2017) Robust human activity recognition using smartphone sensors via CT-PCA and online SVM. IEEE Trans Ind Inform 13(6):3070–3080. https://doi.org/10.1109/TII.2017.2712746

  51. Ma C, Li W, Cao J, Du J, Li Q, Gravina R (2020) Adaptive sliding window based activity recognition for assisted livings. Inf Fusion 53:55–65. https://doi.org/10.1016/j.inffus.2019.06.013

Download references

Conflict of Interest

There is no conflict of interest.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Updesh Verma .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Verma, U., Tyagi, P., Kaur, M. (2023). Wearable Sensor-Based Framework for the Detection of Daily Living Activities Utilizing In-Depth Features. In: Doriya, R., Soni, B., Shukla, A., Gao, XZ. (eds) Machine Learning, Image Processing, Network Security and Data Sciences. Lecture Notes in Electrical Engineering, vol 946. Springer, Singapore. https://doi.org/10.1007/978-981-19-5868-7_11

Download citation

  • DOI: https://doi.org/10.1007/978-981-19-5868-7_11

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-19-5867-0

  • Online ISBN: 978-981-19-5868-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics