Skip to main content

Comparison of offline and real-time human activity recognition results using machine learning techniques

Neural Computing and Applications volume 32, pages 15673–15686 (2020)Cite this article

Abstract

Today’s human activity recognition is an important part of healthcare and ambient-assisted living where accelerometer and gyroscope sensors provide the raw data about physical activities and functional abilities of an observed person. Previous studies have shown that activity recognition can be seen as a machine learning chain with its particular data preprocessing technique. In recent past, several scientists measured rather high recognition accuracies on public databases or in laboratory environment but their solutions have not been tested in real environment. The goal of this paper is to examine the efficiency of previously used machine learning methods in real time by an Android-based, self-learning, activity recognition application which has been designed especially to this study according to the latest theoretical results (with the most relevant feature extraction and machine learning algorithms). Before real-time tests, we investigated the design considerations and application possibilities of different shallow and deep methods. The final outcome shows recognition rate difference between the “online” and “offline” cases. In the article we present some reasons for the difference and their possible solutions.

This is a preview of subscription content, access via your institution.

Access options

Buy single article

Instant access to the full article PDF.

USD 39.95

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

References

  1. Paillard-Borg S, Wang HX, Winblad B, Fratiglioni L (2008) Pattern of participation in leisure activities among older people in relation to their health conditions and contextual factors: a survey in Swedish urban area. Ageing Soc 29:803–821

    Article  Google Scholar 

  2. Godfrey A, Conway R, Meagher D, Olaighin G (2008) Direct measurement of human movement by accelerometry. Med Eng Phys 30:1364–1386

    Article  Google Scholar 

  3. Sebestyen G, Tirea A, Albert R (2012) Monitoring human activity through portable devices. Carpathian J Electron Comput Eng 5:101–106

    Google Scholar 

  4. Maurer U, Smailagic A, Siewiorek DP, Deisher M (2006) Activity recognition and monitoring using multiple sensors on different body positions. In: Proceedings of the international workshop on wearable and implementable body sensor networks. Cambridge, pp 112–116

  5. Suto J, Oniga S, Buchman A (2015) Real time human activity monitoring. Annales Mathematicae et Informaticae 44:187–196

    MATH  Google Scholar 

  6. Chernbumroong S, Cang S, Atkins A, Yu H (2013) Elderly activities recognition and classification for applications in assisted living. Expert Syst Appl 40:1662–1674

    Article  Google Scholar 

  7. Shoaib M, Bosch S, Ince OD, Scholten H, Havinga PJM (2015) A survey of online activity recognition using mobile phones. Sensors 15:2059–2085

    Article  Google Scholar 

  8. Bayat A, Pomplun M, Tran DA (2014) A study on human activity recognition using accelerometer data from smartphones. Procedia Comput Sci 34:450–457

    Article  Google Scholar 

  9. Ayu MA, Ismail SA, Matin AFA, Montoro T (2012) A comparison study of classifier algorithms for mobile-phone’s accelerometer based activity recognition. Eng Procedia 41:224–229

    Article  Google Scholar 

  10. Yang JY, Wang JS, Chen YP (2008) Using acceleration measurements for activity recognition: an effective learning algorithm for constructing neural classifiers. Pattern Recogn Lett 29:2213–2220

    Article  Google Scholar 

  11. Khan AM, Lee YK, Lee SY, Kim TS (2010) A triaxial accelerometer-based physical-activity recognition via augmented-signal features and a hierarchical recognizer. IEEE T Inf Technol B 14:1166–1172

    Article  Google Scholar 

  12. Oniga S, Suto J (2014) Human activity recognition using neural networks. In: Proceedings of the 15th International Carpathian Control Conference. Velke Karlovice, pp 759–762

  13. Preece JS, Goulermas JY, Kenney LPJ, Howard D (2009) A comparison of feature extraction methods for classification of dynamic activities from accelerometer data. IEEE T Bio-Med Eng 56:871–879

    Article  Google Scholar 

  14. Duarte F, Lourenco A, Abrantes A (2014) Classification of physical activities using a smart phone: evaluation study using multiple users. Procedia Technol 17:239–247

    Article  Google Scholar 

  15. Gao L, Bourke AK, Nelson J (2014) Evaluation of accelerometer based multi-sensor versus single sensor activity recognition systems. Med Eng Phys 36:779–785

    Article  Google Scholar 

  16. Sheng M, Jiang J, Su B, Tang Q, Yahya AA, Wang G (2016) Short-time activity recognition with wearable sensors using convolutional neural networks. In: Proceedings of the 15th ACM SIGGRAPH conference on virtual-reality continuum and its applications in industry. Zhuhai, pp 413–416

  17. Jiang W, Yin Z (2015) Human activity recognition using wearable sensors by deep convolutional neural networks. In: Proceedings of the 23th ACM international conference on multimedia, Brisbane, pp 1307–1310

  18. Godfrey A, Bourke AK, Olaighin GM, Van Ven de P, Nelson J (2011) Activity classification using a single chest mounted tri-axial accelerometer. Med Eng Phys 33:1127–1135

    Article  Google Scholar 

  19. Yang AY, Jafari R, Sastry SS, Bajcsy R (2009) Distributed recognition of human actions using wearable motion sensor networks. J Amb Intel Smart En. 1:103–115

    Google Scholar 

  20. Ertugrul OF, Kaya Y (2016) Determining the optimal number of body-worn sensors for human activity recognition. Soft Comput 20:1–8

    Article  Google Scholar 

  21. Oniga S, Suto J (2016) Activity recognition in adaptive assistive systems using artificial neural networks. Elektron Elektrotech 22:68–72

    Article  Google Scholar 

  22. Karantonis DM, Narayanan MR, Mathie M, Lovell NH, Celler BG (2006) Implementation of real-time human movement classifier using a triaxial accelerometer for ambulatory monitoring. IEEE T Inf Technol B 10:156–167

    Article  Google Scholar 

  23. Android developers, API guides, location and sensors, motion sensors. https://developer.android.com/guide/topics/sensors/sensors_motion.html. Accessed 14 Nov 2017

  24. Ni Q, Patterson T, Cleland I, Nugent C (2016) Dynamic detection of window starting positions and its implementation within an activity recognition framework. J Biomed Inf 62:171–180

    Article  Google Scholar 

  25. Lara OD, Labrador MA (2013) A survey on human activity recognition using wearable sensors. IEEE Commun Surv Tut 15:1192–1209

    Article  Google Scholar 

  26. Suto J, Oniga S (2017) Efficiency investigation of artificial neural networks in human activity recognition. J Ambient Intell Human Comput. https://doi.org/10.1007/s12652-017-0513-5

    Article  MATH  Google Scholar 

  27. Ayachi FS, Nguyen HP, Lavigne-Palletier C, Goubault E, Boissy P, Duval C (2016) Wavelet-based algorithm for auto-detection of daily living activities of older adults captured by multiple inertial measurement units (IMUs). Physiol Meas 37:442–461

    Article  Google Scholar 

  28. Suto J, Oniga S, Pop-Sitar P (2017) Feature analysis to human activity recognition. Int J Comp Commun 12:116–130

    Article  Google Scholar 

  29. Saeys Y, Inza I, Larranaga P (2007) A review of feature selection techniques in bioinformatics. Bioinformatics 23:2507–2517

    Article  Google Scholar 

  30. Gou Q, Liu B, Chen CW (2016) A two-layer and multi-strategy framework for human activity recognition using smartphone. In: Proceedings of the IEEE international conference on communications, Kuala Lumpur, pp 120–126

  31. Jatoba CL, Grobmann U, Kunze U, Ottenbacher J, Stork W (2008) Context-aware mobile health monitoring: evaluation of different pattern recognition methods for classification of physical activity. In: Proceedings of the 30th annual international IEEE EMBS conference, Vancouver, pp 5250–5253

  32. Damasevicius R, Vasiljevas M, Salkevicius J, Wozniak M (2016) Human activity recognition in AAL environments using random projections. Comput Math Method M. https://doi.org/10.1155/2016/4073584

    Article  MATH  Google Scholar 

  33. Su B, Tang Q, Wang G, Sheng M (2016) The recognition of human daily actins with wearable motion sensor systems. In: Transaction on edutainment, 12, Springer, Berlin, pp 68–77

  34. Oniga S, Suto J (2015) Optimal recognition method of human activities using artificial neural networks. Meas Sci Rev 15:323–327

    Article  Google Scholar 

  35. Rahman HA, Ge D, Faucheur AL, Prioux J, Carrault G (2017) Advanced classification of ambulatory activities using spectral density distances and heart rates. Biomed Signal Poces 34:9–15

    Article  Google Scholar 

  36. Ronao CA, Cho SB (2016) Human activity recognition with smartphone sensors using deep learning neural networks. Expert Syst Appl 59:235–244

    Article  Google Scholar 

  37. Zeiler MD, Fergus M (2014) Visualizing and understanding convolutional networks. In: European conference on computer vision, Zurich, pp 818–833

  38. Krizevsky A, Sutskerev I, Hinton GE (2012) ImageNet classification with deep convolutional neural networks. In: Neural Information Processing Systems, Nevada, pp 1–9

  39. Suto J, Oniga S (2015) A new relation between “twiddle factors” in the fast Fourier transformation. Elektron Elektrotech 21:56–59

    Article  Google Scholar 

  40. Kouris I, Koutsouis D (2013) Application of data mining techniques to efficiently monitor chronic diseases using wireless body area networks and smartphones. Univ J Biomed Eng 1:23–31

    Google Scholar 

  41. Anguita D, Ghio A, Oneto L, Parra X, Reyes-Ortiz L (2013) A public domain dataset for human activity recognition using smartphones. In: Proceedings of 21th European symposium on artificial neural networks, computational intelligence and machine learning. Bruges, pp 437–442

  42. Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, Erhan D, Vanhoucker V, Rabinovich R (2015) Going deeper with convolutions. In: Proceedings of the IEEE conference on computer vision and pattern recognition. Boston, pp 1–9

  43. Suto J, Oniga S, Lung C, Orha I (2017) Recognition rate difference between real-time and offline human activity recognition. In: Proceedings of the international conference on internet of things for the global community. Funchal, pp 103–109

Download references

Acknowledgement

This work has been supported by the ÚNKP-17-3-IV New National Excellence Program of the Ministry of Human Capacities.

Author information

Authors and Affiliations

  1. Department of Informatics Systems and Networks, Faculty of Informatics, University of Debrecen, 26 Kassai Road, Debrecen, 4028, Hungary

    Jozsef Suto & Stefan Oniga

  2. Department of Electronic and Computer Engineering, Technical University of Cluj-Napoca, North University Centre of Baia Mare, 62A Str. Dr. Victor Babes, Baia Mare, 43008, Romania

    Stefan Oniga, Claudiu Lung & Ioan Orha

Authors
  1. Jozsef Suto
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Stefan Oniga
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Claudiu Lung
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Ioan Orha
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jozsef Suto.

Ethics declarations

Conflict of interest

The authors declare that there is no conflict of interests regarding the publication of this paper.

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Suto, J., Oniga, S., Lung, C. et al. Comparison of offline and real-time human activity recognition results using machine learning techniques. Neural Comput & Applic 32, 15673–15686 (2020). https://doi.org/10.1007/s00521-018-3437-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-018-3437-x

Keywords

  • Activity recognition
  • Android application
  • Feature extraction
  • Machine learning