Skip to main content

Ensemble residual network-based gender and activity recognition method with signals

The Journal of Supercomputing volume 76, pages 2119–2138 (2020)Cite this article

Abstract

Nowadays, deep learning is one of the popular research areas of the computer sciences, and many deep networks have been proposed to solve artificial intelligence and machine learning problems. Residual networks (ResNet) for instance ResNet18, ResNet50 and ResNet101 are widely used deep network in the literature. In this paper, a novel ResNet-based signal recognition method is presented. In this study, ResNet18, ResNet50 and ResNet101 are utilized as feature extractor and each network extracts 1000 features. The extracted features are concatenated, and 3000 features are obtained. In the feature selection phase, 1000 most discriminative features are selected using ReliefF, and these selected features are used as input for the third-degree polynomial (cubic) activation-based support vector machine. The proposed method achieved 99.96% and 99.61% classification accuracy rates for gender and activity recognitions, respectively. These results clearly demonstrate that the proposed pre-trained ensemble ResNet-based method achieved high success rate for sensors signals.

This is a preview of subscription content, access via your institution.

Access options

Buy single article

Instant access to the full article PDF.

USD 39.95

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

References

  1. Munoz-Organero M (2019) Outlier detection in wearable sensor data for human activity recognition (HAR) based on DRNNs. IEEE Access 7:74422–74436

    Article  Google Scholar 

  2. Chen Y, Shen C (2017) Performance analysis of smartphone-sensor behavior for human activity recognition. IEEE Access 5:3095–3110

    Article  Google Scholar 

  3. Wang K, He J, Zhang L (2019) Attention-based convolutional neural network for weakly labeled human activities recognition with wearable sensors. IEEE Sens J 19:7598–7604

    Article  Google Scholar 

  4. Cornacchia M, Ozcan K, Zheng Y, Velipasalar S (2016) A survey on activity detection and classification using wearable sensors. IEEE Sens J 17(2):386–403

    Article  Google Scholar 

  5. Wang J, Chen Y, Hao S, Peng X, Hu L (2019) Deep learning for sensor-based activity recognition: a survey. Pattern Recognit Lett 119:3–11

    Article  Google Scholar 

  6. Altun K, Barshan B, Tunçel O (2010) Comparative study on classifying human activities with miniature inertial and magnetic sensors. Pattern Recognit 43(10):3605–3620

    Article  Google Scholar 

  7. Song B, Kamal AT, Soto C, Ding C, Farrell JA, Roy-Chowdhury AK (2010) Tracking and activity recognition through consensus in distributed camera networks. IEEE Trans Image Process 19(10):2564–2579

    Article  MathSciNet  Google Scholar 

  8. Huynh-The T et al (2018) Hierarchical topic modeling with pose-transition feature for action recognition using 3D skeleton data. Inf Sci 444:20–35

    Article  MathSciNet  Google Scholar 

  9. Mario M-O (2018) Human activity recognition based on single sensor square HV acceleration images and convolutional neural networks. IEEE Sens J 19(4):1487–1498

    Article  Google Scholar 

  10. Tian Y, Wang X, Chen L, Liu Z (2019) Wearable sensor-based human activity recognition via two-layer diversity-enhanced multiclassifier recognition method. Sensors 19(9):2039

    Article  Google Scholar 

  11. Jiang W, Yin Z (2013) Human activity recognition using wearable sensors by deep convolutional neural networks. In: Proceedings of the 23rd ACM International Conference on Multimedia, ACM, pp 1307–1310

  12. Chernbumroong S, Cang S, Atkins A, Yu H (2013) Elderly activities recognition and classification for applications in assisted living. Expert Syst Appl 40(5):1662–1674

    Article  Google Scholar 

  13. Nweke HF, Teh YW, Al-Garadi MA, Alo UR (2018) Deep learning algorithms for human activity recognition using mobile and wearable sensor networks: state of the art and research challenges. Expert Syst Appl 105:233–261

    Article  Google Scholar 

  14. Wang Z, Guo M, Zhao C (2016) Badminton stroke recognition based on body sensor networks. IEEE Transa Hum Mach Syst 46(5):769–775

    Article  Google Scholar 

  15. Gravina R, Alinia P, Ghasemzadeh H, Fortino G (2017) Multi-sensor fusion in body sensor networks: state-of-the-art and research challenges. Inf Fusion 35:68–80

    Article  Google Scholar 

  16. Cheng W-C, Jhan D-M (2012) Triaxial accelerometer-based fall detection method using a self-constructing cascade-AdaBoost-SVM classifier. IEEE J Biomed Health Inf 17(2):411–419

    Article  Google Scholar 

  17. Margarito J, Helaoui R, Bianchi AM, Sartor F, Bonomi AG (2015) User-independent recognition of sports activities from a single wrist-worn accelerometer: a template-matching-based approach. IEEE Trans Biomed Eng 63(4):788–796

    Google Scholar 

  18. Wang A, Chen G, Yang J, Zhao S, Chang C-Y (2016) A comparative study on human activity recognition using inertial sensors in a smartphone. IEEE Sens J 16(11):4566–4578

    Article  Google Scholar 

  19. He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 770–778

  20. LeCun Y, Bengio Y, Hinton G (2015) Deep learning. Nature 521(7553):436

    Article  Google Scholar 

  21. Goodfellow I, Bengio Y, Courville A (2016) Deep learning. MIT Press, Cambridge

    MATH  Google Scholar 

  22. Sutskever I, Martens J, Dahl G, Hinton G (2013) On the importance of initialization and momentum in deep learning. In: International Conference on Machine Learning, pp 1139–1147

  23. Hinton GE, Osindero S, Teh Y-W (2006) A fast learning algorithm for deep belief nets. Neural Comput 18(7):1527–1554

    Article  MathSciNet  Google Scholar 

  24. Bengio Y, Goodfellow I, Courville A (2017) Deep learning. Citeseer, Princeton

    MATH  Google Scholar 

  25. Oh J, Guo X, Lee H, Lewis RL, Singh S (2015) Action-conditional video prediction using deep networks in atari games. In: Advances in Neural Information Processing Systems, pp 2863–2871

  26. Abdel-Hamid O, Mohamed A-R, Jiang H, Deng L, Penn G, Yu D (2014) Convolutional neural networks for speech recognition. IEEE/ACM Trans Audio Speech Lang Process 22(10):1533–1545

    Article  Google Scholar 

  27. Cao W, Wang X, Ming Z, Gao J (2018) A review on neural networks with random weights. Neurocomputing 275:278–287

    Article  Google Scholar 

  28. Salakhutdinov R, Mnih A, Hinton G (2007) Restricted Boltzmann machines for collaborative filtering. In: Proceedings of the 24th International Conference on Machine Learning, ACM, pp 791–798

  29. Le Roux N, Bengio Y (2008) Representational power of restricted Boltzmann machines and deep belief networks. Neural Comput 20(6):1631–1649

    Article  MathSciNet  Google Scholar 

  30. LeCun Y, Bottou L, Bengio Y, Haffner P (1998) Gradient-based learning applied to document recognition. Proc IEEE 86(11):2278–2324

    Article  Google Scholar 

  31. Szegedy C et al (2015) Going deeper with convolutions. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 1–9

  32. Iandola FN, Han S, Moskewicz MW, Ashraf K, Dally WJ, Keutzer K (2016) SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and < 0.5 MB model size. arXiv preprint arXiv:1602.07360

  33. Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556

  34. Xsens N (2010) MTi and MTx user manual and technical documentation

  35. Barshan B, Yüksek MC (2014) Recognizing daily and sports activities in two open source machine learning environments using body-worn sensor units. Comput J 57(11):1649–1667

    Article  Google Scholar 

  36. Robnik-Šikonja M, Kononenko I (2003) Theoretical and empirical analysis of ReliefF and RReliefF. Mach Learn 53(1–2):23–69

    Article  Google Scholar 

  37. Kononenko I, Šimec E, Robnik-Šikonja M (1997) Overcoming the myopia of inductive learning algorithms with RELIEFF. Appl Intell 7(1):39–55

    Article  Google Scholar 

  38. Rowland R et al (2019) A simple burn wound severity assessment classifier based on spatial frequency domain imaging (SFDI) and machine learning. In: Photonics in Dermatology and Plastic Surgery 2019, 2019, vol. 10851: International Society for Optics and Photonics, p 1085109

  39. Liapis A, Katsanos C, Sotiropoulos D, Xenos M, Karousos N (2015) Recognizing emotions in human computer interaction: studying stress using skin conductance. In: IFIP Conference on Human–Computer Interaction. Springer, pp 255–262

  40. Hu C, Chen Y, Hu L, Peng X (2018) A novel random forests based class incremental learning method for activity recognition. Pattern Recognit 78:277–290

    Article  Google Scholar 

  41. Hammad I, El-Sankary K (2019) Practical considerations for accuracy evaluation in sensor-based machine learning and deep learning. Sensors 19(16):3491

    Article  Google Scholar 

  42. Wang L, Liu R (2019) Human activity recognition based on wearable sensor using hierarchical deep LSTM networks. Circuits Syst Signal Process 39:837–856

    Article  Google Scholar 

  43. Kuncan F, Kaya Y, Kuncan M (2019) New approaches based on local binary patterns for gender identification from sensor signals. J Faculty Eng Architect Gazi Univ 34(4):2173–2185

    Google Scholar 

  44. Vavoulas G, Chatzaki C, Malliotakis T, Pediaditis M, Tsiknakis M (2016) The MobiAct dataset: recognition of activities of daily living using smartphones. In: ICT4AgeingWell, pp 143–151

  45. Ferrari A, Mobilio M, Micucci D, Napoletano P (2019) On the homogenization of heterogeneous inertial-based databases for human activity recognition. In: 2019 IEEE World Congress on Services (SERVICES), vol. 2642. IEEE, pp 295–300

  46. Chen Y, Zhong K, Zhang J, Sun Q, Zhao X (2016) LSTM networks for mobile human activity recognition. In: 2016 International Conference on Artificial Intelligence: Technologies and Applications. Atlantis Press

  47. Ajerla D, Mahfuz S, Zulkernine F (2019) A real-time patient monitoring framework for fall detection. Wirel Commun Mob Comput. https://doi.org/10.1155/2019/9507938

    Article  Google Scholar 

  48. Ferrari A, Micucci D, Mobilio M, Napoletano P (2019) Hand-crafted features vs residual networks for human activities recognition using accelerometer. In: 2019 IEEE 23rd International Symposium on Consumer Technologies (ISCT). IEEE, pp 153–156

  49. Welhenge AM, Taparugssanagorn A (2019) Human activity classification using long short-term memory network. SIViP 13(4):651–656

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Digital Forensics Engineering, Technology Faculty, Firat University, Elazig, Turkey

    Turker Tuncer, Fatih Ertam & Sengul Dogan

  2. Department of Computer Engineering, Faculty of Engineering and Architecture, Kirsehir Ahi Evran University, Kirsehir, Turkey

    Emrah Aydemir

  3. Department of Information and Communications Technology, Faculty of Computer Science and Telecommunications, Cracow University of Technology, Warszawska 24 st., F-3, 31-155, Krakow, Poland

    Paweł Pławiak

  4. Institute of Theoretical and Applied Informatics, Polish Academy of Sciences, Bałtycka 5, 44-100, Gliwice, Poland

    Paweł Pławiak

Authors
  1. Turker Tuncer
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Fatih Ertam
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Sengul Dogan
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Emrah Aydemir
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Paweł Pławiak
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Turker Tuncer.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Tuncer, T., Ertam, F., Dogan, S. et al. Ensemble residual network-based gender and activity recognition method with signals. J Supercomput 76, 2119–2138 (2020). https://doi.org/10.1007/s11227-020-03205-1

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11227-020-03205-1

Keywords

  • Ensemble residual network
  • Gender identification
  • Daily sport activity recognition
  • Sensor signals
  • Machine learning