Skip to main content
Log in

An improved Wi-Fi sensing-based human activity recognition using multi-stage deep learning model

  • Application of soft computing
  • Published:
Soft Computing Aims and scope Submit manuscript

Abstract

Human activity detection and response in real time is one of the major objectives in many defense applications. Many technologies that include surveillance cameras and wearable devices using sensors were proposed for human activity detection. But, these technologies are not popular due to a lack of convenience, privacy, availability, and affordability. Sensing and recognizing various human activities using wireless signal characteristics have been in the reckoning in recent years. This paper proposes a multi-stage deep learning model consisting of a convolutional neural network and other popular deep neural architectures, namely Alexnet, Googlenet, and Squeezenet, for Wi-Fi sensing-based human activity recognition. Transfer learning is used for recognizing crucial human activities using the channel state information (CSI) of the Wi-Fi signal. The objective is to identify critical human activities and then to minimize the false negatives. In the proposed multi-stage model, a data sample is tested in one network for identifying the critical activity; if classified as negative with predefined confidence, the sample is tested again in the subsequent architectures. A sample is considered negative only if all the stages confirm it as negative. Our proposed multi-stage model can reduce the false negatives with a slight increase in the false positive rate. We have considered the dataset consisting of measured CSI values of three transmitter–receiver pairs for six different activities: fall, wave, jump, walk, clap, and sit. We report the results of the experiments with a focus on reducing false negatives of individual activities during the testing phase.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  • Adib F, Katabi D (2013) See through walls with WiFi!. In: Proceedings of the ACM SIG- COMM 2013 conference on SIGCOMM, pp 75–86

  • Arshad S, Feng C, Liu Y, Hu Y, Yu R, Zhou S, Li H (2017) Wi-chase: A WiFi based human activity recog- nition system for sensorless environments. In: 2017 IEEE 18th international symposium on a world of wireless, mobile and multimedia networks (WoWMoM). IEEE, pp 1–6

  • Arnab B, Zhi-Ya Z, Fadi A-T, Xiaodong Y (2020) Cognitive intelligence for monitoring fractured post-surgery ankle activity using channel information. IEEE Access 8:112113–112129. https://doi.org/10.1109/ACCESS.2020.3000599

    Article  Google Scholar 

  • Brinke JK, Meratnia N (2019) Dataset: Channel state information for different activities, participants and days. In: Proceedings of the 2nd workshop on data acquisition to analysis, pp 61–64

  • Brinke JK, Meratnia N (2019) Scaling activity recognition using channel state information through convolutional neural networks and transfer learning. In: Proceedings of the first international workshop on challenges in artificial intelligence and machine learning for internet of things, pp 56–62

  • Goodfellow I, Bengio Y, Courville A (2016) Deep learning. MIT Press. http://www.deeplearningbook.org

  • Iandola FN, Han S, Moskewicz MW, Ashraf K, Dally WJ., Keutzer K (2016) SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and \(<0.5\) MB model size. In: arXiv:1602.07360

  • Jiang W, Miao C, Ma F, Yao S, Wang Y, Yuan Y, Xue H, Song C, Ma X, Koutsonikolas D et al (2018) To- wards environment independent device free hu- man activity recognition. In: Proceedings of the 24th annual international conference on mobile computing and networking, pp 289–304

  • Alex K, Ilya S, Hinton Geoffrey E (2012) Imagenet classification with deep convolutional neural networks. Adv Neural Inf Process Syst 25:1097–1105

    Google Scholar 

  • Lee C-C, Huang X-C (2018) Human Activity Detection via WiFi Signals Using Deep Neural Networks. In: 2018 IEEE/ACM international conference on utility and cloud computing companion (UCC Companion). IEEE, pp 3–4

  • Heju L, Xin H, Xukai C, Yinyin F, Qun F (2019) Wi-motion: a robust human activity recognition using WiFi signals. IEEE Access 7:153287–153299

    Article  Google Scholar 

  • Ma Y, Zhou G, Wang S (2019) WiFi sensing with channel state information: a survey. ACM Comput Surv (CSUR) 52(3):1–36

    Article  Google Scholar 

  • Palipana S, Rojas D, Agrawal P, Pesch D (2018) FallDeFi: ubiquitous fall detection using commodity Wi-Fi devices. In: Proceedings of the ACM on interactive, mobile, wear- able and ubiquitous technologies 1.4, pp 1–25

  • Sharma L, Chao C-H, Wu S-L, Li M-C (2021) High accuracy WiFi-based human activity classification system with time-frequency diagram CNN method for different places. Sensors 21(11):1424–8220. https://doi.org/10.3390/s21113797

    Article  Google Scholar 

  • Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, Erhan D, Vanhoucke V, Rabinovich A (2015) Going deeper with convolutions. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1–9

  • Tereikovska L, Tereikovskyi I, Beketova A, Karaman G, Makovetska N (2021) Recognition of Speaker’s Emotion by Squeezenet convolutional neural network. J Theor Appl Inf Technol 99(5):1139–1148

  • Wang D, Zhou Z, Yu X, Cao Y (2019) CSIID: WiFi-based Human Identification via Deep Learning. In: 2019 14th international conference on computer science & education (ICCSE). IEEE, pp 326–330

  • Wang F, Gong W, Liu J (2018) On spatial diversity in WiFi-based human activity recognition: a deep learning-based approach. IEEE Internet Things J 6(2):2035–2047

    Article  Google Scholar 

  • Wang H, Zhang D, Wang Y, Ma J, Wang Y, Li S (2016) RT-Fall: a real-time and contactless fall detection system with commodity WiFi devices. IEEE Trans Mobile Comput 16(2):511–526

    Article  Google Scholar 

  • Jie W, Xiao Z, Qinhua G, Hao Y, Hongyu W (2016) Device-free wireless localization and activity recognition: a deep learning approach. IEEE Trans Veh Technol 66(7):6258–6267

    Google Scholar 

  • Jingjing W, Goo PJ (2020) A novel fingerprint localization algorithm based on modified channel state information using Kalman filter. J Electr Eng Technol 15(4):1811–1819

    Article  Google Scholar 

  • Wang Y, Wu K, Ni LM (2016) Wifall: device-free fall detection by wireless networks. IEEE Trans Mobile Comput 16(2):581–594

    Article  Google Scholar 

  • Wikipedia contributors (2020a) Data augmentation—Wikipedia, the free encyclopedia. [Online; accessed 27-November-2020]. https://en.wikipedia.org/w/index.php?title=Data_augmentation&oldid=984299198

  • Wikipedia contributors (2020b) Deep learning—Wikipedia, the free encyclopedia. https://en.wikipedia.org/w/index.php?title=Deep_learning&oldid=990318824

  • Wikipedia contributors (2020) Generative adversarial network—Wikipedia, the Free Encyclopedia. https://en.wikipedia.org/w/index.php?title=Generative_adversarial_network&oldid=990692312

  • Wikipedia contributors (2020d) Spiking neural network—Wikipedia, the free encyclopedia. https://en.wikipedia.org/w/index.php?title=Spiking_neural_network&oldid=989250702

  • Wikipedia contributors (2020e) Transfer learning—Wikipedia, the free encyclopedia.https://en.wikipedia.org/w/index.php?title=Transfer_learning&oldid=986818868

  • Wikipedia contributors (2020f) Wi-Fi—Wikipedia, The Free Encyclopedia. https://en.wikipedia.org/w/index.php?title=Wi-Fi&oldid=990443977

  • Xiang Peng, Ji Peng, Zhang Dian (2018) “Enhance RSS-based indoor localization accuracy by lever- aging environmental physical features”. In: Wireless Communications and Mobile Computing 2018

  • Yang X, Xiong F, Shao Y, Niu Q(2018) WmFall: WiFi-based multistage fall detection with channel state information. Int J Distrib Sens Netw 14(10), 1550147718805718

  • Youssef M, Mah M, Agrawala A (2007) Challenges: device-free passive localization for wireless environments. In: Proceedings of the 13th annual ACM international conference on Mobile computing and networking, pp 222–229

  • Zhang D, Wang H, Wang Y, Ma J (2015) Anti-fall: A non-intrusive and real-time fall detector leveraging CSI from commodity WiFi devices. In: International conference on smart homes and health telematics. Springer, pp 181–193

  • Zhou Q, Xing J, Chen W, Zhang X, Yang Q (2018) From signal to image: enabling fine-grained gesture recognition with commercial Wi-Fi devices. Sensors 18(9):3142

    Article  Google Scholar 

  • Zhu D, Pang N, Li G, Liu S (2017) NotiFi: a ubiquitous WiFi-based abnormal activity detection system. In: 2017 international joint conference on neural networks (IJCNN). IEEE, pp 1766–1773

  • Zhu D, Zhao B, Wang S, Wu D (2018) Direct-path based fingerprint extraction algorithm for indoor localization. In: Proceedings of the 15th EAI international conference on mobile and ubiquitous systems: computing, networking and services, pp 11–18

  • Zou H, Zhou Y, Yang J, Jiang H, Xie L, Spanos CJ (2018) WiFi-enabled device-free gesture recognition for smart home automation. In: 2018 IEEE 14th international conference on control and automation (ICCA). IEEE, pp 476–481

Download references

Funding

The funding for this study was received from Institute of Eminence (IoE), University of Hyderabad, Hyderabad, India.

Author information

Authors and Affiliations

Authors

Contributions

The first author is a PhD student under the supervision of the second author who is also the corresponding author of this paper. The corresponding author defined the problem, formulated the methodology, designed the experiments, and structured the writing and presentation. The first author did the literature survey, conducted the experiments, and wrote the paper.

Corresponding author

Correspondence to Siba K. Udgata.

Ethics declarations

Conflict of interest

Authors declare that there is no conflict of interest in this work.

Ethical approval

This article does not contain any studies with human participants directly or animals performed by any of the authors.

Informed consent

We have used the publicly available dataset for the experiment and there is no direct involvement of individuals in the experiment.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Sruthi, P., Udgata, S.K. An improved Wi-Fi sensing-based human activity recognition using multi-stage deep learning model. Soft Comput 26, 4509–4518 (2022). https://doi.org/10.1007/s00500-021-06534-2

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00500-021-06534-2

Keywords

Navigation