Advertisement

A Deep Learning Approach to Device-Free People Counting from WiFi Signals

  • Iker Sobron
  • Javier Del Ser
  • Iñaki Eizmendi
  • Manuel Velez
Conference paper
Part of the Studies in Computational Intelligence book series (SCI, volume 798)

Abstract

The last decade has witnessed a progressive interest shown by the community on inferring the presence of people from changes in the signals exchanged by deployed wireless devices. This non-invasive approach finds its rationale in manifold applications where the provision of counting devices to the people expected to traverse the scenario at hand is not affordable nor viable in the practical sense, such as intrusion detection in critical infrastructures. A trend in the literature has focused on modeling this paradigm as a supervised learning problem: a dataset with WiFi traces and their associated number of people is assumed to be available a priori, which permits to learn the pattern between traces and the number of people by a supervised learning algorithm. This paper advances over the state of the art by proposing a novel convolutional neural network that infers such a pattern over space (frequency) and time by rearranging the received I/Q information as a three-dimensional tensor. The proposed layered architecture incorporates further processing elements for a better generalization capability of the overall model. Results are obtained over real WiFi traces and compared to those recently reported over the same dataset for shallow learning models. The superior performance shown by the model proposed in this work paves the way towards exploring the applicability of the latest advances in Deep Learning to this specific case study.

Keywords

Device-free people counting Internet of Things Convolutional neural network Deep Learning 

Notes

Acknowledgements

This work was supported in part by the Spanish Ministry of Economy and Competitiveness under project 5GnewBROS (TEC2015-66153-P MINECO/FEDER, EU) and by the Basque Government (IT683-13 and the EMAITEK program).

References

  1. 1.
    Abdelnasser, H., Harras, K.A., Youssef, M.: Ubibreathe: a ubiquitous non-invasive WiFi-based breathing estimator. In: 16th ACM International Symposium on Mobile Ad Hoc Networking and Computing, pp. 277–286. ACM (2015)Google Scholar
  2. 2.
    Altman, D.G.: Practical Statistics for Medical Research. Chapman and Hall/CRC, London (1990)Google Scholar
  3. 3.
    Balakrishnama, S., Ganapathiraju, A.: Linear discriminant analysis-a brief tutorial. Institute for Signal and information Processing 18, 1–8 (1998)Google Scholar
  4. 4.
    Breiman, L.: Random forests. Mach. Learn. 45(1), 5–32 (2001)CrossRefGoogle Scholar
  5. 5.
    Cianca, E., De Sanctis, M., Di Domenico, S.: Radios as sensors. IEEE Internet Things J. 4(2), 363–373 (2017)CrossRefGoogle Scholar
  6. 6.
    Cohen, J.: A coefficient of agreement for nominal scales. Educ. Psychol. Meas. 20(1), 37–46 (1960)CrossRefGoogle Scholar
  7. 7.
    Cortes, C., Vapnik, V.: Support-vector networks. Mach. Learn. 20(3), 273–297 (1995)zbMATHGoogle Scholar
  8. 8.
    David, O.E., Greental, I.: Genetic algorithms for evolving deep neural networks. In: Companion Publication of the 2014 Annual Conference on Genetic and Evolutionary Computation, pp. 1451–1452. ACM (2014)Google Scholar
  9. 9.
    Floreano, D., Dürr, P., Mattiussi, C.: Neuroevolution: from architectures to learning. Evol. Intell. 1(1), 47–62 (2008)CrossRefGoogle Scholar
  10. 10.
    Friedman, J.H.: Greedy function approximation: a gradient boosting machine. Ann. Stat. 29, 1189–1232 (2001)MathSciNetCrossRefGoogle Scholar
  11. 11.
    Friedman, J.H.: Stochastic gradient boosting. Comput. Stat. Data Anal. 38(4), 367–378 (2002)MathSciNetCrossRefGoogle Scholar
  12. 12.
    Joshi, K.R., Bharadia, D., Kotaru, M., Katti, S.: Wideo: fine-grained device-free motion tracing using RF backscatter. In: NSDI, pp 189–204 (2015)Google Scholar
  13. 13.
    Kingma, D.P., Ba, J.: Adam: a method for stochastic optimization. arXiv preprint arXiv:14126980, published at ICLR 2015 (2014)
  14. 14.
    Liu, J., Wang, Y., Chen, Y., Yang, J., Chen, X., Cheng, J.: Tracking vital signs during sleep leveraging off-the-shelf WiFi. In: 16th ACM International Symposium on Mobile Ad Hoc Networking and Computing, pp. 267–276. ACM (2015)Google Scholar
  15. 15.
    Lv, J., Yang, W., Gong, L., Man, D., Du, X.: Robust WLAN-based indoor fine-grained intrusion detection. In: 2016 IEEE Global Communications Conference (GLOBECOM), pp 1–6 (2016)Google Scholar
  16. 16.
    Miikkulainen, R., Liang, J., Meyerson, E., Rawal, A., Fink, D., Francon, O., Raju, B., Shahrzad, H., Navruzyan, A., Duffy, N., et al.: Evolving deep neural networks. arXiv preprint arXiv:170300548 (2017)
  17. 17.
    Ohara, K., Maekawa, T., Matsushita, Y.: Detecting state changes of indoor everyday objects using Wi-Fi channel state information. Proc. ACM Interact Mob Wearable Ubiquitous Technol. 1(3), 88:1–88:28 (2017).  https://doi.org/10.1145/3131898CrossRefGoogle Scholar
  18. 18.
    Oppermann, F.J., Boano, C.A., Römer, K.: A decade of wireless sensing applications: survey and taxonomy. In: The Art of Wireless Sensor Networks, vol 1: Fundamentals, pp. 11–50. Springer, New York, NY, USA (2014)Google Scholar
  19. 19.
    Pu, Q., Gupta, S., Gollakota, S., Patel, S.: Whole-home gesture recognition using wireless signals. In: 19th Annual International Conference on Mobile Computing & Networking, pp. 27–38. ACM (2013)Google Scholar
  20. 20.
    Qian, K., Wu, C., Yang, Z., Liu, Y., Zhou, Z.: PADS: passive detection of moving targets with dynamic speed using PHY layer information. In: 2014 20th IEEE International Conference on Parallel and Distributed Systems (ICPADS), pp 1–8 (2014)Google Scholar
  21. 21.
    Raja, M., Sigg, S.: Applicability of RF-based methods for emotion recognition: a survey. In: 2016 IEEE International Conference on Pervasive Computing and Communication Workshops (PerCom Workshops), pp. 1–6. IEEE (2016)Google Scholar
  22. 22.
    Schölkopf, B., Bartlett, P.L., Smola, A.J., Williamson, R.C.: Shrinking the tube: a new support vector regression algorithm. In: Advances in Neural Information Processing Systems, pp 330–336 (1999)Google Scholar
  23. 23.
    Seifeldin, M., Saeed, A., Kosba, A.E., El-Keyi, A., Youssef, M.: Nuzzer: a large-scale device-free passive localization system for wireless environments. IEEE Trans. Mob. Comput. 12(7), 1321–1334 (2013)CrossRefGoogle Scholar
  24. 24.
    Sobron, I., Del Ser, J., Eizmendi, I., Velez, M.: EHUCOUNT dataset (2017). www.ehu.eus/tsr_radio/index.php/research-areas/data-analytics-in-wireless-networks. Accessed 30th Nov 2017
  25. 25.
    Sobron, I., Del Ser, J., Eizmendi, I., Velez, M.: Device-free people counting in IoT environments: new insights, results and open challenges. IEEE Internet Things J. ,1 (2018).  https://doi.org/10.1109/JIOT.2018.2806990, early Access
  26. 26.
    Such, F.P., Madhavan, V., Conti, E., Lehman, J., Stanley, K.O., Clune, J.: Deep neuroevolution: genetic algorithms are a competitive alternative for training deep neural networks for reinforcement learning. arXiv preprint arXiv:171206567 (2017)
  27. 27.
    Wang, X., Gao, L., Mao, S., Pandey, S.: Deepfi: deep learning for indoor fingerprinting using channel state information. In: IEEE Wireless Communications and Networking Conference (WCNC), pp 1666–1671 (2015).  https://doi.org/10.1109/WCNC.2015.7127718
  28. 28.
    Wang, X., Gao, L., Mao, S.: CSI phase fingerprinting for indoor localization with a deep learning approach. IEEE Internet Things J. 3(6), 1113–1123 (2016).  https://doi.org/10.1109/JIOT.2016.2558659CrossRefGoogle Scholar
  29. 29.
    Wang, Y., Wu, K., Ni, L.M.: Wifall: device-free fall detection by wireless networks. IEEE Trans. Mob. Comput. 16(2), 581–594 (2017)CrossRefGoogle Scholar
  30. 30.
    Wu, C., Yang, Z., Zhou, Z., Liu, X., Liu, Y., Cao, J.: Non-invasive detection of moving and stationary human with WiFi. IEEE J. Sel. Areas Commun. 33(11), 2329–2342 (2015)CrossRefGoogle Scholar
  31. 31.
    Zeng, Y., Pathak, P.H., Mohapatra, P.: Analyzing shopper’s behavior through WiFi signals. In: Proceedings of the 2nd Workshop on Workshop on Physical Analytics, WPA 2015, New York, NY, USA, pp. 13–18. ACM (2015)Google Scholar
  32. 32.
    Zhang, C., Li, H., Wang, X., Yang, X.: Cross-scene crowd counting via deep convolutional neural networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 833–841 (2015)Google Scholar
  33. 33.
    Zhang, Y., Zhou, D., Chen, S., Gao, S., Ma, Y.: Single-image crowd counting via multi-column convolutional neural network. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 589–597 (2016)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2018

Authors and Affiliations

  • Iker Sobron
    • 1
  • Javier Del Ser
    • 2
    • 3
  • Iñaki Eizmendi
    • 1
  • Manuel Velez
    • 1
  1. 1.University of the Basque Country (UPV/EHU)BilbaoSpain
  2. 2.TECNALIA, University of the Basque Country (UPV/EHU)BizkaiaSpain
  3. 3.Basque Center for Applied Mathematics (BCAM)BizkaiaSpain

Personalised recommendations