Skip to main content
SpringerLink
Log in

Long-Range Gesture Recognition Using Millimeter Wave Radar

  • Conference paper
  • First Online:
Green, Pervasive, and Cloud Computing (GPC 2020)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 12398))

Included in the following conference series:

Abstract

Millimeter wave (mmWave) based gesture recognition technology provides a good human computer interaction (HCI) experience. Prior works focus on the close-range gesture recognition, but fall short in range extension, i.e., they are unable to recognize gestures more than one meter away from considerable noise motions. In this paper, we design a long-range gesture recognition model which utilizes a novel data processing method and a customized artificial Convolutional Neural Network (CNN). Firstly, we break down gestures into multiple reflection points and extract their spatial-temporal features which depict gesture details. Secondly, we design a CNN to learn changing patterns of extracted features respectively and output the recognition result. We thoroughly evaluate our proposed system by implementing on a commodity mmWave radar. Besides, we also provide more extensive assessments to demonstrate that the proposed system is practical in several real-world scenarios.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Li, G., Wu, H., Jiang, G., Xu, S., Liu, H.: Dynamic gesture recognition in the Internet of Things. IEEE Access 7, 23713–23724 (2018). https://doi.org/10.1109/ACCESS.2018.2887223

    Article  Google Scholar 

  2. Naosekpam, V., Sharma, R.K.: Machine learning in 3D space gesture recognition. Jurnal Kejuruteraan 31, 243–248 (2019)

    Google Scholar 

  3. Liang, Y., Zhou, X., Yu, Z., Guo, B.: Energy-efficient motion related activity recognition on mobile devices for pervasive healthcare. MONET 19(3), 303–317 (2014)

    Google Scholar 

  4. Liu, W., Zhang, C., Ma, H., Li, S.: Learning efficient spatial-temporal gait features with deep learning for human identification. Neuroinformatics 16, 457–471 (2018). https://doi.org/10.1007/s12021-018-9362-4

    Article  Google Scholar 

  5. Li, S., Liu, X., Liu, W., Ma, H., Zhang, H.: A discriminative null space based deep learning approach for person re-identification. In: CCIS 2016, pp. 480–484 (2016)

    Google Scholar 

  6. Venkatnarayan, R.H., Mahmood, S., Shahzad, M.: WiFi based multi-user gesture recognition. IEEE Trans. Mob. Comput. (2019). https://doi.org/10.1109/TMC.2019.2954891

  7. Qian, K., Wu, C., Zhou, Z., Zheng, Y., Yang, Z., Liu, Y.: Inferring motion direction using commodity Wi-Fi for interactive exergames. In: ACM CHI, Denver, USA, 6–11 May 2017 (2017)

    Google Scholar 

  8. Qian, K., Wu, C., Yang, Z., Liu, Y., Jamieson, K.: Widar: decimeter-level passive tracking via velocity monitoring with commodity Wi-Fi. In: ACM MobiHoc, Chennai, India, 10–14 July 2017 (2017)

    Google Scholar 

  9. Qian, K., Wu, C., Zhang, Y., Zhang, G., Yang, Z., Liu, Y.: Widar2.0: passive human tracking with a single Wi-Fi link. In: ACM MobiSys, Munich, Germany, 10–15 June 2018 (2018)

    Google Scholar 

  10. AlSharif, M.H., Saad, M., Al-Naffouri, T.Y.: Hand gesture recognition using ultrasonic waves. Article (2017)

    Google Scholar 

  11. Das, A., Tashev, I., Mohammed, S.: Ultrasound based gesture recognition. In: Conference Paper, March (2017)

    Google Scholar 

  12. Hu, Q., Yu, Z., Wang, Z., Guo, B., Chen, C.: ViHand: gesture recognition with ambient light. In: SmartWorld/SCALCOM/UIC/ATC/CBDCom/IOP/SCI 2019, pp. 468–474 (2019)

    Google Scholar 

  13. Venkatnarayan, R.H., Shahzad, M.: Gesture recognition using ambient light. Proc. ACM Interact. Mob. Wearable Ubiquit. Technol. 2(1), 28 (2018). Article ID 40

    Article  Google Scholar 

  14. Lee, B., Park, K., Ghan, S., Chin, S.: Designing canonical form of finger motion grammar in leapmotion contents. In: 2016 International Conference on Mechatronics, Control and Automation Engineering (2016)

    Google Scholar 

  15. Sakaguchi, K., Haustein, T., et al.: Where, when, and how mmWave is used in 5G and beyond. IEICE Trans. Electron. 100, 790–808 (2017)

    Article  Google Scholar 

  16. Smith, K.A., Csech, C., Murdoch, D., Shaker, G.: Gesture recognition using mm-Wave sensor for human-car interface. IEEE Sens. Lett. 2, 1–4 (2018)

    Article  Google Scholar 

  17. Hazra, S., Santra, A.: Robust gesture recognition using millimetric-wave radar system. IEEE Sens. Lett. 2, 1–4 (2018)

    Article  Google Scholar 

  18. Liu, K., Liu, W., Gan, C., Tan, M., Ma, H.: T-C3D: temporal convolutional 3D network for real-time action recognition. In: AAAI, pp. 7138–7145 (2018)

    Google Scholar 

  19. Liu, W., Yan, C.C., Liu, J., Ma, H.: Deep learning based basketball video analysis for intelligent arena application. Multimedia Tools Appl. 76(23), 24983–25001 (2017)

    Article  Google Scholar 

  20. Song, Y., Liu, L., Ma, H., Vasilakos, A.V.: A biology-based algorithm to minimal exposure problem of wireless sensor networks. IEEE Trans. Netw. Serv. Manag. 11(3), 417–430 (2014)

    Article  Google Scholar 

  21. Zhou, A., Yang, S., Yang, Y., Fan, Y., Ma, H.: Autonomous environment mapping using commodity millimeter-wave network device. In: INFOCOM 2019, pp. 1126–1134 (2019)

    Google Scholar 

  22. Zhou, A., et al.: Robot navigation in radio beam space: leveraging robotic intelligence for seamless mmWave network coverage. In: MobiHoc 2019, pp. 161–170 (2019)

    Google Scholar 

  23. Meng, Z., et al.: Gait recognition for co-existing multiple people using millimeter wave sensing. In: AAAI (2020)

    Google Scholar 

  24. Molchanov, P., Gupta, S., Kim, K., Kautz, J.: Hand gesture recognition with 3D convolutional neural networks. NVIDIA, Santa Clara, California, USA (2015)

    Google Scholar 

  25. Dogru, S., Baptista, R., Marques, L.: Tracking drones with drones using millimeter wave radar. In: Silva, M.F., Luís Lima, J., Reis, L.P., Sanfeliu, A., Tardioli, D. (eds.) ROBOT 2019. AISC, vol. 1093, pp. 392–402. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-36150-1_32

    Chapter  Google Scholar 

  26. Wei, T., Zhang, X.: mTrack: high-precision passive tracking using millimeter wave radios. Department of Electrical and Computer Engineering (2015)

    Google Scholar 

  27. Dwivedi, S.: Simulation analysis on applicability of meta material and PBG based mm-Wave planar antenna for advanced cellular technologies. Open J. Antennas Propag. 5, 23–35 (2017)

    Article  Google Scholar 

  28. Rasekh, M.E., Marzi, Z., Zhu, Y., Madhow, U., Zheng, H.: Noncoherent mmWave path tracking (2017)

    Google Scholar 

  29. Liu, C., Li, Y., Ao, D., Tian, H.: Spectrum-based hand gesture recognition using millimeter-wave radar parameter measurements. IEEE Access 7, 79147–79158 (2019). https://doi.org/10.1109/ACCESS.2019.2923122

    Article  Google Scholar 

  30. Chuang, C.-H., Chen, Y.-N., Deng, M.-S., Fan, K.-C.: Gesture recognition based on kinect (2014)

    Google Scholar 

  31. Liu, L., Song, Y., Zhang, H., Ma, H., Vasilakos, A.V.: Physarum optimization: a biology-inspired algorithm for the Steiner tree problem in networks. IEEE Trans. Comput. 64(3), 819–832 (2013)

    MathSciNet  MATH  Google Scholar 

  32. Binh, N.D.: Gestures recognition from sound waves. Research Article EAI Endorsed Transactions on Context-aware Systems and Applications (2016)

    Google Scholar 

  33. Principle of Radar. Texas Instrument

    Google Scholar 

  34. He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: IEEE Conference on Computer Vision and Pattern Recognition. IEEE Computer Society (2016)

    Google Scholar 

Download references

Acknowledgment

The research is supported by National Key R&D Program of China (2019YFB2102202), NSFC (61772084, 61832010), the Fundamental Research Funds for the Central Universities (2019XD-A13) and OPPO research foundation.

Author information

Authors and Affiliations

  1. Beijing University of Posts and Telecommunications, Beijing, China

    Yu Liu, Yuheng Wang, Haipeng Liu & Anfu Zhou

  2. OPPO Co., Ltd., Beijing, China

    Jianhua Liu & Ning Yang

Authors
  1. Yu Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yuheng Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Haipeng Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Anfu Zhou
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Jianhua Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Ning Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Anfu Zhou .

Editor information

Editors and Affiliations

  1. Northwestern Polytechnical University, Xi’an, China

    Zhiwen Yu

  2. University of Mannheim, Mannheim, Germany

    Christian Becker

  3. Chinese University of Hong Kong, Shatin, Hong Kong

    Guoliang Xing

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Liu, Y., Wang, Y., Liu, H., Zhou, A., Liu, J., Yang, N. (2020). Long-Range Gesture Recognition Using Millimeter Wave Radar. In: Yu, Z., Becker, C., Xing, G. (eds) Green, Pervasive, and Cloud Computing. GPC 2020. Lecture Notes in Computer Science(), vol 12398. Springer, Cham. https://doi.org/10.1007/978-3-030-64243-3_3

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-64243-3_3

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-64242-6

  • Online ISBN: 978-3-030-64243-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation