Gesture Recognition System Based on RFID

  • Xuan Wang
  • Xin Kou
  • Zifan Wang
  • Lanqing Wang
  • Baoying Liu
  • Feng Chen
Conference paper
Part of the Communications in Computer and Information Science book series (CCIS, volume 747)


Gestures recognition as the main technology of human-computer interaction draws a great amount attention of researchers. Comparing to existing methods, the RFID-based passive gesture recognition requires no specialized equipment which makes it much easier to be used. To achieve the goal, we build a priori gesture database according to signal features caused by perturbation of different gestures. Then, the modified dynamic time warping (DTW) algorithm has been used to match with the priori fingerprint database. Besides, we propose a wireless phase calibration algorithm by utilizing the theory that the noise subspace and the signal subspace is orthogonal in multiple signal classification (MUSIC) algorithm to estimate and remove phase errors that may caused by equipment differences so that we can ensure the accuracy of angle of arrival (AoA) estimation. To evaluate the effectiveness of our gesture recognition system, the experiments in a real scene were carried out. And the experimental results show that we can achieve about 92% accuracy.


Gesture recognition Feature extraction Phase calibration AoA estimation DTW 


  1. 1.
    Kellogg, B., Talla, V., Gollakota, S.: Bringing gesture recognition to all devices. In: Usenix Conference on Networked Systems Design and Implementation, pp. 303–316 (2014)Google Scholar
  2. 2.
    Ziaie, P., Muller, T., Knoll, A.: A novel approach to hand-gesture recognition in a human-robot dialog system. In: First Workshops on Image Processing Theory, Tools and Applications, 2008, IPTA 2008, pp. 1–8 (2008)Google Scholar
  3. 3.
    Sun, L., Sen, S., Koutsonikolas, D., Kim, K.H.: Widraw: Enabling hands-free drawing in the air on commodity wifi devices. In: International Conference on Mobile Computing and Networking, pp. 77–89 (2015)Google Scholar
  4. 4.
    Badi, H.S., Hussein, S.: Hand posture and gesture recognition technology. Neural Comput. Appl. 25(3–4), 871–878 (2014)CrossRefGoogle Scholar
  5. 5.
    Blum, M.: After the kinect, what’s next for gesture-recognition technology? Pak. J. Biol. Sci. PJBS 13(14), 691–698 (2011)Google Scholar
  6. 6.
    Wang, J., Vasisht, D., Katabi, D.: RF-IDRAW: virtual touch screen in the air using RF signals. In: ACM Conference on SIGCOMM, pp. 235–246 (2014)Google Scholar
  7. 7.
    Youssef, M., Mah, M., Agrawala, A.: Challenges: device-free passive localization for wireless environments. In: ACM International Conference on Mobile Computing and Networking, pp. 222–229 (2007)Google Scholar
  8. 8.
    Pu, Q., Jiang, S., Gollakota, S.: Whole-home gesture recognition using wireless signals (demo). In: ACM SIGCOMM 2013 Conference on SIGCOMM, pp. 485–486 (2013)Google Scholar
  9. 9.
    Wang, Y., Liu, J., Chen, Y., Gruteser, M., Yang, J., Liu, H.: E-eyes: Device-free Location-oriented Activity Identification Using Fine-grained WiFi Signatures (2014)Google Scholar
  10. 10.
    Joshi, K., Bharadia, D., Kotaru, M., Katti, S.: Wideo: fine-grained device-free motion tracing using RF backscatter. In: Usenix Conference on Networked Systems Design and Implementation, pp. 189–204 (2015)Google Scholar
  11. 11.
    Tan, S., Yang, J.: Wifinger: leveraging commodity wifi for fine-grained finger gesture recognition. In: ACM International Symposium on Mobile Ad Hoc Networking and Computing, pp. 201–210 (2016)Google Scholar
  12. 12.
    Huang, Y.F., Yao, T.Y., Yang, H.J.: Performance of hand gesture recognition based on received signal strength with weighting signaling in wireless communications. In: International Conference on Network-Based Information Systems, pp. 596–600 (2015)Google Scholar
  13. 13.
    Wang, J., Katabi, D.: Dude, where’s my card?: RFID positioning that works with multipath and non-line of sight. In: ACM SIGCOMM Conference on SIGCOMM, pp. 51–62 (2013)Google Scholar
  14. 14.
    Fortin-Simard, D., Bouchard, K., Gaboury, S., Bouchard, B., Bouzouane, A.: Accurate passive RFID localization system for smart homes. In: IEEE International Conference on Networked Embedded Systems for Every Application, pp. 1–8 (2013)Google Scholar
  15. 15.
    Chang, L., Chen, X., Meng, H., Fang, D.: Poster: HALL: High-accuracy and low-cost RFID localization in large-scale environment. In: International Conference on Mobile Systems, Applications, and Services Companion, p. 17 (2016)Google Scholar
  16. 16.
    He, W., Wu, K., Zou, Y., Ming, Z.: WiG: Wifi-based gesture recognition system. In: International Conference on Computer Communication and Networks, pp. 1–7 (2015)Google Scholar
  17. 17.
    Abdelnasser, H., Youssef, M., Harras, K.A.: WiGest: A ubiquitous wifi-based gesture recognition system. In: IEEE Conference on Computer Communications, pp. 1472–1480 (2015)Google Scholar
  18. 18.
    Ding, H., Shangguan, L., Yang, Z., Han, J., Zhou, Z., Yang, P., Xi, W., Zhao, J.: FEMO: a platform for free-weight exercise monitoring with RFIDs. In: ACM Conference on Embedded Networked Sensor Systems, pp. 141–154 (2015)Google Scholar
  19. 19.
    Zou, Y., Xiao, J., Han, J., Wu, K., Li, Y., Ni, L.M.: GRfid: a device-free RFID-based gesture recognition system. IEEE Trans. Mobile Comput. 16(2), 381–393 (2017)CrossRefGoogle Scholar
  20. 20.
    Joshi, K., Hong, S., Katti, S.: Pinpoint: localizing interfering radios. In: Usenix Conference on Networked Systems Design and Implementation, pp. 241–254 (2013)Google Scholar
  21. 21.
    Laxmikanth, P., Susruthababu, S., Surendra, L., Babu, S.S., Ratnam, D.V.: Enhancing the performance of AOA estimation in wireless communication using the music algorithm. In: International Conference on Signal Processing and Communication Engineering Systems, pp. 448–452 (2015)Google Scholar
  22. 22.
    Lavate, T.B., Kokate, V.K., Sapkal, A.M.: Performance analysis of MUSIC and ESPRIT DOA estimation algorithms for adaptive array smart antenna in mobile communication. In: Second International Conference on Computer and Network Technology, pp. 308–311 (2010)Google Scholar
  23. 23.
    Akbari, F., Moghaddam, S.S., Vakili, V.T.: MUSIC and ESPRIT DOA estimation algorithms with higher resolution and accuracy. In: International Symposium on Telecommunications, pp. 76–81 (2011)Google Scholar
  24. 24.
    Xiong, J., Jamieson, K.: ArrayTrack: a fine-grained indoor location system. In: Usenix Conference on Networked Systems Design and Implementation, pp. 71–84 (2013)Google Scholar

Copyright information

© Springer Nature Singapore Pte Ltd. 2018

Authors and Affiliations

  • Xuan Wang
    • 1
  • Xin Kou
    • 1
  • Zifan Wang
    • 1
  • Lanqing Wang
    • 1
  • Baoying Liu
    • 1
  • Feng Chen
    • 1
  1. 1.School of Information Science and TechnologyNorthwest UniversityXi’anChina

Personalised recommendations