Skip to main content

Human Computer Interaction Through Hand Gestures for Home Automation Using Microsoft Kinect

  • Conference paper
  • First Online:
Proceedings of International Conference on Communication and Networks

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 508))

Abstract

Gesture recognition has been an attractive area of research since a long time. With the introduction of Microsoft Kinect, hand gesture and body gesture recognition has become handy for the researchers. Here an innovative application has been presented which controls all electrical home appliances through hand gestures. The algorithm presented here is an assistive application useful for physically challenged and senior citizens. In this paper we have used Microsoft Kinect for image capturing along with some important computer vision (CV) and digital image processing techniques (DIP) for hand gesture recognition. Arduino Uno microcontroller and relay circuits are used for controlling electrical devices. The algorithm presented gives an accuracy of 88 %.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. El-Sawah A., Georganas N., Petiriu E., A prototype for 3-D hand tracking and posture estimation, IEEE transaction of Instrum Meas, vol. 57(8), pp. 1627–1636 (2008).

    Google Scholar 

  2. P. Premaratne, Human Computer Interaction using Hand Gesture Recognition, Springer (2014).

    Google Scholar 

  3. Pavlovic V., Sharma R., Huang T., Visual Interpretation of Hand Gesture for Human Computer Interaction, IEEE transaction on Pattern Analysis and Machine Intelligence, vol. 19(7), pp. 677–695 (1997).

    Google Scholar 

  4. Erol A., Bebis G., Nicolescu M., Boyle R., Twombly X., Vision Based Hand Pose Estimation: A Review, Computer Vision and Image Understanding, pp. 52–73 (2007).

    Google Scholar 

  5. Suarez J., Murphy R., Hand Gesture Recognition with Depth Image: A Review, IEEE International Symposium on Robot and Human Interactive Communication, pp. 9–13 (2012).

    Google Scholar 

  6. Agrawal I., Johar S.,Santhosh J., A Tutor for the Hearing Impaired (Developed using Automatic Gesture Recognition), International Journal of Computer Science, Engineering and Application, vol. 1(4), pp. 49–61 (2011).

    Google Scholar 

  7. Ren Z., Youn J., Meng J., Zhang Z., Robust Part Based Hand Gesture Recognition Using Kinect Sensor, IEEE Transaction Multimedia, vol. 15(5), pp. 1110–1120 (2013).

    Google Scholar 

  8. Arun K., Chris Z., Joseph and J. L. Jr., Poster: Real Time Markless Kinect Based Finger Tracking and Hand Gesture Recognition, In IEEE Symposium on 3D User Interface, Orlando, USA (2013).

    Google Scholar 

  9. Verma H., Aggarwal E., Chandra S., Gesture Recognition using Kinect for Sign Language Transalation, In IEEE International Conference on Image Processing (ICIIP-2013) (2013).

    Google Scholar 

  10. Shukla J., Dwivedi A., A Method for Hand Gesture Recognition, In Fourth International Conference on Communication System and Network Technologies (2014).

    Google Scholar 

  11. C. Cliff and S. S. Mirfakhroei, “Hand Gesture Recognition Using Kinect,” Technical Report No ECE-2013-04, Boston University (2013).

    Google Scholar 

  12. Du H., To T.H., Hand Gesture Recognition using Kinect, Technical Report No. ECE-2011-04, Boston University (2011).

    Google Scholar 

  13. Raheja J., Chaudhary A., Singal K., Tracking of Fingertips and Centre of Palm using Kinect, In IEEE International Conference on Computational Intelligence, Modelling and Simulation, Malaysia (2011).

    Google Scholar 

  14. Biswas K., Basu S., Gesture REcognition using Microsoft Kinect, In 5th International Conference on Automation, Robotics and Application, Wellington, Newzeland (2011).

    Google Scholar 

  15. Jing P., Ye-Peng G., Human Computer Interaction using Pointing Gesture based on an Adaptive Virtual Touch Screen, International Journal of Signal Processing, Image Processing and Pattern Recognition, vol. 6(4), pp. 81–91 (2013).

    Google Scholar 

  16. Hamissi M., Foez K., Real Time Hand Gesture Recognition Based on Depth Map for Human Robot Interaction, International Journal of Electrical and Computer Engineering, vol. 3(6), pp. 770–778 (2013).

    Google Scholar 

  17. Verma H.V., Eshan A., Chandra S., Gesture Recognition Using Kinect for Sign Language Translation, In IEEE Second International Conference on Image Information Processing (ICIIP-2013) (2013).

    Google Scholar 

  18. Marin G., Fraccaro M., Donadeo M., Dominio F., Zanuttigh P., Palm Area Detection for Reliable Hand Gesture Recognition, In IEEE International Workshop on Multimedia Signal Processing 2013 (MMSP-2013) (2013).

    Google Scholar 

  19. Han J., Shao L., Xu D., Shotton J., Enhance Computer Vision with Microsoft Kinect Sensor - A Review, IEEE Transaction on Cybernetics, vol. 43(5), pp. 1318–1334 (2013).

    Google Scholar 

  20. Mitra S., Acharya T., Gesture Recognition: A survey, IEEE Transaction on System, Man and Cybernetics - Part C: Applications and Reviews, vol. 37(3), pp. 311–324 (2007).

    Google Scholar 

  21. Otsu N., A Threshold Selection Method from Gray-Level Histograms, IEEE Transactions on Systems, Man, and Cybernetics, vol. 9(1), pp. 62–66 (1979).

    Google Scholar 

  22. Hu, Ming-Kuei, Visual pattern recognition by moment invariants, IRE Transaction on Information Theory, vol. 8(2), pp. 179–187 (1962).

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Smit Desai .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer Nature Singapore Pte Ltd.

About this paper

Cite this paper

Desai, S., Desai, A. (2017). Human Computer Interaction Through Hand Gestures for Home Automation Using Microsoft Kinect. In: Modi, N., Verma, P., Trivedi, B. (eds) Proceedings of International Conference on Communication and Networks. Advances in Intelligent Systems and Computing, vol 508. Springer, Singapore. https://doi.org/10.1007/978-981-10-2750-5_3

Download citation

  • DOI: https://doi.org/10.1007/978-981-10-2750-5_3

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-10-2749-9

  • Online ISBN: 978-981-10-2750-5

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics