Human Hand Gesture Recognition Using Motion Orientation Histogram for Interaction of Handicapped Persons with Computer

  • Maryam Vafadar
  • Alireza Behrad
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5099)


Some groups of handicapped persons cannot reliably move the mouse and do the necessary operation on it to control the computer. However they can do some 3-d hand motions. Variety of tools has been presented for these users to interact with computer. Hand gesture recognition is one of the proper methods for this purpose. This paper presents a new algorithm for hand gesture recognition. In this algorithm, after constructing motion history image of video frames for each gesture and applying necessary processing on this image, motion orientation histogram vector is extracted. These vectors are then used for the training of Hidden Markov Model and hand gesture recognition. We tested the proposed algorithm with different hand gestures and results showed the correct gesture recognition rate of 90 percent. Comparing the results of proposed method with those of other methods showed that in addition to eliminating traditional problems in this area, recognition rate has been improved up to 4 percent.


Hand gesture recognition Motion history image Hidden Markov model Motion orientation histogram 


  1. 1.
    Derpanis., G.: A Review of Vision-Based Hand Gestures. York University (2004)Google Scholar
  2. 2.
    Hai., W., Shamaie., A., Sutherland., A.: Real Time Gesture Recognition of Human Hand
  3. 3.
    Mu-Chun, S.: A Neural Network-Based Approach to Recognizing 3D Arm Movement, Biomedical Engineering Application. Basis and Communication 15(1), 17–26 (2003)CrossRefGoogle Scholar
  4. 4.
    Hou., X., Li., S.Z., Zhang., H., Cheng., Q.: Direct Appearance Models. In: Proc. Of IEEE Conf. on Computer Vision and Pattern Recognition, vol. 1, pp. 828–833 (2001)Google Scholar
  5. 5.
    Shalbaf, R., Vafadoost, M., Shalbaf, A.: Lipreading Using Image Processing for Helping Handicap. In: Iranian conf. on Biomedical Engineering (2007)Google Scholar
  6. 6.
    Trucco., E., Verri., A.: Introductory Techniques for 3-D Computer Vision. Prentice-Hall, New Jersey (1998)Google Scholar
  7. 7.
    Harding., P.R.G., Ellis., T.: Recognition Hand Gesture Using Fourier Descriptors. In: Proc. of IEEE Conf. on Pattern Recognition (ICPR 2004), vol. 3, pp. 286–289 (2004)Google Scholar
  8. 8.
    Dionisio, C.R.P., Cesar Jr., R.M.: A Project for Hand Gesture Recognition. In: Proc. of IEEE Symposium on Computer Graphics and Image Processing, p. 345 (2000)Google Scholar
  9. 9.
    Lamar., M.V., Bhuiyan, M.S., Iwata., A.: Hand Gesture Recognition Analysis and an Iimproved CombNET-II. In: Proc. Of IEEE Conf. on Man and Cybernetics, vol. 4 (1999)Google Scholar
  10. 10.
    Moghaddam, B., Pentland, A.: Probabilistic Visual Learning for Object Detection. In: Conf. on Computer Vision, Cambridge, MA (1995)Google Scholar
  11. 11.
    Moghaddam, B.: Principal Manifolds and Bayesian Subspaces for Visual Recognition. In: Proc. Of IEEE Conf. on Computer Vision, ICCV 1999 (1999)Google Scholar
  12. 12.
    Freeman, W.T., Roth, M.: Orientation Histogram for Hand Gesture Recognition. In: IEEE Int. Workshop on Automatic face and gesture recognition (1995)Google Scholar
  13. 13.
    Black, M., Yacoob, Y.: Tracking and Recognizing Rigid and Non-rigid Facial Motion Using Local Parametric Models of Image Motion. In: Proc. Of IEEE Conf. on Computer Vision, ICCV 1995 (1995)Google Scholar
  14. 14.
    Shan., C., Yucheng., W., Xianchao., Q., Tieniu., T.: Gesture Recognition Using Temporal Template Based Trajectories. In: Int. Conf. on Pattern Recognition, vol. 3, pp. 954–957 (2004)Google Scholar
  15. 15.
    Kumar, S., Kumar, D.K., Sharma, A., McLachlan, N.: Classification of Hand Movements Using Motion Templates and Geometrical based Moments, 3, pp. 299–304 (2004)Google Scholar
  16. 16.
    Venkatesh Babu, R., Ramakrishnan, K.R.: Recognition of Human Actions Using Motion History Information Extracted from the Compressed Video, vol. 22, pp. 597–607 (2004)Google Scholar
  17. 17.
    Ogata, T., Tan, J.K., Ishikawa, S.: High-Speed Human Motion Recognition Based on a Motion History Image and an Eigenspace. IEICE Trans. on Information and Systems E89-D, 281–289 (2006)CrossRefGoogle Scholar
  18. 18.
    Bobick., A.F.: Computers Seening Action, MIT media library (1997)Google Scholar
  19. 19.
    Davis., J.W.: Hierarchical Motion History Images for Recognizing Human Motion, Department of computer and Information science of Ohio state university (2002)Google Scholar
  20. 20.
    Kenny, M., McKenna, S.J.: An Experimental Comparison of Trajectory-Based and History-Based Representation for Gesture. In: Camurri, A., Volpe, G. (eds.) GW 2003. LNCS (LNAI), vol. 2915, pp. 152–163. Springer, Heidelberg (2004)Google Scholar
  21. 21.
    Keskin, C., Erkan, A., Akarun, L.: Real time Hand Tracking and 3D Gesture Recognition for Interactive Interfaces using HMM, Bogazici university, Eusipco (2005)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2008

Authors and Affiliations

  • Maryam Vafadar
    • 1
  • Alireza Behrad
    • 1
  1. 1.Faculty of EngineeringShahed UniversityTehranIran

Personalised recommendations