Robust 3D Head Tracking and Its Applications

  • Wooju Ryu
  • Daijin Kim
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4642)

Abstract

The head tracking is a challenging work and a useful application in the field of computer vision. This paper proposes a fast 3D head tracking method that is working robustly under a variety of difficult conditions. First, we obtain the pose robustness by using the 3D cylindrical head model (CHM) and dynamic template. Second, we also obtain the robustness about the fast head movement by using the dynamic template. Third, we obtain the illumination robustness by modeling the illumination basis vectors and by adding them to the previous input image to adapt the current input image. Experimental results show that the proposed head tracking method outperforms the other tracking method using the fixed and dynamic template in terms of the small pose error and the higher successful tracking rate and it tracks the head successfully even if the head moves fast under the rapidly changing poses and illuminations in a speed of 10-15 frames/sec. The proposed head tracking method has a versatile applications such as a head gesture TV remote controller for the handicapped people and a drawing tool by the head movement for the entertainment.

Keywords

Head Movement Mouse Cursor Drawing Tool Head Tracking Remote Controller 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

References

  1. 1.
    Cascia, M., Sclaroff, S., Athitsos, V.: Fast, reliable head tracking under varying illumination: An approach based on robust registration of texture-mapped 3d models. IEEE Trans. Pattern Analysis and Machine Intelligence(PAMI) 22, 322–336 (2000)CrossRefGoogle Scholar
  2. 2.
    Xiao, J., Moriyama, T., Kanade, T., Cohn, J.: Robust full-motion recovery of head by dynamic templates and re-registration techniques. International Journal of Imaging Systems and Technology 13, 85–94 (2003)CrossRefGoogle Scholar
  3. 3.
    Basu, S., Essa, I., Pentland, A.: Motion regularization for model-based head tracking. In: ICPR. Proceedings of the International Conference on Pattern Recognition, vol. 3, p. 611 (1996)Google Scholar
  4. 4.
    Malciu, M., Preteux, F.: A robust model-based approach for 3d head tracking in video sequences. In: Proceedings of the Fourth IEEE International Conference on Automatic Face and Gesture Recognition, p. 169. IEEE Computer Society Press, Los Alamitos (2000)CrossRefGoogle Scholar
  5. 5.
    Lucas, B., Kanade, T.: An iterative image registration technique with an application to stereo vision. In: IJCAI. Proceedings of the 7th International Joint Conference on Artificial Intelligence, pp. 674–679 (1981)Google Scholar
  6. 6.
    Baker, S., Matthews, I.: Lucas-Kanade 20 Years On: A Unifying Framework: Part 1, tech. report CMU-RI-TR-02-16, Technical Report. Robotics Institute, Carnegie Mellon University (2002)Google Scholar
  7. 7.
    Baker, S., Gross, R., Matthews, I.: Lucas-Kanade 20 Years On: A Unifying Framework: Part 3, tech. report CMU-RI-TR-03-35, Technical Report. Robotics Institute, Carnegie Mellon University (2003)Google Scholar
  8. 8.
    Bregler, C., Malik, J.: Tracking people with twists and exponential maps. In: CVPR. IEEE Conference on Computer Vision and Pattern Recognition, pp. 8–15. IEEE Computer Society Press, Los Alamitos (1998)Google Scholar
  9. 9.
    Murray, R., Li, Z., Sastry, S.: A Mathematical Introduction to Robotic Manipulation. CRC Press, Boca Raton, USA (1994)MATHGoogle Scholar
  10. 10.
    Froba, B., Ernst, A.: Face detection with the modified census transform. In: Proceedings of the IEEE Conference on Automatic Face and Gesture Recognition, pp. 91–96. IEEE Computer Society Press, Los Alamitos (2004)CrossRefGoogle Scholar
  11. 11.
    Ryu, W., Sung, J., Kim, D.: Asian Head Movement Video Under Rapidly Changing Pose, Head Movement and Illumination AHM01, Technical Report. Intelligent Multimedia Lab, Dep. of CSE, POSTECH (2006)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2007

Authors and Affiliations

  • Wooju Ryu
    • 1
  • Daijin Kim
    • 1
  1. 1.Intelligent Multimedia Laboratory, Dept. of Computer Science and Engineering, Pohang University of Science and Technology (POSTECH), PohangKorea

Personalised recommendations