Eye and Nostril Localization for Automatic Calibration of Facial Action Recognition System

  • Jaromir Przybylo
Part of the Advances in Intelligent and Soft Computing book series (AINSC, volume 57)


The work presented here focusses on automatic facial action recognition using image analysis algorithms and application of facial gestures to machine control. There are many sources of variation in facial appearance which make recognition a challenging task. Therefore, machine adaptation to human and environment is — in our opinion — the key issue. The main contribution of this paper is eye and nostril localization algorithm designed to initialize facial expression recognition system or recalibrate its parameters during execution.


Automatic Calibration Facial Expression Recognition System Static Image Analysis Optimum Lighting Condition Blink Event 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Augustyniak, P., Mikrut, Z.: Complete Scanpaths Analysis Toolbox. In: IEEE Engineering in Medicine and Biology Society, EMBS 2006, pp. 5137–5140 (2006)Google Scholar
  2. 2.
    Betke, M., Gips, J., Fleming, P.: The Camera Mouse: Visual Tracking of Body Features to Provide Computer Access For People with Severe Disabilities. IEEE Trans. on Neural Systems and Rehabilitation Eng. 10, 1–10 (2002)CrossRefGoogle Scholar
  3. 3.
    Bobick, A.F., Davis, J.W.: Action Recogn. Using Temporal Templates. In: MBR 1997 (1997)Google Scholar
  4. 4.
    Broniec, A.: Motion and motion intention representation in EEG signal and possibilities of application in man – machine interface. AGH University of Science and Technology Master Thesis (2007)Google Scholar
  5. 5.
    Chau, M., Betke, M.: Real time eye tracking and blink detection with usb cameras. Boston University Computer Science (2005)Google Scholar
  6. 6.
    Evans, D.G., Drew, R., Blenkhorn, P.: Controlling mouse pointer position using an infrared head-operated joystick. IEEE Trans. on Rehabilitation Engineering 8, 107–117 (2000)CrossRefGoogle Scholar
  7. 7.
    Fasel, B., Luettin, J.: Automatic Facial Expression Analysis: A Survey. Pattern Recognition 36, 259–275 (2003)CrossRefzbMATHGoogle Scholar
  8. 8.
    Gong, S., McKenna, S.J., Psarrou, A.: Dynamic Vision: From Images to Face Recognition. Imperial College Press (2000)Google Scholar
  9. 9.
    Rein-Lien, H., Abdel-Mottaleb, M., Jain, A.K.: Face Detection in Color Images. IEEE Trans. Pattern Anal. Mach. Intell. 24, 696–706 (2002)CrossRefGoogle Scholar
  10. 10.
    Kapoor, A., Qi, Y., Picard-Rosalind, W.: Fully Automatic Upper Facial Action Recognition. AMFG, 195–202 (2003)Google Scholar
  11. 11.
    Lalonde, M., Byrns, D., Gagnon, L., Teasdale, N., Laurendeau, D.: Real-time eye blink detection with GPU-based SIFT tracking CRV, 481–487 (2007)Google Scholar
  12. 12.
    Lindeberg, T.: Scale-space theory: A basic tool for analysing structures at different scales. J. of Applied Statistics, 224–270 (1994)Google Scholar
  13. 13.
    Lisetti, C.L., Schiano, D.J.: Automatic Facial Expression Interpretation: Where Human-Computer Interaction. Artificial Intelligence and Cognitive Science Intersect. Pragmatics and Cognition 8(1), 185–235 (2002)CrossRefGoogle Scholar
  14. 14.
    Lombardi, J., Betke, M.: A Self-initializing Eyebrow Tracker for Binary Switch Emulation (2002)Google Scholar
  15. 15.
    Ober, J., Hajda, J., Loska, J.: Applications of eye movement measuring system OBER2 to medicine and technology. In: SPIE’s 11th Annual International Symposium on Aerospace/Defence Sensing, Simulation, and Controls, Infrared technology and applications, pp. 327–336 (1997)Google Scholar
  16. 16.
    Pregenzer, M., Pfurtscheller, G.: Frequency component selection for an EEG-based brain to computer interface. IEEE Transactions on Rehabilitation Engineering 7, 246–252 (1999)CrossRefGoogle Scholar
  17. 17.
    Przybylo, J.: Automatic facial action recognition in face images and analysis of those within Human-Machine Interaction context. AGH University of Science and Technology, adviser: Piotr Augustyniak DSc EE (2008)Google Scholar
  18. 18.
    Zhouand, Z.H., Geng, X.: Projection functions for eye detection. Pattern Recognition 37, 1049–1056 (2004)CrossRefGoogle Scholar
  19. 19.
    Zhiwei, Z.: Real-time eye detection and tracking under various light conditions, pp. 139–144. ACM Press, New York (2002)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Jaromir Przybylo
    • 1
  1. 1.AGH University of Science and TechnologyKrakowPoland

Personalised recommendations