A Probabilistic Approach to Semantic Face Retrieval System

  • Karthik Sridharan
  • Sankalp Nayak
  • Sharat Chikkerur
  • Venu Govindaraju
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3546)


A probabilistic system that retrieves face images based on verbal descriptions given by users is proposed. This interactive system prompts the user at each stage of query to provide a description about a facial feature that will help it to retrieve the required face image. It is a soft biometric system that groups people by the description of their faces. The method proposed automates the process of extracting general verbal descriptions of faces like ’long nosed’ or ’blonde haired’ and performs queries on them. The proposed method uses Bayesian learning for the query process and hence is more immune to errors in both the extraction of semantic descriptions and user given information. It was found that the required face image appeared 77.6% of the time within the top 5 and 90.4% of the time within the top 10 retrieved face images.


Skin Color Face Detection Verbal Description Semantic Description Require Person 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Bruce, V.: Recognizing Faces, Faces as Patterns, pp. 37–58. Lawrence Earlbaum Associates, Mahwah (1988)Google Scholar
  2. 2.
    Frowd, C.D., Hancock, P.J.B., Carson, D.: EvoFIT: A Holistic, Evolutionary Facial Imaging Technique for Creating Composites. ACM TAP 1(1) (2004)Google Scholar
  3. 3.
    Phantomas Elaborate Face Recognition,Product description:
  4. 4.
    Wu, J.K., Ang, Y.H., Lam, P.C., Moorthy, S.K., Narasimhalu, A.D.: Facial Image Retrieval, Identification, and Inference System. In: Proceedings of the first ACM international conference on Multimedia, pp. 47–55 (1993)Google Scholar
  5. 5.
    Pentland, A., Picard, R., Sclaroff, S.: Photobook: tools for content based manipulation of image databases. In: Proc. SPIE: Storage and Retrieval for Image and Video Databases II, vol. 2185Google Scholar
  6. 6.
    Martinez, A.M., Benavente, R.: The AR face database, CVC Tech. Report No. 24 (1998)Google Scholar
  7. 7.
    Benn, D.E., Nixon, M.S., Carter, J.N.: Robust Eye Centre Extraction Using the Hough Transform. In: AVBPA, pp. 3–9 (1997)Google Scholar
  8. 8.
    Vezhnevets, V., Sazonov, V., Andreeva, A.: A Survey on Pixel-Based Skin Color Detection Techniques. In: Proc. Graphicon-2003, Moscow, Russia, September 2003, pp. 85–92 (2003)Google Scholar
  9. 9.
    Wark, T., Sridharan, S.: A syntatic approach to automatic lip feature extraction for speaker identification. In: ICASSP, pp. 3693–3696 (1998)Google Scholar
  10. 10.
    Sahasrabudhe, S.C., Gupta, K.S.D.: A Valley-seeking Threshold Selection Technique. In: Rosenfeld, A., Shapiro, L. (eds.) Computer Vision and Image Processing, pp. 55–65. Academic Press, London (1992)Google Scholar
  11. 11.
    Turk, M., Pentland, A.: Eigenfaces for recognition. Journal of Cognitive Neuroscience 3(1), 71–86 (1991)CrossRefGoogle Scholar
  12. 12.
    Laughery, K.R., Fowler, R.H.: Sketch Artists and Identi-kit, Procedure for Recalling Faces. Journal of Applied Psychology 65(3), 307–316 (1980)CrossRefGoogle Scholar
  13. 13.
    Dony, R.D., Wesolkowski, S.: Edge detection on color images using RGB vector angles. In: Proc. IEEE Can. Conf. Electrical and Computer Engineering, pp. 687–692 (1999)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2005

Authors and Affiliations

  • Karthik Sridharan
    • 1
  • Sankalp Nayak
    • 1
  • Sharat Chikkerur
    • 1
  • Venu Govindaraju
    • 1
  1. 1.Center for Unified Biometrics and Sensors University at BuffaloUSA

Personalised recommendations