Multimedia Tools and Applications

, Volume 51, Issue 2, pp 739–777 | Cite as

Bag of soft biometrics for person identification

New trends and challenges
  • Antitza Dantcheva
  • Carmelo Velardo
  • Angela D’Angelo
  • Jean-Luc Dugelay


In this work we seek to provide insight on the general topic of soft biometrics. We firstly present a new refined definition of soft biometrics, emphasizing on the aspect of human compliance, and then proceed to identify candidate traits that accept this novel definition. We then address relations between traits and discuss associated benefits and limitations of these traits. We also consider two novel soft biometric traits, namely weight and color of clothes and we analyze their reliability. Related promising results on the performance are provided. Finally, we consider a new application, namely human identification solely carried out by a bag of facial, body and accessory soft biometric traits, and as an evidence of its practicality, we provide preliminary promising results.


Soft biometrics Weight Clothes color Bag of soft biometrics Human identification Multibiometrics Biometrics 


  1. 1.
    Adjeroh D, Cao D, Piccirilli M, Ross A (2010) Predictability and correlation in human metrology. In: Proceedings WIFSGoogle Scholar
  2. 2.
    Ailisto H, Vildjiounaite E, Lindholm M, Makela SM, Peltola J (2006) Soft biometrics-combining body weight and fat measurements with fingerprint biometrics. Pattern Recogn Lett 27(5):325–334CrossRefGoogle Scholar
  3. 3.
    Baluja S, Rowley HA (2006) Boosting sex identification performance. Int J Comput Vis 71:111–119CrossRefGoogle Scholar
  4. 4.
    BenAbdelkader C, Davis L (2006) Estimation of anthropomeasures from a single calibrated camera. In: Proceedings of FG, pp 499–504Google Scholar
  5. 5.
    Berlin B, Kay P (1993) Basic color terms; their universality and evolution. Van Nostrand Reinhold, LondonGoogle Scholar
  6. 6.
    Caifeng S, Shaogang G, McOwand PW (2007) Learning gender from human gaits and faces. In: Proceedings of AVSS, pp 505–510Google Scholar
  7. 7.
    Carnicky J, Chorvat, JD (2006) Three-dimensional measurement of human face with structured-light illumination. Meas Sci Rev 6:1–4Google Scholar
  8. 8.
    Coe TR, Halkes M, Houghton K, Jefferson D (2002) The accuracy of visual estimation of weight and height in pre-operative supine patients. Anaesthesia 54(6):582–586CrossRefGoogle Scholar
  9. 9.
    Center for Disease Control and Prevention CDC. National health and nutrition examination survey, 1999–2005.
  10. 10.
    Chiraz BA, Cutler R, Davis L (2002) View-invariant estimation of height and stride for gait recognition. In: Proceedings of ICBA, vol 2359/2006, pp 155–167Google Scholar
  11. 11.
    Criminisi A, Reid I, Zisserman A (2000) Single view metrology. Int J Comput Vis 40(2):123–148zbMATHCrossRefGoogle Scholar
  12. 12.
    Dantcheva A, Dugelay J-L, Elia P (2010) Person recognition using a bag of facial soft biometrics (BoFSB). In: Proceedings of MMSPGoogle Scholar
  13. 13.
    Dantcheva A, Dugelay J-L, Elia P (2010) Soft biometrics systems: reliability and scaling laws. In: Proceedings of BTASGoogle Scholar
  14. 14.
    Dantcheva A, Erdogmus N, Dugelay J-L (2011) On the reliability of eye color classification as a soft biometrics trait. In: Proceedings of WACV (to appear)Google Scholar
  15. 15.
    D’Angelo A, Dugelay J-L (2010) A statistical approach to culture colors distribution in video sensors. In: Proceedings of VPQMGoogle Scholar
  16. 16.
    D’Angelo A, Dugelay J-L (2011) People re-identification in camera networks based on probabilistic color histograms. In: Proceedings of electronic imaging (to appear)Google Scholar
  17. 17.
    De Mendonca MC (2000) Estimation of height from the length of long bones in a portuguese adult population. Am J Phys Anthropol 112(1):39–48CrossRefGoogle Scholar
  18. 18.
    Denman S, Fookes C, Bialkowski A, Sridharan S (2009) Soft-biometrics: unconstrained authentication in a surveillance environment. In: Proceedings of DICTA, pp 196–203Google Scholar
  19. 19.
    Duyar I, Pelin C (2003) Body height estimation based on tibia length in different stature groups. Am J Phys Anthropol 122(1):23–27CrossRefGoogle Scholar
  20. 20.
    Givens G, Beveridge JR, Draper BA, Bolme D (2003) A statistical assessment of subject factors in the pca recognition of human faces. In: Proceedings of CVPRGoogle Scholar
  21. 21.
    Gray D, Brennan S, Tao H (2007) Evaluating appearance models for recognition, reacquisition, and tracking. In: Proceedings of PETSGoogle Scholar
  22. 22.
    Gutta S, Wechsler H (1999) Gender and ethnic classification of human faces using hybrid classifiers. In: Proceedings of IJCNN, vol 6, pp 4084–4089Google Scholar
  23. 23.
    Gutta S, Phillips J, Wechsler H (1998) Gender and ethnic classification of face images. In: Proceedings of FG, pp 194–199Google Scholar
  24. 24.
    Gutta S, Huang JRJ, Jonathon P, Wechsler H (2000) Mixture of experts for classification of gender, ethnic origin, and pose of human faces. Trans Neural Netw 11:948–960CrossRefGoogle Scholar
  25. 25.
    Hadid A, Pietikaeinen M, Martinkauppi B (2002) Color-based face detection u sing skin locus model and hierarchical filtering. In: Proceedings of ICPR, pp 196–200Google Scholar
  26. 26.
    Heo J, Kong SG, Abidi BR, Abidi MA (2004) Fusion of visual and thermal signatures with eyeglass removal for robust face recognition. In: Proceedings of CVPRW, p 122Google Scholar
  27. 27.
    Hong L, Jain AK, Pankanti S (1999) Can multibiometrics improve performance? In: Proceedings of AutoID, vol 99, pp 59–64Google Scholar
  28. 28.
    Hosoi S, Takikawa E, Kawade M (2004) Ethnicity estimations with facial images. In: Proceedings of FG, pp 195–200Google Scholar
  29. 29.
    II H, William L, Larkin GL, Trujillo MJ, Hinds JL, Delaney KA (2004) Errors in weight estimation in the emergency department: comparing performance by providers and patients. J Emerg Med 27(3):219–224CrossRefGoogle Scholar
  30. 30.
    Indovina M, Uludag U, Snelick R, Mink A, Jain AK (2003) Multimodal biometric authentication methods: a COTS approach. In: Proceedings of MMUA, pp 99–106Google Scholar
  31. 31.
    Jain AK, Dass SC, Nandakumar K (2004) Soft biometric traits for personal recognition systems. In: Proceedings of ICBA. Springer, pp 1–40Google Scholar
  32. 32.
    Jain AK, Dass SC, Nandakumar K (2004) Can soft biometric traits assist user recognition? In: Proceedings of SPIE, vol 5404, pp 561–572Google Scholar
  33. 33.
    Jeges E, Kispal I, Hornak Z (2008) Measuring human height using calibrated cameras. In: Proceedings of HSI, pp 755–760Google Scholar
  34. 34.
    Jiang X, Binkert M, Achermann B, Bunke H (2000) Towards detection of glasses in facial images. PAA 3:9–18Google Scholar
  35. 35.
    Joachims T (1998) Text categorization with support vector machines: learning with many relevant features. In: Proceedings of ECML. Springer, pp 137–142Google Scholar
  36. 36.
    Johansson G (1973) Visual perception of biological motion and a model for its analysis. Perceiving Events and Objects 3Google Scholar
  37. 37.
    Kakumanua P, Makrogiannis S, Bourbakis N (2007) A survey of skin-color modeling and detection methods. In: Proceedings of ICPR, vol 40.Google Scholar
  38. 38.
    Kaushik N, Mittal A (2006) A novel beard removal method based on structural similarity and coordinate transformations. In: Proceedings of INDICON, pp 270.1–270.6Google Scholar
  39. 39.
    Keys A, Fidanza F, Karvonen MJ, Kimura N, Taylor HL (1972) Indices of relative weight and obesity. J Chronic Dis 25(6–7):329–343CrossRefGoogle Scholar
  40. 40.
    Keller JM, Gray MR, Givens JR (1985) A fuzzy k-nearest neighbor algorithm. Trans Syst Man Cybern 15(4):581Google Scholar
  41. 41.
    Lazebnik S, Schmid C, Ponce J (2006) Beyond bags of features: spatial pyramid matching for recognizing natural scene categories. In: Proceedings of ICPR, vol 2Google Scholar
  42. 42.
    Lee J-E, Jain AK, Jin R (2008) Scars, marks and tattoos (SMT): soft biometric for suspect and victim identification. In: Proceedings of BCCGoogle Scholar
  43. 43.
    Lin H, Lu H, Zhang L (2006) A new automatic recogntion system of gender, age and ethnicity. In: Proceedings of WCICA, vol 2, pp 9988–9991Google Scholar
  44. 44.
    Lu X, Jain AK (2004) Ethnicity identification from face images. In: Proceedings of SPIE, vol 5404, pp 114–123Google Scholar
  45. 45.
    Madden C, Piccardi M (2005) Height measurement as a session-based biometric for people matching across disjoint camera views. In: Proceedings of image and vision computing New ZealandGoogle Scholar
  46. 46.
    Matta F, Saeed U, Mallauran C, Dugelay J-L (2008) Facial gender recognition using multiple sources of visual information. In: Proceedings of MMSP, pp 785–79Google Scholar
  47. 47.
    Menon S, Kelly AM (2005) How accurate is weight estimation in the emergency department? Emergency Medicine Australasia 17(2):113–116CrossRefGoogle Scholar
  48. 48.
    Mikolajczyk K, Schmid C, Zisserman A (2004) Human detection based on a probabilistic assembly of robust part detectors. In: Proceedings of ECCV. Springer, pp 69–82Google Scholar
  49. 49.
    Moustakas K, Tzovaras D, Stavropoulos G (2010) Gait recognition using geometric features and soft biometrics. Signal Process Lett 17:367–370CrossRefGoogle Scholar
  50. 50.
    Newham E (1995) The biometric report. SJB Services, New YorkGoogle Scholar
  51. 51.
    Nixon M (1985) Eye spacing measurement for facial recognition. In: Proceedings of SPIE, vol 575, pp 279–285Google Scholar
  52. 52.
    Nkengne A, Bertin C, Stamatas GN, Giron A, Issachar A, Rossi N, Fertil B (2008) Influence of facial skin attributes on the perceived age of Caucasian women. J Eur Acad Dermatol Venereol 22:982–991CrossRefGoogle Scholar
  53. 53.
    O’Toole A, Peterson A, Deffenbacher K (1994) Structural aspects of face recognition and the other race effect. Mem Cogn 22:208–224Google Scholar
  54. 54.
    Patterson E, Sethuram A, Alber M, Ricanek K, King M (2007) Aspects of age variation in facial morphology affecting biometrics. In: Proceedings of BTASGoogle Scholar
  55. 55.
    Poh N, Bengio S (2006) Using chimeric users to construct fusion classifiers in biometric authentication tasks: an investigation. In: Proceedings of ICASSP, vol 5Google Scholar
  56. 56.
    Puhan NB, Sudha N (2008) A novel iris database indexing method using the iris color. In: Proceedings of ICIEA, pp 1886–1891Google Scholar
  57. 57.
    Rhodes HTF (1956) Alphonse Bertillon: father of scientific detection. Abelard-Schuman, New York: 27Google Scholar
  58. 58.
    Saatci Y, Town C (2006) Cascaded classification of gender and facial expression. In: Proceedings of FG, pp 393–400Google Scholar
  59. 59.
    Samangooei S, Nixon M, Guo B (2008) The use of semantic human description as a soft biometric. In: Proceedings of BTASGoogle Scholar
  60. 60.
    Sun Z, Bebis G, Yuan X, Louis SJ (2002) Genetic feature subset selection for gender classification: a comparison study. In: Proceedings of WACV, p 165Google Scholar
  61. 61.
    Sun D, Zhao M, He H (2008) Hair-color modeling and head detection. In: Proceedings of WCICA, pp 7773–7776Google Scholar
  62. 62.
    Vaquero D, Feris R, Tran D, Brown L, Hampapur A, Turk M (2009) Attribute-based people search in surveillance environments. In: Proceedings of WACVGoogle Scholar
  63. 63.
    Velardo C, Dugelay J-L (2010) Weight estimation from visual body appearance. In: Proceedings of BTASGoogle Scholar
  64. 64.
    Violoa P, Jones M (2001) Robust real-time face detection. In: Proceedings of ICCV, p 747Google Scholar
  65. 65.
    Wang L, Tan T, Ning H, Hu W (2003) Silhouette analysis-based gait recognition for human identification. Trans Pattern Anal Mach Intell 25(12):1505–1518CrossRefGoogle Scholar
  66. 66.
    Wayman JL (1997) Large-scale civilian biometric systems-issues and feasibility. In: Proceedings of card tech/secure tech ID, vol 732Google Scholar
  67. 67.
    Weda H, Barbieri M (2007) Automatic children detection in digital images. In: Proceedings of ICMEGoogle Scholar
  68. 68.
    Wolf F, Poggio T, Sinha P (2006) Bags of words. CiteseerGoogle Scholar
  69. 69.
    Wu H, Yoshikawa G, Shioyama T, Lao S, Kawade M (2002) Glasses frame detection with 3D Hough transform. In: Proceedings of ICPR, vol 16, pp 346–349Google Scholar
  70. 70.
    Xiao Y, Yan H (2004) Extraction of glasses in human face images. Springer, pp 1–23Google Scholar
  71. 71.
    Zewail R, Elsafi A, Saeb M, Hamdy N (2004) Soft and hard biometrics fusion for improved identity verification. In: Proceedings of MWSCASGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC 2010

Authors and Affiliations

  • Antitza Dantcheva
    • 1
  • Carmelo Velardo
    • 1
  • Angela D’Angelo
    • 1
  • Jean-Luc Dugelay
    • 1
  1. 1.EURECOMSophia AntipolisFrance

Personalised recommendations