Face Re-Identification for Digital Signage Applications

  • Giovanni Maria Farinella
  • Giuseppe Farioli
  • Sebastiano Battiato
  • Salvo Leonardi
  • Giovanni Gallo
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8811)

Abstract

The estimation of soft biometric features related to a person standing in front an advertising screen plays a key role in digital signage applications. Information such as gender, age, and emotions of the user can help to trigger dedicated advertising campaigns to the target user as well as it can be useful to measure the type of audience attending a store. Among the technologies useful to monitor the customers in this context, there are the ones that aim to answer the following question: is a specific subject back to the advertising screen within a time slot? This information can have an high impact on the automatic selection of the advertising campaigns to be shown when a new user or a re-identified one appears in front the smart screen. This paper points out, through a set of experiments, that the re-identification of users appearing in front a screen is possible with a good accuracy. Specifically, we describe a framework employing frontal face detection technology and re-identification mechanism, based on similarity between sets of faces learned within a time slot (i.e., the models to be re-identified) and the set of face patches collected when a user appears in front a screen. Faces are pre-processed to remove geometric and photometric variability and are represented as spatial histograms of Locally Ternary Pattern for re-identification purpose. A dataset composed by different presentation sessions of customers to the proposed system has been acquired for testing purpose. Data have been collected to guarantee realistic variabilities. The experiments have been conducted with a leave-one-out validation method to estimate the performances of the system in three different working scenarios: one sample per presentation session for both testing and training (one-to-one), one sample per presentation session for testing and many for training (one-to-many), as well as considering many samples per presentation sessions for both testing and training (many-to-many). Experimental results on the considered dataset show that an accuracy of 88.73 % with 5 % of false positive can be achieved by using a many-to-many re-identification approach which considers few faces samples in both training and testing.

References

  1. 1.
    Aberdeen Research: Digital Signage: A Path to Customer Loyalty, Brand Awareness and Marketing Performance (2010)Google Scholar
  2. 2.
    Khatri, S.: Digital signage and professional display market set for solid growth in 2012. Signage & Professional Displays Market Tracker Report, April 2012Google Scholar
  3. 3.
    Ricanek, K., Barbour, B.: What are soft biometrics and how can they be used? Computer 44(9), 106–108 (2011)CrossRefGoogle Scholar
  4. 4.
    Batagelj, B., Ravnik, R., Solina, F.: Computer vision and digital signage. In: Tenth International Conference on Multimodal Interfaces (2008)Google Scholar
  5. 5.
    Müller, J., Exeler, J., Buzeck, M., Krüger, A.: ReflectiveSigns: digital signs that adapt to audience attention. In: Tokuda, H., Beigl, M., Friday, A., Brush, A.J.B., Tobe, Y. (eds.) Pervasive 2009. LNCS, vol. 5538, pp. 17–24. Springer, Heidelberg (2009)CrossRefGoogle Scholar
  6. 6.
    Exeler, J., Buzeck, M., Müller, J.: eMir: digital signs that react to audience emotion. In: 2nd Workshop on Pervasive Advertising, pp. 38–44 (2009)Google Scholar
  7. 7.
    Ravnik, R., Solina, F.: Audience measurement of digital signage: quantitative study in real-world environment using computer vision. Interact. Comput. 25(3), 218–228 (2013)CrossRefGoogle Scholar
  8. 8.
    Dantcheva, A., Dugelay, J.-L.: Frontal-to-side face re-identification based on hair, skin and clothes patches. In: IEEE International Conference on Advanced Video and Signal-Based Surveillance, pp. 309–313 (2011)Google Scholar
  9. 9.
    Vezzani, R., Baltieri, D., Cucchiara, R.: People re-identification in surveillance and forensics: a survey. ACM Comput. Surv. 46(2), 29:1–29:3 (2013)CrossRefGoogle Scholar
  10. 10.
    Tan, X., Triggs, B.: Enhanced local texture feature sets for face recognition under difficult lighting conditions. IEEE Trans. Image Process. 19(6), 1635–1650 (2010)MathSciNetCrossRefGoogle Scholar
  11. 11.
  12. 12.
    Viola, P., Jones, M.J.: Robust real-time face detection. Int. J. Comput. Vis. 57(2), 137–154 (2004)CrossRefGoogle Scholar
  13. 13.
    Schapire, R.E.: A brief introduction to boosting. In: International Joint Conference on Artificial intelligence (1999)Google Scholar
  14. 14.
    Zhao, W., Chellappa, R., Phillips, P.J., Rosenfeld, A.: Face recognition: a literature survey. ACM Comput. Surv. 34(4), 399–485 (2003)CrossRefGoogle Scholar
  15. 15.
    Ahonen, T., Hadid, A., Pietiknen, M.: Face description with local binary patterns: application to face recognition. IEEE Trans. Pattern Anal. Mach. Intell. 28(12), 2037–2041 (2006)CrossRefGoogle Scholar
  16. 16.
    Wang, J.-G., Yau, W.-Y., Wang, H. L.: Age categorization via ECOC with fused gabor and LBP features. In: Workshop on Applications of Computer Vision (2009)Google Scholar
  17. 17.
    Hadid, A., Pietikinen, M.: Combining appearance and motion for face and gender recognition from videos. Pattern Recognit. 42(11), 2818–2827 (2009)CrossRefGoogle Scholar
  18. 18.
    Ylioinas, J., Hadid, A., Pietikainen, M.: Age classification in unconstrained conditions using LBP variants. In: International Conference on Pattern Recognition (2012)Google Scholar
  19. 19.
    Webb, A.R.: Statistical Pattern Recognition, 2nd edn. Wiley, New York (2002)CrossRefMATHGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  • Giovanni Maria Farinella
    • 1
  • Giuseppe Farioli
    • 1
  • Sebastiano Battiato
    • 1
  • Salvo Leonardi
    • 2
  • Giovanni Gallo
    • 1
  1. 1.Image Processing Laboratory, Department of Mathematics and Computer ScienceUniversity of CataniaCataniaItaly
  2. 2.Advice S.C.CataniaItaly

Personalised recommendations