Abstract
The estimation of soft biometric features related to a person standing in front an advertising screen plays a key role in digital signage applications. Information such as gender, age, and emotions of the user can help to trigger dedicated advertising campaigns to the target user as well as it can be useful to measure the type of audience attending a store. Among the technologies useful to monitor the customers in this context, there are the ones that aim to answer the following question: is a specific subject back to the advertising screen within a time slot? This information can have an high impact on the automatic selection of the advertising campaigns to be shown when a new user or a re-identified one appears in front the smart screen. This paper points out, through a set of experiments, that the re-identification of users appearing in front a screen is possible with a good accuracy. Specifically, we describe a framework employing frontal face detection technology and re-identification mechanism, based on similarity between sets of faces learned within a time slot (i.e., the models to be re-identified) and the set of face patches collected when a user appears in front a screen. Faces are pre-processed to remove geometric and photometric variability and are represented as spatial histograms of Locally Ternary Pattern for re-identification purpose. A dataset composed by different presentation sessions of customers to the proposed system has been acquired for testing purpose. Data have been collected to guarantee realistic variabilities. The experiments have been conducted with a leave-one-out validation method to estimate the performances of the system in three different working scenarios: one sample per presentation session for both testing and training (one-to-one), one sample per presentation session for testing and many for training (one-to-many), as well as considering many samples per presentation sessions for both testing and training (many-to-many). Experimental results on the considered dataset show that an accuracy of 88.73 % with 5 % of false positive can be achieved by using a many-to-many re-identification approach which considers few faces samples in both training and testing.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsNotes
- 1.
In our experiments the LTP threshold \(t\) has been fixed as suggested in [10].
References
Aberdeen Research: Digital Signage: A Path to Customer Loyalty, Brand Awareness and Marketing Performance (2010)
Khatri, S.: Digital signage and professional display market set for solid growth in 2012. Signage & Professional Displays Market Tracker Report, April 2012
Ricanek, K., Barbour, B.: What are soft biometrics and how can they be used? Computer 44(9), 106–108 (2011)
Batagelj, B., Ravnik, R., Solina, F.: Computer vision and digital signage. In: Tenth International Conference on Multimodal Interfaces (2008)
Müller, J., Exeler, J., Buzeck, M., Krüger, A.: ReflectiveSigns: digital signs that adapt to audience attention. In: Tokuda, H., Beigl, M., Friday, A., Brush, A.J.B., Tobe, Y. (eds.) Pervasive 2009. LNCS, vol. 5538, pp. 17–24. Springer, Heidelberg (2009)
Exeler, J., Buzeck, M., Müller, J.: eMir: digital signs that react to audience emotion. In: 2nd Workshop on Pervasive Advertising, pp. 38–44 (2009)
Ravnik, R., Solina, F.: Audience measurement of digital signage: quantitative study in real-world environment using computer vision. Interact. Comput. 25(3), 218–228 (2013)
Dantcheva, A., Dugelay, J.-L.: Frontal-to-side face re-identification based on hair, skin and clothes patches. In: IEEE International Conference on Advanced Video and Signal-Based Surveillance, pp. 309–313 (2011)
Vezzani, R., Baltieri, D., Cucchiara, R.: People re-identification in surveillance and forensics: a survey. ACM Comput. Surv. 46(2), 29:1–29:3 (2013)
Tan, X., Triggs, B.: Enhanced local texture feature sets for face recognition under difficult lighting conditions. IEEE Trans. Image Process. 19(6), 1635–1650 (2010)
Microsoft Kinect. http://www.microsoft.com/en-us/kinectforwindows/
Viola, P., Jones, M.J.: Robust real-time face detection. Int. J. Comput. Vis. 57(2), 137–154 (2004)
Schapire, R.E.: A brief introduction to boosting. In: International Joint Conference on Artificial intelligence (1999)
Zhao, W., Chellappa, R., Phillips, P.J., Rosenfeld, A.: Face recognition: a literature survey. ACM Comput. Surv. 34(4), 399–485 (2003)
Ahonen, T., Hadid, A., Pietiknen, M.: Face description with local binary patterns: application to face recognition. IEEE Trans. Pattern Anal. Mach. Intell. 28(12), 2037–2041 (2006)
Wang, J.-G., Yau, W.-Y., Wang, H. L.: Age categorization via ECOC with fused gabor and LBP features. In: Workshop on Applications of Computer Vision (2009)
Hadid, A., Pietikinen, M.: Combining appearance and motion for face and gender recognition from videos. Pattern Recognit. 42(11), 2818–2827 (2009)
Ylioinas, J., Hadid, A., Pietikainen, M.: Age classification in unconstrained conditions using LBP variants. In: International Conference on Pattern Recognition (2012)
Webb, A.R.: Statistical Pattern Recognition, 2nd edn. Wiley, New York (2002)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Farinella, G.M., Farioli, G., Battiato, S., Leonardi, S., Gallo, G. (2014). Face Re-Identification for Digital Signage Applications. In: Distante, C., Battiato, S., Cavallaro, A. (eds) Video Analytics for Audience Measurement. VAAM 2014. Lecture Notes in Computer Science(), vol 8811. Springer, Cham. https://doi.org/10.1007/978-3-319-12811-5_3
Download citation
DOI: https://doi.org/10.1007/978-3-319-12811-5_3
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-12810-8
Online ISBN: 978-3-319-12811-5
eBook Packages: Computer ScienceComputer Science (R0)