Abstract
The paper deals with surveillance face recognition in security applications such as surveillance camera systems or access control systems. Presented research is focused on enhancing recognition performance, reducing classification time and memory requirements. We aim to make it feasible to implement face recognition in end devices such as cameras, identification terminals or popular IoT devices. Therefore, we utilize algorithms that require low computational power and optimize them in order to reach higher recognition rates. We present a novel higher quantile method that enhances recognition performance via creation of robust and representative face templates for nearest neighbor classifier. Templates computed by the higher quantile method are determined by tolerance intervals which handle feature variability caused by face pose, expression, illumination and possible low image quality. The recognition performance evaluation has been conducted on images captured by surveillance camera system that are contained in unique IFaViD dataset. The IFaViD is the only one dataset captured by real surveillance camera system containing complex scenarios. The results show that the higher quantile method outperforms the contemporary approaches by 4%, respectively, 10% depending on the IFaViD’s test subset.
Similar content being viewed by others
Change history
24 September 2019
In the original publication of the article, the below-mentioned acknowledgement was not included and the author would like to add it.
References
Abuzneid MA, Mahmood A (2018) Enhanced human face recognition using LBPH descriptor, multi-knn, and back-propagation neural network. IEEE Access 6:20641–20651. https://doi.org/10.1109/ACCESS.2018.2825310
Ahonen A, Hadid A, Pietikäinen M (2006) Face description with local binary patterns: application to face recognition. IEEE Trans Pattern Anal Mach Intell 28(12):2037–2041
An L, Kafai M, Bhanu B (2013) Dynamic Bayesian network for unconstrained face recognition in surveillance camera networks. IEEE J Emerg Sel Top Circuits Syst 3(2):155–164. https://doi.org/10.1109/JETCAS.2013.2256752
Anděl J (1976) Statistical analysis of time series. SNTL, Praha
Belhumeur PN, Hespanha JP, Kriegman DJ (1997) Eigenfaces vs. fisherfaces: recognition using class specific linear projection. IEEE Trans Pattern Anal Mach Intell 7:711–720. https://doi.org/10.1109/34.598228
Biswas S, Aggarwal G, Flynn P (2011) Face recognition in low-resolution videos using learning-based likelihood measurement model. Proc Int Jt Conf Biom IJCB 2011:1–7. https://doi.org/10.1109/IJCB.2011.6117514
Fawcett T (2006) An introduction to ROC analysis. Pattern Recognit Lett 27:861–874
García V, Sánchez JS, Marqués AI, Martínez-Peláez R (2018) A regression model based on the nearest centroid neighborhood. Pattern Anal Appl 21(4):941–951. https://doi.org/10.1007/s10044-018-0706-3
Huang G, Lee H, Learned-Miller E (2012) Learning hierarchical representations for face verification with convolutional deep belief networks. In: IEEE conference on computer vision and pattern recognition, pp 2518–2525
Huang GB, Ramesh M, Berg T, Learned-Miller E (2007) Labeled faces in the wild: a database for studying face recognition in unconstrained environments. Technical Report 07-49, University of Massachusetts, Amherst, Massachusetts, USA
Koringa PA, Mitra SK, Asari VK (2017) Handling illumination variation: a challenge for face recognition. In: Raman B, Kumar S, Roy PP, Sen D (eds) Proceedings of international conference on computer vision and image processing, pp 273–283. Springer Singapore, Singapore
Linna M, Kannala J, Rahtu E (2015) Online face recognition system based on local binary patterns and facial landmark tracking. In: Battiato S, Blanc-Talon J, Gallo G, Philips W, Popescu D, Scheunders P (eds) Advanced concepts for intelligent vision systems. Springer International Publishing, Cham, pp 403–414
Malach T, Pomenkova J (2014) Face template creation: Is centroid method a suitable approach? In: Proceedings of the 24th international conference radioelektronika, radioelektronika 2012, Bratislava, Slovakia, pp 105–108
Malach T, Pomenkova J (2018) Comparing classifier’s performance based on confidence interval for the ROC. Radioengineering 27(3):827–834. https://doi.org/10.13164/re.2018.0827
Malach T, Prinosil J (2014) Face templates creation surveillance face recognition system. In: Proceedings of the 3rd international conference on pattern recognition applications and methods, ICPRAM 2014, Angers, France, pp 724–729
Phillips PJ, Flynn PJ, Beveridge JR, Scruggs WT, O’Toole AJ, Bolme D, Bowyer KW, Draper BA, Givens GH, Lui Y, Sahibzada H, Scallan J, Weimer S (2009) Overview of the multiple biometrics grand challenge. Adv Biom 5558:705–714. https://doi.org/10.1007/978-3-642-01793-3_72
Phillips PJ, Hyeonjoon M, Rizvi S, Rauss PJ (2000) The FERET evaluation methodology for face-recognition algorithms. IEEE Trans Pattern Anal Mach Intell 22(10):1090–1104. https://doi.org/10.1109/34.879790
Prinosil J (2013) Local descriptors based face recognition engine for video surveillance systems. In: 36th International conference on telecommunications and signal processing, TSP 2013, Berlin, Germany, pp 862–866. https://doi.org/10.1109/TSP.2013.6614062
Savchenko AV (2015) An optimal greedy approximate nearest neighbor method in statistical pattern recognition. In: Kryszkiewicz M, Bandyopadhyay S, Rybinski H, Pal SK (eds) Pattern recognition and machine intelligence. Springer International Publishing, Cham, pp 236–245
Shi W, Jiang M (2018) Face recognition based on multi-view. In: Lai JH, Liu CL, Chen X, Zhou J, Tan T, Zheng N, Zha H (eds) Pattern recognition and computer vision. Springer International Publishing, Cham, pp 127–136
Singh C, Mittal N, Walia E (2014) Complementary feature sets for optimal face recognition. EURASIP J Image Video Process 2014(1):35
Stallkamp J, Ekenel H, Stiefelhagen R (2007) Video-based face recognition on real-world data. In: Proceedings of IEEE 11th international conference on computer vision, ICCV 2007, Rio de Janeiro, Brazil, pp 1–8
Taigman Y, Ming Y, Marc’Aurelio R, Lior W (2014) Deepface: closing the gap to human-level performance in face verification. In: IEEE conference on computer vision and pattern recognition, CVPR 2014, Columbus, OH, USA, pp 1701–1708. https://doi.org/10.1109/CVPR.2014.220
Theodoridis S, Koutroubas K (2009) Pattern recognition. Academic Press, Waltham, Massachusetts, USA. ISBN 978-1-597-59749-272-0
Tome P, Fierrez J, Vera-Rodriguez R, Nixon M (2014) Soft biometrics and their application in person recognition at a distance. IEEE Trans Inf Forensics Secur 9(3):464–475. https://doi.org/10.1109/TIFS.2014.2299975
Viola P, Jones M (2001) Robust real-time object detection. Int J Comput Vis 4:4
Westin L (2015) Receiver operating characteristic (ROC) analysis. Evaluating discriminance effects among decision support systems, vol 2015, no 1. [online] Cited 11 Feb 2015. Available at http://nutkin.cs.umu.se/research/reports/2001/018/part1.pdf
Zhang H, Wu QJ, Chow TW, Zhao M (2012) A two-dimensional neighborhood preserving projection for appearance-based face recognition. Pattern Recognit 45:1866–1876. https://doi.org/10.1016/j.patcog.2011.11.002
Zhao W, Chellapa R (2006) Face processing. Academic Press, Waltham
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Malach, T., Pomenkova, J. Optimal face templates: the next step in surveillance face recognition. Pattern Anal Applic 23, 1021–1032 (2020). https://doi.org/10.1007/s10044-019-00842-y
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10044-019-00842-y