Skip to main content
SpringerLink
Log in

Biometric recognition in surveillance scenarios: a survey

  • Published:
Artificial Intelligence Review Aims and scope Submit manuscript

Abstract

Interest in the security of individuals has increased in recent years. This increase has in turn led to much wider deployment of surveillance cameras worldwide, and consequently, automated surveillance systems research has received more attention from the scientific community than before. Concurrently, biometrics research has become more popular as well, and it is supported by the increasing number of approaches devised to address specific degradation factors of unconstrained environments. Despite these recent efforts, no automated surveillance system that performs reliable biometric recognition in such an environment has become available. Nevertheless, recent developments in human motion analysis and biometric recognition suggest that both can be combined to develop a fully automated system. As such, this paper reviews recent advances in both areas, with a special focus on surveillance scenarios. When compared to previous studies, we highlight two distinct features, i.e., (1) our emphasis is on approaches that are devised to work in unconstrained environments and surveillance scenarios; and (2) biometric recognition is the final goal of the surveillance system, as opposed to behavior analysis, anomaly detection or action recognition.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

References

  • Aggarwal J, Cai Q, Liao W, Sabata B (1998) Nonrigid motion analysis: articulated and elastic motion. Comput Vis Image Underst 70(2):142–156

    Article  Google Scholar 

  • Aggarwal J, Cai Q (1999) Human motion analysis: a review. Comput Vis Image Underst 73(3):428–440

    Article  Google Scholar 

  • Aggarwal J, Ryoo M (2011) Human activity analysis: a review. ACM Comput Surv 43(3):16:1–16:43

    Article  Google Scholar 

  • Ahonen T, Hadid A, Pietikainen M (2006) Face description with local binary patterns: application to face recognition. IEEE Trans Pattern Anal Mach Intell 28(12):2037–2041

    Article  MATH  Google Scholar 

  • Ailisto H, Vildjiounaite E, Lindholm M, Mkel SM, Peltola J (2006) Soft biometrics combining body weight and fat measurements with fingerprint biometrics. Pattern Recogn Lett 27(5):325–334

    Article  Google Scholar 

  • Andriyenko A, Schindler K (2010) Globally optimal multi-target tracking on a hexagonal lattice. In: Proceedings of the 11th European conference on computer vision: part I. pp 466–479

  • Andriyenko A, Schindler K (2011) Multi-target tracking by continuous energy minimization. In: IEEE conference on computer vision and pattern recognition. pp 1265–1272

  • Andriyenko A, Schindler K, Roth S (2012) Discrete-continuous optimization for multi-target tracking. In: IEEE conference on computer vision and pattern recognition. pp 1926–1933

  • Babenko B, Yang MH, Belongie S (2011) Robust object tracking with online multiple instance learning. IEEE Trans Pattern Anal Mach Intell 33(8):1619–1632

    Article  Google Scholar 

  • Barnich O, Van Droogenbroeck M (2011) Vibe: a universal background subtraction algorithm for video sequences. IEEE Trans Image Process 20(6):1709–1724

    Article  MathSciNet  Google Scholar 

  • Barrow HG, Tenenbaum JM, Bolles RC, Wolf HC (1977) Parametric correspondence and chamfer matching: two new techniques for image matching. In: Proceedings of the 5th international joint conference on artificial intelligencem, IJCAI’77, vol. 2. Morgan Kaufmann Publishers Inc., San Francisco, pp 659–663

  • Bashir K, Xiang T, Gong S (2010) Gait recognition without subject cooperation. Pattern Recogn Lett 31(13):2052–2060

    Article  Google Scholar 

  • Belhumeur P, Hespanha J, Kriegman D (1997) Eigenfaces vs. fisherfaces: recognition using class specific linear projection. IEEE Trans Pattern Anal Mach Intell 19(7):711–720

    Article  Google Scholar 

  • Belongie S, Malik J, Puzicha J (2002) Shape matching and object recognition using shape contexts. IEEE Trans Pattern Anal Mach Intell 24(4):509–522

    Article  Google Scholar 

  • Benfold B, Reid I (2011) Stable multi-target tracking in real-time surveillance video. In: Proceedings of the 2011 IEEE conference on computer vision and pattern recognition, CVPR ’11. IEEE Computer Society, Washington, DC. pp 3457–3464

  • Berclaz J, Fleuret F, Turetken E, Fua P (2011) Multiple object tracking using k-shortest paths optimization. IEEE Trans Pattern Anal Mach Intell 33(9):1806–1819

    Article  Google Scholar 

  • Berclaz J, Fleuret F, Fua P (2009) Multiple object tracking using flow linear programming. In: Twelfth IEEE international workshop on performance evaluation of tracking and surveillance (PETS-Winter). pp 1–8

  • Blanz V, Vetter T (2003) Face recognition based on fitting a 3d morphable model. IEEE Trans Pattern Anal Mach Intell 25(9):1063–1074

    Article  Google Scholar 

  • Bledsoe WW (1964) The model method in facial recognition. Tech. Rep. PRI 15. Panoramic Research, Inc., Palo Alto

  • Bobick A, Davis J (2001) The recognition of human movement using temporal templates. IEEE Trans Pattern Anal Mach Intell 23(3):257–267

    Article  Google Scholar 

  • Boddeti V, Smereka J, Kumar B (2011) A comparative evaluation of iris and ocular recognition methods on challenging ocular images. In: International joint conference on biometrics. pp 1–8

  • Bolle R, Pankanti S (1998) Biometrics, Personal Identification in Networked Society: Personal Identification in Networked Society. Kluwer Academic Publishers, Norwell, MA, USA

    Google Scholar 

  • Breitenstein M, Reichlin F, Leibe B, Koller-Meier E, Van Gool L (2011) Online multiperson tracking-by-detection from a single, uncalibrated camera. IEEE Trans Pattern Anal Mach Intell 33(9):1820–1833

    Article  Google Scholar 

  • Breitenstein M, Reichlin F, Leibe B, Koller-Meier E, Van Gool L (2009) Robust tracking-by-detection using a detector confidence particle filter. In: International conference on computer vision. pp 1515–1522

  • Brutzer S, Hoferlin B, Heidemann G (2011) Evaluation of background subtraction techniques for video surveillance. In: IEEE conference on computer vision and pattern recognition (CVPR). pp 1937–1944

  • Butler DE, Bove VM, Sridharan S (2005) Real-time adaptive foreground/background segmentation. EURASIP J Adv Signal Process 2005(14):841,926

    Article  MATH  Google Scholar 

  • Butler D, Sridharan S, Bove VMJ (2003) Real-time adaptive background segmentation. In: Proceedings of 2003 international conference on Multimedia and Expo, 2003. ICME ’03, vol. 3. pp III-341–III-344

  • Cai Y, de Freitas N, Little JJ (2006) Robust visual tracking for multiple targets. In: ECCV. pp 107–118

  • Cai Y, Medioni G, Dinh T (2013) Towards a practical PTZ face detection and tracking systems. In: Proceedings of the IEEE workshop on applications of computer vision. pp 31–38

  • CASIA: Casia iris image databases (2014). http://www.idealtest.org/findTotalDbByMode.do?mode=Iris

  • Cédras C, Shah M (1995) Motion-based recognition a survey. Image Vis Comput 13(2):129–155

    Article  Google Scholar 

  • Chan CH, Tahir M, Kittler J, Pietikainen M (2013) Multiscale local phase quantization for robust component-based face recognition using kernel fusion of multiple descriptors. IEEE Trans Pattern Anal Mach Intell 35(5):1164–1177

    Article  Google Scholar 

  • Chen C, Liang J, Zhao H, Hu H, Tian J (2009) Frame difference energy image for gait recognition with incomplete silhouettes. Pattern Recogn Lett 30(11):977–984

    Article  Google Scholar 

  • Chen CH, Yao Y, Chang H, Koschan A, Abidi M (2013) Integration of multispectral face recognition and multi-ptz camera automated surveillance for security applications. Cent Eur J Eng 3(2):253–266

    Google Scholar 

  • Cheng Y (1995) Mean shift, mode seeking, and clustering. IEEE Trans Pattern Anal Mach Intell 17(8):790–799

    Article  Google Scholar 

  • Chu CT, Hwang JN, Pai HI, Lan KM (2013) Tracking human under occlusion based on adaptive multiple kernels with projected gradients. IEEE Trans Multimed 15(7):1602–1615

    Article  Google Scholar 

  • Comaniciu D, Ramesh V, Meer P (2003) Kernel-based object tracking. IEEE Trans Pattern Anal Mach Intell 25(5):564–577

    Article  Google Scholar 

  • Dalal N, Triggs B (2005) Histograms of oriented gradients for human detection. In: IEEE computer society conference on computer vision and pattern recognition, vol. 1. pp. 886–893

  • Dantcheva A, Velardo C, DAngelo A, Dugelay JL (2011) Bag of soft biometrics for person identification. Multimed Tools Appl 51(2):739–777

    Article  Google Scholar 

  • Daugman J (1993) High confidence visual recognition of persons by a test of statistical independence. IEEE Trans Pattern Anal Mach Intell 15(11):1148–1161

    Article  Google Scholar 

  • Daugman J (2004) How iris recognition works. IEEE Trans Circuits Syst Video Technol 14(1):21–30

    Article  Google Scholar 

  • Davies A, Velastin S (2005) A progress review of intelligent cctv surveillance systems. In: IEEE intelligent data acquisition and advanced computing systems: technology and applications. pp 417–423

  • Denman S, Fookes C, Bialkowski A, Sridharan S (2009) Soft-biometrics: unconstrained authentication in a surveillance environment. In: Digital image computing: techniques and applications, 2009, DICTA ’09. pp 196–203

  • Dinh TB, Vo N, Medioni G (2011) Context tracker: exploring supporters and distracters in unconstrained environments. In: IEEE conference on computer vision and pattern recognition. pp 1177–1184

  • Dollar P, Wojek C, Schiele B, Perona P (2012) Pedestrian detection: an evaluation of the state of the art. IEEE Trans Pattern Anal Mach Intell 34(4):743–761

    Article  Google Scholar 

  • EarthCam (2014) Times square cams. http://www.earthcam.com/usa/newyork/timessquare/?cam=tsstreet

  • Elgammal A, Harwood D, Davis L (2000) Non-parametric model for background subtraction. In: ECCV. pp 751–767

  • Eng HL, Toh KA, Kam AH, Wang J, Yau WY (2003) An automatic drowning detection surveillance system for challenging outdoor pool environments. IEEE Int Conf Comput Vis 1:532

    Google Scholar 

  • Ess A, Leibe B, Van Gool L (2007) Depth and appearance for mobile scene analysis. In: IEEE 11th international conference on computer vision. pp 1–8

  • Felsberg M (2013) Enhanced distribution field tracking using channel representations. In: International conference on computer vision workshops. pp 121–128

  • Feris R, Datta A, Pankanti S, Sun MT (2013) Boosting object detection performance in crowded surveillance videos. In: IEEE workshop on applications of computer vision. pp 427–432

  • Fisher R (2005) Caviar dataset

  • Fleuret F, Berclaz J, Lengagne R, Fua P (2008) Multicamera people tracking with a probabilistic occupancy map. IEEE Trans Pattern Anal Mach Intell 30(2):267–282

    Article  Google Scholar 

  • Fortmann TE, Bar-Shalom Y, Scheffe M (1983) Sonar tracking of multiple targets using joint probabilistic data association. IEEE J Ocean Eng 8(3):173–184

    Article  Google Scholar 

  • Gavrila D (1998) Multi-feature hierarchical template matching using distance transforms. In: Fourteenth international conference on pattern recognition, vol. 1. pp 439–444

  • Gavrila D (1999) The visual analysis of human movement: a survey. Comput Vis Image Underst 73(1):82–98

    Article  MATH  Google Scholar 

  • Gavrila D (2007) A bayesian, exemplar-based approach to hierarchical shape matching. IEEE Trans Pattern Anal Mach Intell 29(8):1408–1421

    Article  Google Scholar 

  • Gavrila D, Philomin V (1999) Real-time object detection for smart vehicles. In: International conference on computer vision, vol. 1. pp 87–93

  • Gloyer B, Aghajan HK, Siu KY, Kailath T (1995) Video-based freeway-monitoring system using recursive vehicle tracking. pp 173–180

  • Goffredo M, Bouchrika I, Carter J, Nixon M (2010) Performance analysis for automated gait extraction and recognition in multi-camera surveillance. Multimed Tools Appl 50(1):75–94

    Article  Google Scholar 

  • Grabner H, Grabner M, Bischof H (2006) Real-time tracking via on-line boosting. In: Proceedings of BMVC. pp 6.1–6.10

  • Grabner H, Leistner C, Bischof H (2008) Semi-supervised on-line boosting for robust tracking. In: Proceedings of the 10th European conference on computer vision: part I. pp 234–247

  • Grabner H, Matas J, Van Gool L, Cattin P (2010) Tracking the invisible: learning where the object might be. In: IEEE conference on computer vision and pattern recognition. pp 1285–1292

  • Grgic M, Delac K, Grgic S (2011) Scface surveillance cameras face database. Multimed Tools Appl 51(3):863–879

    Article  Google Scholar 

  • Gross R, Matthews I, Cohn J, Kanade T, Baker S (2010) Multi-pie. Best of automatic face and gesture recognition 2008. Image Vis Comput 28(5):807–813

    Article  Google Scholar 

  • Gu J, Ding X, Wang S, Wu Y (2010) Action and gait recognition from recovered 3-d human joints. IEEE Trans Syst Man Cybern Part B Cybern 40(4):1021–1033

    Article  Google Scholar 

  • Gurwicz Y, Yehezkel R, Lachover B (2011) Multiclass object classification for real-time video surveillance systems. Patt Recogn Lett 32(6):805–815

    Article  Google Scholar 

  • Haering N, Venetianer P, Lipton A (2008) The evolution of video surveillance: an overview. Mach Vis Appl 19(5–6):279–290

    Article  Google Scholar 

  • Han J, Bhanu B (2006) Individual recognition using gait energy image. IEEE Trans Pattern Anal Mach Intell 28(2):316–322

    Article  Google Scholar 

  • Hare S, Saffari A, Torr PHS (2011) Struck: structured output tracking with kernels. In: IEEE international conference on computer vision. pp 263–270

  • Haritaoglu I, Harwood D, Davis L (2000) W4: real-time surveillance of people and their activities. IEEE Trans Pattern Anal Mach Intell 22(8):809–830

    Article  Google Scholar 

  • He B, Xu D, Nian R, van Heeswijk M, Yu Q, Miche Y, Lendasse A (2014) Fast face recognition via sparse coding and extreme learning machine. Cognit Comput 6(2):264–277

    Google Scholar 

  • Heikkila J, Rahtu E, Ojansivu V (2014) Local phase quantization for blur insensitive texture description. In: Local binary patterns: new variants and applications. pp 49–84

  • Horn BK, Schunck BG (1981) Determining optical flow. Artif Intell 17(13):185–203

    Article  Google Scholar 

  • Hossain MA, Makihara Y, Wang J, Yagi Y (2010) Clothing-invariant gait identification using part-based clothing categorization and adaptive weight control. Patt Recogn 43(6):2281–2291

    Article  Google Scholar 

  • Hou YL, Pang GH (2011) People counting and human detection in a challenging situation. IEEE Trans Syst Man Cybern Part A Syst Hum 41(1):24–33

    Article  Google Scholar 

  • Hu W, Tan T, Wang L, Maybank S (2004) A survey on visual surveillance of object motion and behaviors. IEEE Trans Syst Man Cybern Part C Appl Rev 34(3):334–352

    Article  Google Scholar 

  • Hu W, Zhou X, Hu M, Maybank S (2009) Occlusion reasoning for tracking multiple people. IEEE Trans Circuits Syst Video Technol 19(1):114–121

    Article  Google Scholar 

  • Huang GB, Ramesh M, Berg T, Learned-Miller E (2007) Labeled faces in the wild: a database for studying face recognition in unconstrained environments. Tech. Rep. 07-49, University of Massachusetts, Amherst

  • Huang GB, Zhu QY, Siew CK (2006) Extreme learning machine: Theory and applications. Neurocomputing 70(13):489–501

    Article  Google Scholar 

  • Huang J, Kumar S, Mitra M, Zhu WJ (1998) Spatial color indexing and applications. In: Sixth international conference on computer vision, 1998. pp 602–607

  • Husain M, Saber E, Misic V, Joralemon S (2006) Dynamic object tracking by partial shape matching for video surveillance applications. In: IEEE international conference on image processing. pp 2405–2408

  • Huttenlocher D, Klanderman G, Rucklidge W (1993) Comparing images using the hausdorff distance. IEEE Trans Pattern Anal Mach Intell 15(9):850–863

    Article  Google Scholar 

  • Huttenlocher D, Noh J, Rucklidge W (1993) Tracking non-rigid objects in complex scenes. In: International conference on computer vision. pp 93–101

  • Iwama H, Muramatsu D, Makihara Y, Yagi Y (2012) Gait-based person-verification system for forensics. In: IEEE fifth international conference on biometrics: theory, applications and systems. pp 113–120

  • Jain AK, Dass S, Nandakumar K (2004) Soft biometric traits for personal recognition systems. In: Biometric authentication. pp 731–738

  • Jain AK, Pankanti S, Prabhakar S, Hong L, Ross A (2004) Biometrics: a grand challenge. In: 17th International conference on pattern recognition, ICPR ’04. IEEE Computer Society, Washington, DC, pp 935–942

  • Jain A, Ross A, Prabhakar S (2004) An introduction to biometric recognition. IEEE Trans Circuits Syst Video Technol 14(1):4–20

    Article  Google Scholar 

  • Jean F, Albu AB, Bergevin R (2009) Towards view-invariant gait modeling: computing view-normalized body part trajectories. Patt Recogn 42(11):2936–2949

    Article  MATH  Google Scholar 

  • Jia X, Lu H, Yang MH (2012) Visual tracking via adaptive structural local sparse appearance model. In: IEEE conference on computer vision and pattern recognition. pp 1822–1829

  • Jiang H, Fels S, Little J (2007) A linear programming approach for multiple object tracking. In: IEEE conference on computer vision and pattern recognition. pp 1–8

  • Ji X, Liu H (2010) Advances in view-invariant human motion analysis: a review. IEEE Trans Syst Man Cybern Part C Appl Rev 40(1):13–24

    Google Scholar 

  • Julier S, Uhlmann J (2004) Unscented filtering and nonlinear estimation. Proc IEEE 92(3):401–422

    Article  Google Scholar 

  • KaewTrakulPong P, Bowden R (2003) A real time adaptive visual surveillance system for tracking low-resolution colour targets in dynamically changing scenes. Image Vis Comput 21(10):913–929

    Article  Google Scholar 

  • Kalal Z, Mikolajczyk K, Matas J (2012) Tracking-learning-detection. IEEE Trans Pattern Anal Mach Intell 34(7):1409–1422

    Article  Google Scholar 

  • Kalman RE (1960) A new approach to linear filtering and prediction problems. Trans ASME J Basic Eng 82(Series D):35–45

    Article  Google Scholar 

  • Kang J, Cohen I, Medioni G (2003) Continuous tracking within and across camera streams. In: IEEE computer society conference on computer vision and pattern recognition, vol. 1. pp I-267–I-272

  • Kasinski A, Florek A, Schmidt A (2008) The put face database. Image Process Commun 13(3–4):59–64

    Google Scholar 

  • Kim K, Chalidabhongse TH, Harwood D, Davis L (2005) Real-time foreground background segmentation using codebook model. Real Time Imaging 11(3):172–185

    Article  Google Scholar 

  • Kim I, Choi H, Yi K, Choi J, Kong S (2010) Intelligent visual surveillance a survey. Int J Control Autom Syst 8(5):926–939

    Article  Google Scholar 

  • Klare BF, Klein B, Taborsky E, Blanton A, Cheney J, Allen K, Grother P, Mah A, Burge M, Jain AK (2015) Pushing the frontiers of unconstrained face detection and recognition: Iarpa janus benchmark a. In: Conference on computer vision and pattern recognition (CVPR)

  • Klontz J, Jain A (2013) A case study of automated face recognition: the boston marathon bombings suspects. IEEE Comput 46(11):91–94

    Article  Google Scholar 

  • Ko T (2008) A survey on behavior analysis in video surveillance for homeland security applications. In: 37th IEEE applied imagery pattern recognition workshop. pp 1–8

  • Krger V, Kragic D, Ude A, Geib C (2007) The meaning of action: a review on action recognition and mapping. Adv Robot 21(13):1473–1501

    Google Scholar 

  • Kristan M, Pflugfelder R, Leonardis A, Matas J, Porikli F, Cehovin L, Nebehay G, Fernandez G, Vojir T, Gatt A, Khajenezhad A, Salahledin A, Soltani-Farani A, Zarezade A, Petrosino A, Milton A, Bozorgtabar B, Li B, Chan CS, Heng C, Ward D, Kearney D, Monekosso D, Karaimer H, Rabiee H, Zhu J, Gao J, Xiao J, Zhang J, Xing J, Huang K, Lebeda K, Cao L, Maresca M, Lim MK, El Helw M, Felsberg M, Remagnino P, Bowden R, Goecke R, Stolkin R, Lim S, Maher S, Poullot S, Wong S, Satoh S, Chen W, Hu W, Zhang X, Li Y, Niu Z (2013) The visual object tracking vot2013 challenge results. In: IEEE international conference on computer vision workshops. pp 98–111

  • Kwon J, Lee KM (2010) Visual tracking decomposition. In: IEEE conference on computer vision and pattern recognition. pp 1269–1276

  • Lee L, Grimson WEL (2002) Gait analysis for recognition and classification. In: Fifth IEEE international conference on automatic face and gesture recognition. pp 148–155

  • Leibe B, Schindler K, Van Gool L (2007) Coupled detection and trajectory estimation for multi-object tracking. In: IEEE 11th international conference on computer vision. pp 1–8

  • Li S, Chu R, Liao S, Zhang L (2007) Illumination invariant face recognition using near-infrared images. IEEE Trans Pattern Anal Mach Intell 29(4):627–639

    Article  Google Scholar 

  • Li H, Hua G, Lin Z, Brandt J, Yang J (2013) Probabilistic elastic matching for pose variant face verification. In: IEEE conference on computer vision and pattern recognition (CVPR). pp 3499–3506

  • Lin SF, Chen JY, Chao HX (2001) Estimation of number of people in crowded scenes using perspective transformation. IEEE Trans Syst Man Cybern Part A Syst Hum 31(6):645–654

    Article  Google Scholar 

  • Liu Z, Shen H, Feng G, Hu D (2012) Tracking objects using shape context matching. Neurocomputing 83:47–55

    Article  Google Scholar 

  • Liu H, Sun F, Yu Y (2014) Multitask extreme learning machine for visual tracking. Cognit Comput 6(3):391–404

    Article  Google Scholar 

  • Liu C, Hu C, Aggarwal J (2011) Eigenshape kernel based mean shift for human tracking. In: IEEE international conference on computer vision workshops. pp 1809–1816

  • Lucas BD, Kanade T (1981) An iterative image registration technique with an application to stereo vision. In: Hayes PJ (ed) IJCAI. William Kaufmann, pp 674–679

  • Luque R, Domnguez E, Palomo E, Muoz J (2008) A neural network approach for video object segmentation in traffic surveillance. In: Image analysis and recognition. pp 151–158

  • Lyle JR, Miller PE, Pundlik SJ, Woodard DL (2012) Soft biometric classification using local appearance periocular region features. Patt Recognit 45(11):3877–3885

    Article  Google Scholar 

  • Lyle J, Miller P, Pundlik S, Woodard D (2010) Soft biometric classification using periocular region features. In: Fourth IEEE international conference on biometrics: theory applications and systems. pp 1–7

  • Maddalena L, Petrosino A (2008) A self-organizing approach to background subtraction for visual surveillance applications. IEEE Trans Image Process 17(7):1168–1177

    Article  MathSciNet  Google Scholar 

  • Maddalena L, Petrosino A (2014) The 3dsobs+ algorithm for moving object detection. Comput Vis Image Underst 122:65–73

    Article  Google Scholar 

  • Maggio E (2005) Cavallaro a multi-part target representation for color tracking. In: IEEE international conference on image processing, vol. 1. pp I-729–I-732

  • Maggio E, Piccardo E, Regazzoni C, Cavallaro A (2007) Particle phd filtering for multi-target visual tracking. In: IEEE international conference on acoustics, speech and signal processing, vol. 1. pp I-1101–I-1104

  • Martinez AM (2002) Recognizing imprecisely localized, partially occluded, and expression variant faces from a single sample per class. IEEE Trans Pattern Anal Mach Intell 24(6):748–763

    Article  Google Scholar 

  • Matey J, Naroditsky O, Hanna K, Kolczynski R, LoIacono D, Mangru S, Tinker M, Zappia T, Zhao WY (2006) Iris on the move: acquisition of images for iris recognition in less constrained environments. Proc IEEE 94(11):1936–1947

    Article  Google Scholar 

  • McCahill M, Norris C (2002) Cctv in britain. Center for Criminology and Criminal Justice, University of Hull, London

    Google Scholar 

  • McFarlane N, Schofield C (1995) Segmentation and tracking of piglets in images. Mach Vis Appl 8(3):187–193

    Article  Google Scholar 

  • McKenna SJ, Jabri S, Duric Z, Wechsler H (2000) Tracking interacting people. In: Proceedings of the fourth IEEE international conference on automatic face and gesture recognition 2000, FG ’00. IEEE Computer Society, Washington, DC. p 348

  • McKenna SJ, Raja Y, Gong S (1999) Tracking colour objects using adaptive mixture models. Image Vis Comput 17(34):225–231

    Article  Google Scholar 

  • Mei X, Ling H (2011) Robust visual tracking and vehicle classification via sparse representation. IEEE Trans Pattern Anal Mach Intell 33(11):2259–2272

    Article  Google Scholar 

  • Mikolajczyk K, Schmid C, Zisserman (2004) A Human detection based on a probabilistic assembly of robust part detectors. In: ECCV. pp 69–82

  • Milan A, Roth S, Schindler K (2014) Continuous energy minimization for multitarget tracking. IEEE Trans Pattern Anal Mach Intell 36(1):58–72

    Article  Google Scholar 

  • Mittal A, Davis LS (2003) M2tracker: a multi-view approach to segmenting and tracking people in a cluttered scene. Int J Comput Vis 51(3):189–203

    Article  MATH  Google Scholar 

  • Moctezuma D, Conde C, de Diego I, Cabello E (2011) Person detection in surveillance environment with hogg: gabor filters and histogram of oriented gradient. In: IEEE international conference on computer vision workshops. pp 1793–1800

  • Moeslund TB, Hilton A, Krger V (2006) A survey of advances in vision-based human motion capture and analysis. Comput Vis Image Underst 104(23):90–126

    Article  Google Scholar 

  • Moeslund TB, Granum E (2001) A survey of computer vision-based human motion capture. Comput Vis Image Underst 81(3):231–268

    Article  MATH  Google Scholar 

  • Munder S, Schnorr C, Gavrila D (2008) Pedestrian detection and tracking using a mixture of view-based shape-texture models. IEEE Trans Intell Transp Syst 9(2):333–343

    Article  Google Scholar 

  • Murray MP (1967) Gait as a total pattern of movement. American Journal of Physical Medicine 46(1):290–333

    Google Scholar 

  • Neves J (2015) Quis-campi dataset. http://quiscampi.di.ubi.pt

  • Neves JC, Moreno JC, Barra S, Proenca H (2015) Acquiring high-resolution face images in outdoor environments: a master-slave calibration algorithm. In: IEEE 7th international conference on biometrics theory, applications and systems (BTAS). pp 1–8

  • Ojala T, Pietikinen M, Harwood D (1996) A comparative study of texture measures with classification based on featured distributions. Patt Recognit 29(1):51–59

    Article  Google Scholar 

  • Ojansivu V, Rahtu E, Heikkila J (2008) Rotation invariant local phase quantization for blur insensitive texture analysis. In: 19th International conference on pattern recognition. pp 1–4

  • Okuma K, Taleghani A, Freitas N, Little JJ, Lowe DG (2004) A boosted particle filter: multitarget detection and tracking. In: ECCV. pp 28–39

  • Okumura M, Iwama H, Makihara Y, Yagi Y (2010) Performance evaluation of vision-based gait recognition using a very large-scale gait database. In: Fourth IEEE international conference on biometrics: theory applications and systems. pp 1–6

  • Oliver N, Rosario B, Pentland A (2000) A bayesian computer vision system for modeling human interactions. IEEE Trans Pattern Anal Mach Intell 22(8):831–843

    Article  Google Scholar 

  • Padole C, Proença H (2012) Periocular recognition: analysis of performance degradation factors. In: 5th IAPR international conference on biometrics. pp 439–445

  • Pantic M, Pentland A, Nijholt A, Huang T (2006) Human computing and machine understanding of human behavior: a survey. In: Proceedings of the 8th international conference on multimodal interfaces, ICMIACM. New York, pp 239–248

  • Park U, Jillela R, Ross A, Jain A (2011) Periocular biometrics in the visible spectrum. IEEE Trans Inf Forensics Secur 6(1):96–106

    Article  Google Scholar 

  • Park U, Choi HC, Jain A, Lee SW (2013) Face tracking and recognition at a distance: a coaxial and concentric PTZ camera system. IEEE Trans Inf Forensics Secur 8(10):1665–1677

    Article  Google Scholar 

  • Park U, Ross A, Jain A (2009) Periocular biometrics in the visible spectrum: a feasibility study. In: IEEE 3rd international conference on biometrics: theory, applications, and systems. pp 1–6

  • PETS (2015) Performance evaluation of tracking and surveillance. http://www.cvg.reading.ac.uk/slides/pets.html

  • Phillips P (2014a) Color feret database. http://www.nist.gov/itl/iad/ig/colorferet.cfm

  • Phillips P (2014b) Face and ocular challenge series. http://www.nist.gov/itl/iad/ig/focs.cfm

  • Phillips P, Flynn P, Scruggs T, Bowyer K, Chang J, Hoffman K, Marques J, Min J, Worek W (2005) Overview of the face recognition grand challenge. In: IEEE computer society conference on computer vision and pattern recognition, vol. 1. pp 947–954

  • Popoola O, Wang K (2012) Video-based abnormal human behavior recognition a review. IEEE Trans Syst Man Cybern Part C Appl Rev 42(6):865–878

    Article  Google Scholar 

  • Poppe R (2007) Vision-based human motion analysis: an overview. Comput Vis Image Underst 108(1–2):4–18

    Article  Google Scholar 

  • Poppe R (2010) A survey on vision-based human action recognition. Image and Vision Computing 28(6):976–990

    Article  Google Scholar 

  • Priydarshi AN, Chakraborty P, Nandi G (2013)Speed invariant, human gait based recognition system for video surveillance security. In: Intelligent interactive technologies and multimedia. pp 325–335

  • Proença H (2007) Towards non-cooperative biometric iris recognition. Ph.D. thesis, University of Beira Interior

  • Proença H, Filipe S, Santos R, Oliveira J, Alexandre L (2010) The ubiris.v2: a database of visible wavelength iris images captured on-the-move and at-a-distance. IEEE Trans Pattern Anal Mach Intell 32(8):1529–1535

    Article  Google Scholar 

  • Proença H, Alexandre L (2007) Toward noncooperative iris recognition: a classification approach using multiple signatures. IEEE Trans Pattern Anal Mach Intell 29(4):607–612

    Article  Google Scholar 

  • Raty T (2010) Survey on contemporary remote surveillance systems for public safety. IEEE Trans Syst Man Cybern Part C Appl Rev 40(5):493–515

    Article  Google Scholar 

  • Reid DA, Nixon MS (2010) Imputing human descriptions in semantic biometrics. pp 25–30

  • Reid D (1979) An algorithm for tracking multiple targets. IEEE Trans Autom Control 24(6):843–854

    Article  Google Scholar 

  • Reid D, Nixon M, Stevenage S (2014) Soft biometrics; human identification using comparative descriptions. IEEE Trans Pattern Anal Mach Intell 36(6):1216–1228

    Article  Google Scholar 

  • Ross D, Lim J, Lin RS, Yang MH (2008) Incremental learning for robust visual tracking. Int J Comput Vis 77(1–3):125–141

    Article  Google Scholar 

  • Saber E, Xu Y, Tekalp AM (2005) Partial shape recognition by sub-matrix matching for partial matching guided image labeling. Patt Recognit 38(10):1560–1573

    Article  Google Scholar 

  • Samangooei S, Nixon M (2008) Performing content-based retrieval of humans using gait biometrics. In: Semantic multimedia. pp 105–120

  • Samangooei S, Nixon M (2010) Performing content-based retrieval of humans using gait biometrics. Multimed Tools Appl 49(1):195–212

    Article  Google Scholar 

  • Sanchez-Reillo R, Sanchez-Avila C, Gonzalez-Marcos A (2000) Biometric identification through hand geometry measurements. IEEE Trans Pattern Anal Mach Intell 22(10):1168–1171

    Article  Google Scholar 

  • Santner J, Leistner C, Saffari A, Pock T, Bischof H (2010) Prost: parallel robust online simple tracking. In: IEEE conference on computer vision and pattern recognition. pp 723–730

  • Santos G, Proença H (2013) Periocular biometrics: an emerging technology for unconstrained scenarios. In: IEEE workshop on computational intelligence in biometrics and identity management. pp 14–21

  • Schroff F, Kalenichenko D, Philbin J (2015) Facenet: a unified embedding for face recognition and clustering. In: IEEE computer society conference on computer vision and pattern recognition

  • Schwartz W, Kembhavi A, Harwood D, Davis L (2009) Human detection using partial least squares analysis. In: IEEE 12th international conference on computer vision. pp 24–31

  • Senior AW, Hampapur A, Lu M (2005) Acquiring multiscale images by pan-titl-zoom control and automatic multicamera calibration. In: Proceedings of the \(7th\) IEEE workshop on application of computer vision, vol. 1. Breckenridge, pp 433–438

  • Sevilla-Lara L (2012) Distribution fields for tracking. In: IEEE conference on computer vision and pattern recognition, CVPR ’12IEEE computer society. Washington, DC, pp 1910–1917

  • Sharma A, Venkatesh KS, Mukerjee A (2011) Human pose estimation in surveillance videos using temporal continuity on static pose. In: 2011 International Conference on image information processing (ICIIP), pp 1–6

  • Shi J, Tomasi C (1994) Good features to track. In: IEEE computer society conference on computer vision and pattern recognition. pp 593–600

  • Sodemann A, Ross M, Borghetti B (2012) A review of anomaly detection in automated surveillance. IEEE Trans Syst Man Cybern Part C Appl Rev 42(6):1257–1272

    Article  Google Scholar 

  • Squires B, Sammut C (1995) Automatic speaker recognition: an application of machine learning. In: ICML. pp 515–521

  • Stauffer C, Grimson WEL (1999) Adaptive background mixture models for real-time tracking. IEEE Comput Soc Conf Comput Vis Patt Recognit 2:246–252

    Google Scholar 

  • Stern H, Efros B (2005) Adaptive color space switching for tracking under varying illumination. Image Vis Comput 23(3):353–364

    Article  Google Scholar 

  • Subburaman V, Descamps A, Carincotte C (2012) Counting people in the crowd using a generic head detector. In: IEEE ninth international conference on advanced video and signal-based surveillance. pp 470–475

  • Supancic J, Ramanan D (2013) Self-paced learning for long-term tracking. In: IEEE conference on computer vision and pattern recognition. pp 2379–2386

  • Szeto MW, Gazis DC (1972) Application of kalman filtering to the surveillance and control of traffic systems. Transp Sci 6(4):419

    Article  MathSciNet  Google Scholar 

  • Talukder A, Matthies L (2004) Real-time detection of moving objects from moving vehicles using dense stereo and optical flow. IEEE RSJ Int Conf Intell Robots Syst 4:3718–3725

    Google Scholar 

  • Tan CW, Kumar (2012) A human identification from at-a-distance images by simultaneously exploiting iris and periocular features. In: 21st international conference on pattern recognition. pp 553–556

  • Tan CW, Kumar A (2013) Towards online iris and periocular recognition under relaxed imaging constraints. IEEE Trans Image Process 22(10):3751–3765

    Article  MathSciNet  Google Scholar 

  • Tan X, Triggs B (2010) Enhanced local texture feature sets for face recognition under difficult lighting conditions. IEEE Trans Image Process 19(6):1635–1650

    Article  MathSciNet  Google Scholar 

  • Terena (2014) Koningsplein webcam. http://www.terena.org/webcam/

  • Tome P, Fierrez J, Vera-Rodriguez R, Nixon M (2014) Soft biometrics and their application in person recognition at a distance. IEEE Trans Inf Forensics Secur 9(3):464–475

    Article  Google Scholar 

  • Tsochantaridis I, Joachims T, Hofmann T, Altun Y (2005) Large margin methods for structured and interdependent output variables. J Mach Learn Res 6:1453–1484

    MathSciNet  MATH  Google Scholar 

  • Turaga P, Chellappa R, Veeraraghavan A (2010) Advances in video-based human activity analysis: challenges and approaches. Adv Comput 80:237–290

    Article  Google Scholar 

  • Turk M, Pentland A (1991) Face recognition using eigenfaces. In: IEEE computer society conference on computer vision and pattern recognition. pp 586–591

  • Vezzani R, Baltieri D, Cucchiara R (2013) People reidentification in surveillance and forensics: a survey. ACM Comput Surv 46(2):29:1–29:37

    Article  Google Scholar 

  • Viola P, Platt JC, Zhang C (2005) Multiple instance boosting for object detection. Adv Neural Inf Process Syst 18:1417–1426

    Google Scholar 

  • Viola P, Jones M (2001) Rapid object detection using a boosted cascade of simple features. In: Proceedings of the 2001 IEEE computer society conference on computer vision and pattern recognition, vol. 1. pp I-511–I-518

  • Viola P, Jones M, Snow D (2003) Detecting pedestrians using patterns of motion and appearance. In: Ninth IEEE international conference on computer vision, vol. 2. pp 734–741

  • Vot2015 challenge (2015). http://www.votchallenge.net/vot2015/. Accessed 21 Dec 2015

  • Wang L, Hu W, Tan T (2003) Recent developments in human motion analysis. Patt Recognit 36(3):585–601

    Article  Google Scholar 

  • Wang L, Tan T, Ning H, Hu W (2003) Silhouette analysis-based gait recognition for human identification. IEEE Trans Pattern Anal Mach Intell 25(12):1505–1518

    Article  Google Scholar 

  • Wang X, Han T, Yan S (2009) An hog-lbp human detector with partial occlusion handling. In: IEEE 12th international conference on computer vision. pp 32–39

  • Weinland D, Ronfard R, Boyer E (2006) Free viewpoint action recognition using motion history volumes. Comput Vis Image Underst 104(23):249–257

    Article  Google Scholar 

  • Weinland D, Ronfard R, Boyer E (2011) A survey of vision-based methods for action representation, segmentation and recognition. Comput Vis Image Underst 115(2):224–241

    Article  Google Scholar 

  • Wheeler F, Weiss R, Tu P (2010) Face recognition at a distance system for surveillance applications. In: Proceedings of the fourth ieee international conference on biometrics: theory applications and systems. Washington, DC, pp 1–8

  • Wildes R (1997) Iris recognition: an emerging biometric technology. Proc IEEE 85(9):1348–1363

    Article  Google Scholar 

  • Wren C, Azarbayejani A, Darrell T, Pentland A (1997) Pfinder: real-time tracking of the human body. IEEE Trans Pattern Anal Mach Intell 19(7):780–785

    Article  Google Scholar 

  • Wright J, Yang A, Ganesh A, Sastry S, Ma Y (2009) Robust face recognition via sparse representation. IEEE Trans Pattern Anal Mach Intell 31(2):210–227

    Article  Google Scholar 

  • Wu Y, Huang T (2001) A co-inference approach to robust visual tracking. In: Eighth IEEE international conference on computer vision, vol. 2. pp 26–33

  • Wu B, Nevatia R (2007a) Cluster boosted tree classifier for multi-view, multi-pose object detection. In: IEEE 11th international conference on computer vision. pp 1–8

  • Wu B, Nevatia R (2007b) Detection and tracking of multiple, partially occluded humans by bayesian combination of edgelet based part detectors. Int J Comput Vis 75(2):247–266

  • Wu B, Nevatia R (2009) Detection and segmentation of multiple, partially occluded objects by grouping, merging, assigning part detection responses. Int J Comput Vis 82(2):185–204

    Article  Google Scholar 

  • Wu Y, Yu T (2006) A field model for human detection and tracking. IEEE Trans Pattern Anal Mach Intell 28(5):753–765

    Article  Google Scholar 

  • Wu Y, Ling H, Yu J, Li F, Mei X, Cheng E (2011a) Blurred target tracking by blur-driven tracker. In: IEEE international conference on computer vision. pp 1100–1107

  • Wu J, Xia J, Chen JM, Cui ZM (2011b) Adaptive detection of moving vehicle based on on-line clustering. J Comput 6(10):2045–2052

  • Wu Y, Lim J, Yang MH (2013) Online object tracking: a benchmark. In: IEEE conference on computer vision and pattern recognition. pp 2411–2418

  • Xiao J, Stolkin R, Leonardis A (2013) An enhanced adaptive coupled-layer lgtracker++. In: IEEE international conference on computer vision workshops. pp 137–144

  • Xu Y, Song D (2010) Systems and algorithms for autonomous and scalable crowd surveillance using robotic ptz cameras assisted by a wide-angle camera. Auton Robots 29(1):53–66

    Article  MathSciNet  Google Scholar 

  • Yao Y, Abidi B, Kalka N, Schmid N, Abidi M (2008) Improving long range and high magnification face recognition: database acquisition, evaluation and enhancement. Comput Vis Image Underst 111(2):111–125

    Article  Google Scholar 

  • Yao J, Odobez JM (2011) Fast human detection from joint appearance and foreground feature subset covariances. Comput Vis Image Underst 115(10):1414–1426

    Article  Google Scholar 

  • Zhang J, Pu J, Chen C, Fleischer R (2010) Low-resolution gait recognition. IEEE Trans Syst Man Cybern Part B Cybern 40(4):986–996

    Article  Google Scholar 

  • Zhang X, Hu W, Bao H, Maybank S (2013) Robust head tracking based on multiple cues fusion in the kernel-bayesian framework. IEEE Trans Circuits Syst Video Technol 23(7):1197–1208

    Article  Google Scholar 

  • Zhang T, Ghanem B, Liu S, Ahuja N (2012) Robust visual tracking via multi-task sparse learning. In: IEEE conference on computer vision and pattern recognition. pp 2042–2049

  • Zhang L, Li Y, Nevatia R (2008) Global data association for multi-object tracking using network flows. In: IEEE conference on computer vision and pattern recognition. pp 1–8

  • Zhang L, Li S, Yuan X, Xiang S (2007) Real-time object classification in video surveillance based on appearance learning. In: IEEE conference on computer vision and pattern recognition. pp 1–8

  • Zhang K, Zhang L, Yang MH (2012) Real-time compressive tracking. In: ECCV. pp 864–877

  • Zhao T, Nevatia R, Wu B (2008) Segmentation and tracking of multiple humans in crowded environments. IEEE Trans Pattern Anal Mach Intell 30(7):1198–1211

    Article  Google Scholar 

  • Zhao T, Nevatia R (2004) Tracking multiple humans in complex situations. IEEE Trans Pattern Anal Mach Intell 26(9):1208–1221

    Article  Google Scholar 

  • Zhao Q, Tao H (2009) A motion observable representation using color correlogram and its applications to tracking. Comput Vis Image Underst 113(2):273–290

    Article  Google Scholar 

  • Zhong W, Lu H, Yang MH (2012) Robust object tracking via sparsity-based collaborative model. In: IEEE conference on computer vision and pattern recognition. pp 1838–1845

  • Zhou S, Krueger V, Chellappa R (2003) Probabilistic recognition of human faces from video. Comput Vis Image Underst 91(12):214–245

    Article  Google Scholar 

  • Zhou Q, Aggarwal J (2006) Object tracking in an outdoor environment using fusion of features and cameras. Image Vis Comput 24(11):1244–1255

    Article  Google Scholar 

  • Zhou H, Hu H (2008) Human motion tracking for rehabilitationa survey. Biomed Signal Process Control 3(1):1–18

    Article  Google Scholar 

  • Zhu X, Lei Z, Yan J, Yi D, Li S (2015) High-fidelity pose and expression normalization for face recognition in the wild. In: 2015 IEEE conference on computer vision and pattern recognition (CVPR). pp 787–796

  • Zivkovic Z (2004) Improved adaptive gaussian mixture model for background subtraction. In: Proceedings of the 17th international conference on pattern recognition, vol. 2. pp 28–31

Download references

Author information

Authors and Affiliations

  1. IT - Instituto de Telecomunicações, University of Beira Interior, Covilhã, Portugal

    João Neves & Hugo Proença

  2. Institute of High Performance Computing and Networking, National Research Council of Italy (ICAR-CNR), Naples, Italy

    Fabio Narducci & Silvio Barra

Authors
  1. João Neves
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Fabio Narducci
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Silvio Barra
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Hugo Proença
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to João Neves.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Neves, J., Narducci, F., Barra, S. et al. Biometric recognition in surveillance scenarios: a survey. Artif Intell Rev 46, 515–541 (2016). https://doi.org/10.1007/s10462-016-9474-x

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10462-016-9474-x

Keywords

Search

Navigation