Multimedia Tools and Applications

, Volume 73, Issue 1, pp 189–218 | Cite as

Offline quality monitoring for legal evidence images in video-surveillance applications

  • Aldo Maalouf
  • Mohamed-Chaker LarabiEmail author
  • Didier Nicholson


Video-surveillance attracted an important research effort in the last few years. Many works are dedicated to the design of efficient systems and the development of robust algorithms. video compression is a very important stage in order to ensure the viability of video-surveillance systems. However, it introduces some distortions decreasing significantly the detection, recognition and identification tasks for legal investigators. Fortunately, an important effort is made in terms of standard definition for video-surveillance in order to achieve to a complete interoperability. However, quality issues are still not addressed in an appropriate way. Investigators are often facing the dilemma of selecting the best match (legal evidence) of the targeted object in the video-sequence. In this paper, we propose an offline quality monitoring system for the extraction of most suitable legal evidence images for video-surveillance applications. This system is constructed around three innovative parts: First, a robust tracking algorithm based on foveal wavelet and mean shift. Second, a no-reference quality metric based on sharpness feature. Finally, a super-resolution algorithm allowing to increase the size of the tracked object without using any information outside the image itself. The combination of the proposed algorithms allowed the construction of a quality monitoring system increasing significantly the efficiency of the legal evidence image extraction.


Quality Video-surveillance Monitoring Tracking Super-resolution Sharpness metric 



This work has been supported by the project QuIAVU funded by the French Research Agency.


  1. 1.
    Allebach J, Wong PW (1996) Edge-directed interpolation. In: Proc. IEEE int. conf. on image procGoogle Scholar
  2. 2.
    ANSI/SIA OSIPS DVI-01 (2008) SIA open, systems integration and performance standards—digital video interface data modelGoogle Scholar
  3. 3.
    Arrêté du 3 août (2007) Portant définition des normes techniques des systèmes de vidéosurveillance. Accessed 31 Oct 2012
  4. 4.
    Batten CF (2000) Autofocusing and astigmatism correction in the scanning electron microscope. M. Phil. thesis, University of Cambridge, Cambridge, UKGoogle Scholar
  5. 5.
    Bovik A (2000) Handbook of image and video processing. Academic PressGoogle Scholar
  6. 6.
    Caviedes J, Obert F (2004) A new sharpness metric based on local kurtosis, edge and energy information. Signal Process 19(2):147–161Google Scholar
  7. 7.
    Chang DB, Carey WK, Hermami SS (1999) Regularity-preserving image interpolation. In: Proc. IEEE int. conf. on image proc., pp 1293–1297Google Scholar
  8. 8.
    Chern NK, Neow NPA, Ang MH (2001) Practical issues in pixel-based autofocusing for machine vision. Proc IEEE Int Conf Robot Autom 3:2791–2796Google Scholar
  9. 9.
    Cohen N, Gattuso J, MacLennan-Brown K (2009) CCTV operational requirements manual. Home Office Scientific Development Branch, publication no. 28/09. Accessed 31 Oct 2012
  10. 10.
    Comaniciu D, Meer P (2002) Mean shift: a robust approach toward feature space analysis. IEEE Trans Patt Anal Mach Intell 24(5):603–619CrossRefGoogle Scholar
  11. 11.
    Comaniciu D, Ramesh V, Meer P (2003) Kernel-based object tracking. IEEE Trans Patt Anal Mach Intell 25(5):564–575CrossRefGoogle Scholar
  12. 12.
    Davis J, Sharma V (2003) Otcbvs benchmark dataset collectionGoogle Scholar
  13. 13.
    Di Zenzo S (1986) A note on the gradient of multi-images. Comput Vis Graph Image Process 33:116–125CrossRefzbMATHGoogle Scholar
  14. 14.
    Elad M, Feuer A (1997) Restoration of single super-resolution image from several blurred, noisy and down-sampled measured images. IEEE Trans Image Process 6(12):1646–1658CrossRefGoogle Scholar
  15. 15.
    EN 50132-5-3 (2012) Alarm systems—CCTV surveillance systems for use in security applicationsGoogle Scholar
  16. 16.
    Erasmus S, Smith K (1982) An automatic focusing and astigmatism correction system for the sem and ctem. J Microsc 127:185–199CrossRefGoogle Scholar
  17. 17.
    Ferzli R, Karam LJ (2009) A no-reference objective image sharpness metric based on the notion of just noticeable blur (jnb). IEEE Trans Image Process 18(4):717–728MathSciNetCrossRefGoogle Scholar
  18. 18.
    Firestone L, Cook K, Talsania N, Preston K (1991) Comparison of autofocus methods for automated microscopy. Cytometry 12:195–206CrossRefGoogle Scholar
  19. 19.
    Ford C, Stange I (2010) A framework for generalizing public safety video applications to determine quality requirements. In: IEEE conference on multimedia communications, services and security, Krakow, Poland, 6–7 May 2010Google Scholar
  20. 20.
    Hardie R, Barnard K, Amstrong E (1997) Joint map registration and high-resolution image estimation using a sequence of undersampled images. IEEE Trans Image Process 6(12):1621–1633CrossRefGoogle Scholar
  21. 21.
    Irani M, Peleg S (1991) Improving resolution by image registration. CVGIP, Graph Models Image Process 53:231–239CrossRefGoogle Scholar
  22. 22.
    ISO 22311 (2012) Societal security—Videosurveillance Format for InteroperabilityGoogle Scholar
  23. 23.
    ISO/IEC JTC1 SC29 wg1n5595 (2009) Call for advanced image coding (AIC) for security applicationsGoogle Scholar
  24. 24.
    ISO/IEC JTC1 SC29 wg1n5598 (2009) ISO/IEC 29170 AIC technical report on evaluation methodologies—working draft v3Google Scholar
  25. 25.
    ITU-T J.144 (2004) Rec. Objective perceptual video quality measurement techniques for digital cable television in the presence of a full referenceGoogle Scholar
  26. 26.
    ITU-T J.149 (2004) Rec. Method for specifying accuracy and cross-calibration of video quality metrics (VQM)Google Scholar
  27. 27.
    Jensen K, Anastassiou D (1995) Subpixel edge localization and the interpolation of still images. IEEE Trans Image Process 4:285–295CrossRefGoogle Scholar
  28. 28.
    Leachtenauer JC, Malila W, Irvine J, Colburn L, Salvaggio N (1997) General image-quality equation: GIQE. Appl Opt IP 36(32):8322–8328CrossRefGoogle Scholar
  29. 29.
    Li X, Orchard MT (2001) New edge-directed interpolation. IEEE Trans Image Process 10(10):1521–1527CrossRefGoogle Scholar
  30. 30.
    Maalouf A, Carré P, Augereau B, Fernandez-Maloigne C (2007) Regularization of multivalued images by means of a wavelet-based partial differential equation, EUSIPCO2007. In: 15th European signal processing conference, Poznan, PolandGoogle Scholar
  31. 31.
    Mallat S (2000) Foveal orthonormal wavelets for singularities. Tech. report, Ecole PolytechniqueGoogle Scholar
  32. 32.
    Mallat S (2009) Geometrical grouplets. Appl Comput Harmon Anal 26(2):161–180MathSciNetCrossRefzbMATHGoogle Scholar
  33. 33.
    Mallat S, Hwang WL (1992) Singularity detection and processing with wavelets. IEEE Trans Inf Theory 38:617–643MathSciNetCrossRefzbMATHGoogle Scholar
  34. 34.
    Mallat S, Zhong S (1992) Characterization of signals from multiscale edges. IEEE Trans Pattern Anal Mach Intell 14(7):710–732CrossRefGoogle Scholar
  35. 35.
    Marziliano P, Dufaux F, Winkler S, Ebrahimi T (2004) Perceptual blur and ringing metrics: applications to jpeg2000. Signal Process Image Commun 19(2):163–172CrossRefGoogle Scholar
  36. 36.
    Muresan DD, Parks TW (2000) Prediction of image detail. In: Proc. IEEE int. conf. on image proc., pp 323–326Google Scholar
  37. 37.
    National Image Interpretability Rating Scale (1996). Accessed 31 Oct 2012
  38. 38.
    Ning J, Zhang L, Zhang D, Wu C (2009) Robust object tracking using joint color-texture histogram. In: IJPRAIGoogle Scholar
  39. 39.
    Open Network Video Interface Forum (ONVIF) (2012). Accessed 31 Oct 2012
  40. 40.
    Patti AJ, Sezan MI, Tekalp AM (1997) Superresolution video reconstruction with arbitrary sampling lattices and nonzero aperture time. IEEE Trans Image Process 6(8):1064–1076CrossRefGoogle Scholar
  41. 41.
    Physical Security Interoperability Alliance (PSIA) (2012). Accessed 31 Oct 2012
  42. 42.
    Sabir MR, Sheikh HR, Bovik AC (2006) A statistical evaluation of recent full reference image quality assessment algorithms. IEEE Trans Image Process 15:3440–3451CrossRefGoogle Scholar
  43. 43.
    Target tracking movie demos (2012). Accessed 31 Oct 2012
  44. 44.
    The Eden project multi-sensor data set (2006). Accessed 31 Oct 2012
  45. 45.
    Video quality in public safety working group (2008) Defining video quality requirements: a guide for public safety, vol 1.0. Accessed 31 Oct 2012
  46. 46.
    VQEG (2000) Final report from the video quality experts group on the validation of objective models of video quality assessment. Accessed 31 Oct 2012
  47. 47.
    Wang Z, Bovik AC, Sheikh HR, Simoncelli EP (2004) Image quality assessment: from error visibility to structural similarity. IEEE Trans Image Process 13(4):600-612CrossRefGoogle Scholar
  48. 48.
    Zhang N, Vladar A, Postek M, Larrabee B (2003) A kurtosis-based statistitcal measure for two-dimensional processes and its application to image sharpness. In: Proc. section of physical and engineering sciences of American Statistical Society, pp 4730–4736Google Scholar

Copyright information

© Springer Science+Business Media New York 2012

Authors and Affiliations

  • Aldo Maalouf
    • 1
  • Mohamed-Chaker Larabi
    • 1
    Email author
  • Didier Nicholson
    • 2
  1. 1.XLIM Laboratory Department SICUniversity of PoitiersPoitiersFrance
  2. 2.Thales Communication and SystemThalesFrance

Personalised recommendations