Unsupervised Footwear Impression Analysis and Retrieval from Crime Scene Data

Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9008)

Abstract

Footwear impressions are one of the most frequently secured types of evidence at crime scenes. For the investigation of crime series they are among the major investigative notes. In this paper, we introduce an unsupervised footwear retrieval algorithm that is able to cope with unconstrained noise conditions and is invariant to rigid transformations. A main challenge for the automated impression analysis is the separation of the actual shoe sole information from the structured background noise. We approach this issue by the analysis of periodic patterns. Given unconstrained noise conditions, the redundancy within periodic patterns makes them the most reliable information source in the image. In this work, we present four main contributions: First, we robustly measure local periodicity by fitting a periodic pattern model to the image. Second, based on the model, we normalize the orientation of the image and compute the window size for a local Fourier transformation. In this way, we avoid distortions of the frequency spectrum through other structures or boundary artefacts. Third, we segment the pattern through robust point-wise classification, making use of the property that the amplitudes of the frequency spectrum are constant for each position in a periodic pattern. Finally, the similarity between footwear impressions is measured by comparing the Fourier representations of the periodic patterns. We demonstrate robustness against severe noise distortions as well as rigid transformations on a database with real crime scene impressions. Moreover, we make our database available to the public, thus enabling standardized benchmarking for the first time.

Notes

Acknowledgement

This Project was supported by the Swiss Comission for Technology and Innovation (CTI) project 13932.1 PFES-ES. The authors thank the German State Criminal Police Offices of Niedersachsen and Bayern and the company forensity ag for their valuable support.

References

  1. 1.
    AlGarni, G., Hamiane, M.: A novel technique for automatic shoeprint image retrieval. Forensic Sci. Int. 181(1), 10–14 (2008)CrossRefGoogle Scholar
  2. 2.
    Cervelli, F., Dardi, F., Carrato, S.: A translational and rotational invariant descriptor for automatic footwear retrieval of real cases shoe marks. Eusipco (2010)Google Scholar
  3. 3.
    Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2005, vol. 1, pp. 886–893. IEEE (2005)Google Scholar
  4. 4.
    Dardi, F., Cervelli, F., Carrato, S.: A texture based shoe retrieval system for shoe marks of real crime scenes. In: Foggia, P., Sansone, C., Vento, M. (eds.) ICIAP 2009. LNCS, vol. 5716, pp. 384–393. Springer, Heidelberg (2009) CrossRefGoogle Scholar
  5. 5.
    De Chazal, P., Flynn, J., Reilly, R.B.: Automated processing of shoeprint images based on the fourier transform for use in forensic science. IEEE Trans. Pattern Anal. Mach. Intell. 27(3), 341–350 (2005)CrossRefGoogle Scholar
  6. 6.
    Gueham, M., Bouridane, A., Crookes, D., Nibouche, O.: Automatic recognition of shoeprints using fourier-mellin transform. In: NASA/ESA Conference on Adaptive Hardware and Systems, AHS 2008, pp. 487–491. IEEE (2008)Google Scholar
  7. 7.
    Harris, C., Stephens, M.: A combined corner and edge detector. In: Alvey Vision Conference, Manchester, UK, vol. 15, p. 50 (1988)Google Scholar
  8. 8.
    Lin, H.-C., Wang, L.-L., Yang, S.-N.: Extracting periodicity of a regular texture based on autocorrelation functions. Pattern Recogn. Lett. 18(5), 433–443 (1997)CrossRefGoogle Scholar
  9. 9.
    Liu, Y., Collins, R.T., Tsin, Y.: A computational model for periodic pattern perception based on frieze and wallpaper groups. IEEE Trans. Pattern Anal. Mach. Intell. 26(3), 354–371 (2004)CrossRefGoogle Scholar
  10. 10.
    Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60(2), 91–110 (2004)CrossRefGoogle Scholar
  11. 11.
    Luostarinen, T., Lehmussola, A.: Measuring the accuracy of automatic shoeprint recognition methods. J. Forensic Sci. (2014)Google Scholar
  12. 12.
    Nibouche, O., Bouridane, A., Crookes, D., Gueham, M., et al.: Rotation invariant matching of partial shoeprints. In: 13th International Machine Vision and Image Processing Conference, IMVIP 2009, pp. 94–98. IEEE (2009)Google Scholar
  13. 13.
    Patil, P.M., Kulkarni, J.V.: Rotation and intensity invariant shoeprint matching using gabor transform with application to forensic science. Pattern Recogn. 42(7), 1308–1317 (2009)CrossRefGoogle Scholar
  14. 14.
    Pavlou, M., Allinson, N.M.: Automatic extraction and classification of footwear patterns. In: Corchado, E., Yin, H., Botti, V., Fyfe, C. (eds.) IDEAL 2006. LNCS, vol. 4224, pp. 721–728. Springer, Heidelberg (2006) CrossRefGoogle Scholar
  15. 15.
    Pavlou, M., Allinson, N.M.: Automated encoding of footwear patterns for fast indexing. Image Vis. Comput. 27(4), 402–409 (2009)CrossRefGoogle Scholar
  16. 16.
    Shi, J., Tomasi, C.: Good features to track. In: 1994 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Proceedings CVPR 1994, pp. 593–600. IEEE (1994)Google Scholar
  17. 17.
    Su, H., Crookes, D., Bouridane, A., Gueham, M.: Local image features for shoeprint image retrieval. In: British Machine Vision Conference, vol. 2007 (2007)Google Scholar
  18. 18.
    Tang, Y., Srihari, S.N., Kasiviswanathan, H., Corso, J.J.: Footwear print retrieval system for real crime scene marks. In: Sako, H., Franke, K.Y., Saitoh, S. (eds.) IWCF 2010. LNCS, vol. 6540, pp. 88–100. Springer, Heidelberg (2011) CrossRefGoogle Scholar
  19. 19.
    Vedaldi, A., Fulkerson, B.: Vlfeat: An open and portable library of computer vision algorithms. In: Proceedings of the International Conference on Multimedia, pp. 1469–1472. ACM (2010)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  • Adam Kortylewski
    • 1
  • Thomas Albrecht
    • 1
  • Thomas Vetter
    • 1
  1. 1.Departement of Mathematics and Computer ScienceUniversity of BaselBaselSwitzerland

Personalised recommendations