Skip to main content
SpringerLink
Log in

Dynamic texture as foreground and background

  • Special Issue Paper
  • Published:
Machine Vision and Applications Aims and scope Submit manuscript

Abstract

Depending on application, temporal texture can be viewed as either foreground or background. We address two related problems: finding regions of dynamic texture in a video and detecting moving targets in a dynamic texture. We propose efficient and fast methods for both cases. The methods can be potentially used in real-time applications of machine vision. First, we show how the optical flow residual can be used to find dynamic texture in video. The algorithm is a practical, real-time simplification of the sophisticated and powerful but time-consuming method (Fazekas et al. in Int J Comput Vis 82:48–63, 2009). We give numerous examples of detecting and segmenting fire, smoke, water and other dynamic textures in real-world videos acquired by static and moving cameras. Then we apply the singular value decomposition (SVD) to a temporal data window in a video to detect targets in dynamic texture via the residual of the largest singular value. For a dynamic background of low-temporal periodicity, such as water, no temporal periodicity analysis is needed. For a highly periodic background such as an escalator, we show that periodicity analysis can improve detection results. Applying the method proposed in Chetverikov and Fazekas (Proceedings of British machine vision conference, vol 1, pp 167–176, 2006), we find the temporal period and use the resonant SVD to detect moving targets against a time-periodic background.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Brox, T., Bruhn, A., Papenberg, N., Weickert, J.: High accuracy optical flow estimation based on a theory for warping. In: Proceedings of European Conference on Computer Vision, vol. IV, pp. 25–36 (2004)

  2. Bruhn A., Weickert J., Schnörr C.: Lucas/Kanade meets Horn/Schunck: combining local and global optic flow methods. Int. J. Comput. Vis. 61(3), 211–231 (2005)

    Article  Google Scholar 

  3. Chan, A.B., Vasconcelos, N.: Layered dynamic textures. In: Weiss, Y., Schölkopf, B., Platt, J. (eds.) Advances in Neural Information Processing Systems, vol. 18, pp. 203–210. MIT Press, Cambridge (2006)

  4. Chetverikov, D., Axt, A.: Approximation-free running SVD and its application to motion detection. Pattern Recognit. Lett. (2009, submitted)

  5. Chetverikov, D., Fazekas, S.: On motion periodicity of dynamic textures. In: Proceedings of British Machine Vision Conference, vol. 1, pp. 167–176 (2006)

  6. Chetverikov, D., Péteri, R.: A brief survey of dynamic texture description and recognition. In: 4th International Conference on Computer Recognition Systems (CORES’05), Springer Advances in Soft Computing, pp. 17–26 (2005)

  7. Cooper, L., Liu, J., Huang, K.: Spatial segmentation of temporal texture using mixture linear models. In: LNCS, vol. 4358, pp. 142–150. Springer, New York (2007)

  8. Crivelli, T., Cernuschi-Frias, B., Bouthemy, P., Yao, J.-F.: Mixed-state markov random fields for motion texture modeling and segmentation. In: Proceedings of International Conference on Image Processing (2006)

  9. Dedeoglu, Y., Toreyin, B.U., Gudukbay, U., Cetin, A.E.: Real-time fire and flame detection in video. In: IEEE International Conference Acoustics, Speech, and Signal Processing, vol. 2, pp. 669–672 (2005)

  10. Doretto, G., Cremers, D., Favaro, P., Soatto, S.: Dynamic texture segmentation. In: Ninth International Conference on Computer Vision, p. 1236 (2003)

  11. Fazekas, S., Amiaz, T., Chetverikov, D., Kiryati, N.: Demo of dynamic texture detection and segmentation. http://vision.sztaki.hu/~fazekas/dtsegm/result/index.html (2007)

  12. Fazekas S., Amiaz T., Chetverikov D., Kiryati N.: Dynamic texture detection based on motion analysis. Int. J. Comput. Vis. 82, 48–63 (2009)

    Article  Google Scholar 

  13. Fazekas, S., Chetverikov, D.: Dynamic texture recognition using optical flow features and temporal periodicity. In: Fifth International Workshop on Content-Based Multimedia Indexing (CBMI), pp. 25–32 (2007)

  14. Free Software Foundation, Inc: GNU Scientific Library (GSL), version gsl-1.10. www.gnu.org/software/gsl/ (2007)

  15. Ghoreyshi, A., Vidal, R.: Segmenting dynamic textures with ising descriptors, ARX models and level sets. In: LNCS, vol. 4358, pp. 121–141. Springer, New York (2007)

  16. Gu, M.: Studies in numerical linear algebra. PhD thesis, Yale University, New Haven (1993)

  17. Hall, P., Marshall, D., Martin, R.: On adding and subtracting eigenspaces with EVD and SVD. In: Proceedings of British Machine Vision Conference, pp. 453–462 (1999)

  18. Horn B.K.P.: Robot Vision. McGraw-Hill, New York (1986)

    Google Scholar 

  19. Horn B.K.P., Schunck B.G.: Determining optical flow. Artif. Intell. 17, 185–203 (1981)

    Article  Google Scholar 

  20. Hull, D., Nascimento, J., Ribeiro, P., et al.: Comparison of target detection algorithms using adaptive background models. In: Joint IEEE Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance (VS-PETS), pp. 117–128 (2005)

  21. Intel Corporation, Microprocessor Research Labs. OpenCV: Open Source Computer Vision Library. http://sourceforge.net/projects/opencvlibrary/ (2007)

  22. Kahl, F., Hartley, R., Hilsenstein, V.: Novelty detection in image sequences with dynamic background. In: LNCS, vol. 3247, pp. 117–128. Springer, New York (2004)

  23. Kanjilal P.P., Bhattacharya J., Saha G.: Robust method for periodicity detection and characterization of irregular cyclical series in terms of embedded periodic components. Phys. Rev. E 59, 4013–4025 (1999)

    Article  Google Scholar 

  24. Lucas, B.D., Kanade, T.: An iterative image registration technique with an application to stereo vision. In: International Joint Conference on Artificial Intelligence, pp. 674–679 (1981)

  25. Mileva, Y., Bruhn, A., Weickert, J.: Illumination-robust variational optical flow with photometric invariants. In: Lecture Notes in Computer Science, vol. 4713, pp. 152–162. Springer, New York (2007)

  26. Monnet, A., Mittal, A., Paragios, N., Ramesh, V.: Background modeling and subtraction of dynamic scenes. In: Proceedings of International Conference on Computer Vision, vol. 2, pp. 1305–1312 (2003)

  27. MUSCLE Network of Excellence: Multimedia Understanding through Semantics, Computation and Learning. http://muscle.ercim.org/ (2005)

  28. Otsu N.: A threshold selection method from gray level histograms. IEEE Trans. Syst. Man Cybern. 9, 62–66 (1979)

    Article  Google Scholar 

  29. Péteri, R., Huskies, M., Fazekas, S.: DynTex: a comprehensive database of dynamic textures. www.cwi.nl/projects/dyntex/ (2005)

  30. Porikli, F., Tuzel, O.: Human body tracking by adaptive background models and mean-shift analysis. In: IEEE International Workshop on Performance Evaluation of Tracking and Surveillance (2003)

  31. Press W., Teukolsky S., Vetterling W., Flannery B.: Numerical Recipes in C. 2nd edn. Cambridge University Press, Cambridge (1992)

    MATH  Google Scholar 

  32. Radke R.J., Andra S., Al-Kofahi O., Roysam B.: Image change detection algorithms: a systematic survey. IEEE Trans. Image Process. 3, 294–307 (2005)

    Article  MathSciNet  Google Scholar 

  33. Rahman, A., Murshed, M.: Multiple temporal texture detection using feature space mapping. In: Sixth ACM International Conference on Image and Video Retrieva, pp. 417–424 (2007)

  34. Rahman, A., Murshed, M.: Temporal texture characterization: a review. In: Studies in Computational Intelligence, vol. 96, pp. 291–316. Springer, New York (2008)

  35. Shafer S.A.: Using color to separate reflection components. Color Res. Appl. 10(4), 210–218 (1985)

    Article  Google Scholar 

  36. Stauffer C., Grimson W.E.L.: Learning patterns of activity using real-time tracking. IEEE Trans. Pattern Anal. Mach. Intell. 22, 747–757 (2000)

    Article  Google Scholar 

  37. Toreyin, B.U., Dedeoglu, Y., Cetin, A.E.: Wavelet based real-time smoke detection in video. In: European Signal Processing Conference (2005)

  38. Toreyin B.U., Dedeoglu Y., Gudukbay U., Cetin A.E.: Computer vision based method for real-time fire and flame detection. Pattern Recognit. Lett. 27, 149–158 (2006)

    Article  Google Scholar 

  39. Zhong, J., Sclaroff, S.: Segmenting foreground objects from a dynamic textured background via a robust Kalman filter. In: Proceedings of International Conference on Computer Vision, vol. 1, pp. 44–50 (2003)

Download references

Author information

Authors and Affiliations

  1. Computer and Automation Research Institute (SZTAKI), Budapest, Hungary

    Dmitry Chetverikov & Sándor Fazekas

  2. Institute of Information Theory and Automation, Prague, Czech Republic

    Michal Haindl

Authors
  1. Dmitry Chetverikov
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Sándor Fazekas
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Michal Haindl
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Dmitry Chetverikov.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Chetverikov, D., Fazekas, S. & Haindl, M. Dynamic texture as foreground and background. Machine Vision and Applications 22, 741–750 (2011). https://doi.org/10.1007/s00138-010-0251-6

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00138-010-0251-6

Keywords

Search

Navigation