Skip to main content
SpringerLink
Log in

Improved Color Patch Similarity Measure Based Weighted Median Filter

  • Conference paper
  • First Online:
Computer Vision -- ACCV 2014 (ACCV 2014)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 9007))

Included in the following conference series:

Abstract

Median filtering the intermediate flow fields during optimization has been demonstrated to be very useful for improving the estimation accuracy. By formulating the median filtering heuristic as non-local term in the objective function, and modifying the new term to include flow and image information that according to spatial distance, color similarity as well as the occlusion state, a weighted non-local term (a practical weighted median filter) reduces errors that are produced by median filtering and better preserves motion details. However, the color similarity measure, which is the most powerful cue, can be easily perturbed by noisy pixels. To increase robustness of the weighted median filter to noise, we introduce the idea of non-local patch denoising method to compute the color similarity in terms of patch difference. Most importantly, we propose an improved color patch similarity measure (ICPSM) to modify the traditional patch manner based measure from three aspects. Comparative experimental results on different optical flow benchmarks show that our method can denoise the flow field more effectively and outperforms the state-of-the art methods, especially for heavy noise sequences.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Horn, B., Schunck, B.: Determining optical flow. Artif. Intell. 17, 185–203 (1981)

    Article  Google Scholar 

  2. Brox, T., Bruhn, A., Papenberg, N., Weickert, J.: High accuracy optical flow estimation based on a theory for warping. In: Pajdla, T., Matas, J.G. (eds.) ECCV 2004. LNCS, vol. 3024, pp. 25–36. Springer, Heidelberg (2004)

    Chapter  Google Scholar 

  3. Baker, S., Scharstein, D., Lewis, J.P., Roth, S., Black, M.J., Szeliski, R.: A database and evaluation methodology for optical flow. Int. J. Comput. Vis. 92, 1–31 (2011)

    Article  Google Scholar 

  4. Black, M.J., Anandan, P.: The robust estimation of multiple motions: parametric and piecewise smooth flow elds. Comput. Vis. Image Underst. 63, 75–104 (1996)

    Article  Google Scholar 

  5. Sun, D., Roth, S., Black, M.J.: A quantitative analysis of current practices in optical flow estimation and the principles behind them. Int. J. Comput. Vis. 106, 115–137 (2014)

    Article  Google Scholar 

  6. Xiao, J., Cheng, H., Sawhney, H.S., Rao, C., Isnardi, M.: Bilateral filtering-based optical flow estimation with occlusion detection. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006, Part I. LNCS, vol. 3951, pp. 211–224. Springer, Heidelberg (2006)

    Chapter  Google Scholar 

  7. Tu, Z., Aa, N., Gemeren, C.V., Veltkamp, R.C.: A combined post-filtering method to improve accuracy of variational optical flow estimation. Pattern Recogn. 47, 1926–1940 (2014)

    Article  Google Scholar 

  8. Lucas, B.D., Kanade, T.: An iterative image registration technique with an application to stereo vision. In: Proceedings of the International Joint Conference on Artificial Intelligence, pp. 674–679 (1981)

    Google Scholar 

  9. Xu, L., Jia, J., Matsushita, Y.: Motion detail preserving optical flow estimation. IEEE Trans. Pattern Anal. Mach. Intel. 16, 1744–1757 (2012)

    Google Scholar 

  10. Chen, Z., Jin, H., Lin, Z., Cohen, S., Wu, Y.: Large displacement optical flow from nearest neighbor fields. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 2443–2450 (2013)

    Google Scholar 

  11. Wedel, A., Pock, T., Zach, C., Bischof, H., Cremers, D.: An improved algorithm for TV-L \(^{\rm {1}}\) optical flow. In: Cremers, D., Rosenhahn, B., Yuille, A.L., Schmidt, F.R. (eds.) Statistical and Geometrical Approaches to Visual Motion Analysis. LNCS, vol. 5604, pp. 23–45. Springer, Heidelberg (2009)

    Chapter  Google Scholar 

  12. Wedel, A., Pock, T., Cremers, D.: Structure- and motion adaptive regularization for high accuracy optic flow. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 1663–1668 (2009)

    Google Scholar 

  13. Rashwan, H.A., Garca, M.A., Puig, D.: Variational optical flow estimation based on stick tensor voting. IEEE Trans. Image Process. 22, 2589–2599 (2013)

    Article  Google Scholar 

  14. Buades, A., Coll, B., Morel, J.: A review of image denoising algorithms, with a new one. SIAM Multiscale Model. Simul. 4, 490–530 (2005)

    Article  MATH  MathSciNet  Google Scholar 

  15. Chaudhury, K.N., Singer, A.: Non-local Euclidean medians. IEEE Sig. Process. Lett. 19, 745–748 (2012)

    Article  Google Scholar 

  16. Sun, Z., Chen, S.: Analysis of non-local Euclidean medians and its improvement. IEEE Sig. Process. Lett. 20, 303–306 (2013)

    Article  Google Scholar 

  17. Aharon, M., Elad, M., Bruckstein, A.M.: The K-SVD: an algorithm for designing of over complete dictionaries for sparse representation. IEEE Sig. Process. Lett. 54, 4311–4322 (2006)

    Article  Google Scholar 

  18. Chatterjee, P., Milanfar, P.: Patch-based near-optimal image denoising. IEEE Trans. Image Process. 21, 1635–1649 (2012)

    Article  MathSciNet  Google Scholar 

  19. Greenberg, S., Kogan, D.: Improved structure-adaptive anisotropic filter. Pattern Recognit. Lett. 27, 59–65 (2006)

    Article  Google Scholar 

  20. Rother, C., Kolmogorov, V., Lempitsky, V.S., Szummer, M.: Optimizing binary MRFS via extended roof duality. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 1–8 (2007)

    Google Scholar 

  21. Kim, T.H., Lee, H.S., Lee, K.M.: Optical flow via locally adaptive fusion of complementary data costs. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 3344–3351 (2013)

    Google Scholar 

  22. Zhang, Q., Xu, L., Jia, J.: 100+ times faster weighted median filter (WMF). In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (2014)

    Google Scholar 

  23. Butler, D.J., Wulff, J., Stanley, G.B., Black, M.J.: A naturalistic open source movie for optical flow evaluation. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012, Part VI. LNCS, vol. 7577, pp. 611–625. Springer, Heidelberg (2012)

    Chapter  Google Scholar 

  24. Liu, C., Freeman, W.T., Adelson, E.H., Weiss, Y.: Human-assisted motion annotation. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 1–8 (2008)

    Google Scholar 

  25. Weinzaepfel, P., Revaud, J., Harchaoui, Z., Schmid, C.: DeepFlow: large displacement optical flow with deep matching. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 1385–1392 (2013)

    Google Scholar 

  26. Bao, L., Yang, Q., Jin, H.: Fast edge-preserving patchmatch for large displacement optical flow. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (2014)

    Google Scholar 

Download references

Acknowledgements

This publication was supported by the Dutch national program COMMIT.

Author information

Authors and Affiliations

  1. Department of Information and Computing Sciences, Utrecht University, Utrecht, The Netherlands

    Zhigang Tu, Coert Van Gemeren & Remco C. Veltkamp

Authors
  1. Zhigang Tu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Coert Van Gemeren
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Remco C. Veltkamp
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Remco C. Veltkamp .

Editor information

Editors and Affiliations

  1. Technische Universität München, Garching, Germany

    Daniel Cremers

  2. University of Adelaide, Adelaide, South Australia, Australia

    Ian Reid

  3. Keio University, Yokohama, Kanagawa, Japan

    Hideo Saito

  4. University of California at Merced, Merced, California, USA

    Ming-Hsuan Yang

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this paper

Cite this paper

Tu, Z., Van Gemeren, C., Veltkamp, R.C. (2015). Improved Color Patch Similarity Measure Based Weighted Median Filter. In: Cremers, D., Reid, I., Saito, H., Yang, MH. (eds) Computer Vision -- ACCV 2014. ACCV 2014. Lecture Notes in Computer Science(), vol 9007. Springer, Cham. https://doi.org/10.1007/978-3-319-16814-2_27

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-16814-2_27

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-16813-5

  • Online ISBN: 978-3-319-16814-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation