Skip to main content

Why Does Non-binary Mask Optimisation Work for Diffusion-Based Image Compression?

  • Conference paper

Part of the Lecture Notes in Computer Science book series (LNIP,volume 8932)

Abstract

Finding optimal data for inpainting is a key problem for image-compression with partial differential equations. Not only the location of important pixels but also their values should be optimal to maximise the quality gain. The position of important data is usually encoded in a binary mask. Recent studies have shown that allowing non-binary masks may lead to tremendous speedups but comes at the expense of higher storage costs and yields prohibitive memory requirements for the design of competitive image compression codecs. We show that a recently suggested heuristic to eliminate the additional storage costs of the non-binary mask has a strong theoretical foundation in finite dimension. Binary and non-binary masks are equivalent in the sense that they can both give the same reconstruction error if the binary mask is supplemented with optimal data which does not increase the memory footprint. Further, we suggest two fast numerical schemes to obtain this optimised data. This provides a significant building block in the conception of efficient data compression schemes with partial differential equations.

Keywords

  • Laplace Interpolation
  • Inpainting
  • Convex Optimisation

This is a preview of subscription content, access via your institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • DOI: 10.1007/978-3-319-14612-6_7
  • Chapter length: 14 pages
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
eBook
USD   69.99
Price excludes VAT (USA)
  • ISBN: 978-3-319-14612-6
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
Softcover Book
USD   89.99
Price excludes VAT (USA)

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Masnou, S., Morel, J.M.: Level lines based disocclusion. In: Proc. of the International Conference on Image Processing, vol. 3, pp. 259–263. IEEE (1998)

    Google Scholar 

  2. Bertalmío, M., Sapiro, G., Caselles, V., Ballester, C.: Image inpainting. In: Proc. SIGGRAPH, pp. 417–424. ACM Press/Addison-Wesley Publishing Company, New Orleans, LI (2000)

    CrossRef  Google Scholar 

  3. Galić, I., Weickert, J., Welk, M., Bruhn, A., Belyaev, A., Seidel, H.-P.: Towards PDE-based image compression. In: Paragios, N., Faugeras, O., Chan, T., Schnörr, C. (eds.) VLSM 2005. LNCS, vol. 3752, pp. 37–48. Springer, Heidelberg (2005)

    CrossRef  Google Scholar 

  4. Liu, D., Sun, X., Wu, F., Li, S., Zhang, Y.Q.: Image compression with edge-based inpainting. IEEE Transactions on Circuits, Systems and Video Technology 7(10), 1273–1286 (2007)

    Google Scholar 

  5. Belhachmi, Z., Bucur, D., Burgeth, B., Weickert, J.: How to choose interpolation data in images. SIAM Journal on Applied Mathematics 70(1), 333–352 (2009)

    CrossRef  MATH  MathSciNet  Google Scholar 

  6. Schmaltz, C., Weickert, J., Bruhn, A.: Beating the quality of JPEG 2000 with anisotropic diffusion. In: Denzler, J., Notni, G., Süße, H. (eds.) DAGM 2009. LNCS, vol. 5748, pp. 452–461. Springer, Heidelberg (2009)

    Google Scholar 

  7. Mainberger, M., Bruhn, A., Weickert, J., Forchhammer, S.: Edge-based compression of cartoon-like images with homogeneous diffusion. Pattern Recognition 44(9), 1859–1873 (2011)

    CrossRef  Google Scholar 

  8. Mainberger, M., Hoffmann, S., Weickert, J., Tang, C.H., Johannsen, D., Neumann, F., Doerr, B.: Optimising spatial and tonal data for homogeneous diffusion inpainting. In: Bruckstein, A.M., ter Haar Romeny, B.M., Bronstein, A.M., Bronstein, M.M. (eds.) SSVM 2011. LNCS, vol. 6667, pp. 26–37. Springer, Heidelberg (2012)

    CrossRef  Google Scholar 

  9. Bourquard, A., Unser, M.: Anisotropic interpolation of sparse generalized image samples. IEEE Transactions on Image Processing 22(2), 459–472 (2013)

    CrossRef  MathSciNet  Google Scholar 

  10. Hoeltgen, L., Setzer, S., Weickert, J.: An optimal control approach to find sparse data for Laplace interpolation. In: Heyden, A., Kahl, F., Olsson, C., Oskarsson, M., Tai, X.-C. (eds.) EMMCVPR 2013. LNCS, vol. 8081, pp. 151–164. Springer, Heidelberg (2013)

    CrossRef  Google Scholar 

  11. Chen, Y., Ranftl, R., Pock, T.: A bi-level view of inpainting - based image compression. Computing Research Repository (2014), http://arxiv.org/abs/1401.4112v2

  12. Gomathi, R., Kumar, A.V.A.: A multiresolution image completion algorithm for compressing digital color images. Journal of Applied Mathematics 2014, Article ID 757318 (2014)

    Google Scholar 

  13. Köstler, H., Stürmer, M., Freundl, C., Rüde, U.: PDE based video compression in real time. Lehrstuhlbericht 07-11, Friedrich-Alexander-Universität Erlangen-Nürnberg (2011)

    Google Scholar 

  14. Ochs, P., Chen, Y., Brox, T., Pock, T.: iPiano: Inertial proximal algorithm for non-convex optimization. SIAM Journal on Imaging Sciences (to appear, 2014)

    Google Scholar 

  15. Ochs, P., Brox, T., Pock, T.: iPiasco: Inertial proximal algorithm for strongly convex optimization. Technical report, Universität Freiburg (2014)

    Google Scholar 

  16. Zaremba, S.: Sur un problème mixte relatif à l’équation de Laplace. Bulletin de l’Académie des Sciences de Cracovie, 313–344 (1910)

    Google Scholar 

  17. Gilbarg, D., Trudinger, N.: Elliptic Partial Differential Equations of Second Order. Springer (2001)

    Google Scholar 

  18. Galić, I., Weickert, J., Welk, M., Bruhn, A., Belyaev, A., Seidel, H.: Image compression with anisotropic diffusion. Journal of Mathematical Imaging and Vision 31(2-3), 255–269 (2008)

    CrossRef  MathSciNet  Google Scholar 

  19. Paige, C.C., Saunders, M.A.: Algorithm 583; LSQR: Sparse linear equations and least-squares problems. ACM Transactions on Mathematical Software 8(2), 195–209 (1982)

    CrossRef  MathSciNet  Google Scholar 

  20. Paige, C.C., Saunders, M.A.: LSQR: An algorithm for sparse linear equations and sparse least squares. ACM Transactions on Mathematical Software 8(1), 43–71 (1982)

    CrossRef  MATH  MathSciNet  Google Scholar 

  21. Golub, G.H., Kahan, W.: Calculating the singular values and pseudoinverse of a matrix. Journal of the Society for Industrial and Applied Mathematics 2(2), 205–224 (1965)

    MATH  MathSciNet  Google Scholar 

  22. Davis, T.A.: Algorithm 832: UMFPACK, an unsymmetric-pattern multifrontal method. ACM Transactions on Mathematical Software 30(2), 196–199 (2004)

    CrossRef  MATH  Google Scholar 

  23. Davis, T.A., Duff, I.S.: An unsymmetric-pattern multifrontal method for sparse LU factorization. SIAM Journal on Matrix Analysis and Applications 18(1), 104–158 (1997)

    CrossRef  MathSciNet  Google Scholar 

  24. Davis, T.A., Duff, I.S.: A combined unifrontal/multifrontal method for unsymmetric sparse matrices. ACM Transactions on Mathematical Software 25(1), 1–19 (1999)

    CrossRef  MATH  MathSciNet  Google Scholar 

  25. Chambolle, A., Pock, T.: A first order primal-dual algorithm for convex problems with applications to imaging. Journal of Mathematical Imaging and Vision 40(1), 120–145 (2011)

    CrossRef  MATH  MathSciNet  Google Scholar 

  26. Pock, T., Chambolle, A.: Diagonal preconditioning for first order primal-dual algorithms in convex optimization. In: Metaxas, D., Quan, L., Sanfeliu, A., Van Gool, L. (eds.) 2011 International Conference on Computer Vision (ICCV 2011), pp. 1762–1769. IEEE (2011)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and Permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this paper

Cite this paper

Hoeltgen, L., Weickert, J. (2015). Why Does Non-binary Mask Optimisation Work for Diffusion-Based Image Compression?. In: Tai, XC., Bae, E., Chan, T.F., Lysaker, M. (eds) Energy Minimization Methods in Computer Vision and Pattern Recognition. EMMCVPR 2015. Lecture Notes in Computer Science, vol 8932. Springer, Cham. https://doi.org/10.1007/978-3-319-14612-6_7

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-14612-6_7

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-14611-9

  • Online ISBN: 978-3-319-14612-6

  • eBook Packages: Computer ScienceComputer Science (R0)