Total variation with nonlocal FT-Laplacian for patch-based inpainting
We consider the problem of inpainting for relatively large damaged areas where the best-known results are achieved using patches. We stem from the ROF-type model. We propose a new ROF model with nonlocal operators and modify it with the F-transform-based operators. As a result, the minimization is considered over a searching space restricted to a finite set of possible reconstructions; each of them is a result of a patch-based inpainting. The fidelity term in the proposed ROF model is estimated by the norm in a Sobolev-like space, which increases the overall quality of reconstruction.
KeywordsInpainting Patch Fuzzy F-transform Total variation ROF model
This work was partially supported by the Project LQ1602 IT4 Innovations excellence in science. The implementation of the F-transform technique is available as a part of the OpenCV framework (Module fuzzy, which is included in opencv_contrib and available at https://github.com/itseez/opencv_contrib).
Compliance with ethical standards
Conflict of interest
Authors Irina Perfilieva and Pavel Vlašánek declare that they have no conflict of interest.
Human and animal rights statement
This article does not contain any studies with human participants or animals performed by any of the authors.
- Ashikhmin M (2001) Synthesizing natural textures. In: Proceedings of the 2001 symposium on interactive 3D graphics. ACM, pp 217–226Google Scholar
- Bertalmio M, Sapiro G, Caselles V, Ballester C (2000) Image inpainting. In: Proceedings of the 27th annual conference on computer graphics and interactive techniques. ACM Press/Addison-Wesley Publishing Co., pp 417–424Google Scholar
- Bogischef V, Merget D, Tiefenbacher P, Rigoll G (2015) Subjective and 453 objective evaluation of image inpainting quality. In: IEEE international conference on image processing (ICIP). IEEE, pp 447–451Google Scholar
- De Bonet JS (1997) Multiresolution sampling procedure for analysis and synthesis of texture images. In: Proceedings of the 24th annual conference on computer graphics and interactive techniques. ACM Press/Addison-Wesley Publishing Co., pp 361–368Google Scholar
- Efros AA, Freeman WT (2001) Image quilting for texture synthesis and transfer. In: Proceedings of the 28th annual conference on computer graphics and interactive techniques. ACM, pp 341–346Google Scholar
- Efros AA, Leung TK (1999) Texture synthesis by non-parametric sampling. In: The proceedings of the seventh IEEE international conference on computer vision, vol 2. IEEE, pp 1033–1038Google Scholar
- Heeger DJ, Bergen JR (1995) Pyramid-based texture analysis/synthesis. In: Proceedings of the 22nd annual conference on computer graphics and interactive techniques. ACM, pp 229–238Google Scholar
- Perfilieva I, Vlašánek P, Wrublová M (2012) Fuzzy transform for image reconstruction. In: Kahraman C, Kerre EE, Bozbura FT (eds) Uncertainty modeling in knowledge engineering and decision making. World Scientific, SingaporeGoogle Scholar
- Perfilieva I, Danková M (2009) Towards F-transform of a higher degree. In: IFSA/EUSFLAT conference. Citeseer, pp 585–588Google Scholar
- Tiefenbacher P, Bogischef V, Merget D, Rigoll G (2015) Subjective and objective evaluation of image inpainting quality. In: IEEE international conference on image processing (ICIP). IEEE, pp 447–451Google Scholar
- Vlašánek P, Perfilieva I (2013) Image reconstruction with usage of the F-transform. In: International joint conference CISIS’12-ICEUTE’12-SOCO’12 special sessions. Springer, Berlin, pp 507–514Google Scholar
- Vlašánek P, Perfilieva I (2013) Influence of various types of basic functions on image reconstruction using F-transform. In: European society for fuzzy logic and technology. Atlantis Press, pp 497–502Google Scholar
- Vlasanek P, Perfilieva I (2014) Interpolation techniques versus F-transform in application to image reconstruction. In: Fuzzy systems (FUZZ-IEEE), 2014 IEEE international conference. IEEE, pp 533–539Google Scholar
- Vlašánek P, Perfilieva I (2015) F-transform and discrete convolution. In: European society for fuzzy logic and technology. Atlantis PressGoogle Scholar