A Linear Framework for Region-Based Image Segmentation and Inpainting Involving Curvature Penalization
We present the first method to handle curvature regularity in region-based image segmentation and inpainting that is independent of initialization.
To this end we start from a new formulation of length-based optimization schemes, based on surface continuation constraints, and discuss the connections to existing schemes. The formulation is based on a cell complex and considers basic regions and boundary elements. The corresponding optimization problem is cast as an integer linear program.
We then show how the method can be extended to include curvature regularity, again cast as an integer linear program. Here, we are considering pairs of boundary elements to reflect curvature. Moreover, a constraint set is derived to ensure that the boundary variables indeed reflect the boundary of the regions described by the region variables.
We show that by solving the linear programming relaxation one gets reasonably close to the global optimum, and that curvature regularity is indeed much better suited in the presence of long and thin objects compared to standard length regularity.
KeywordsCurvature regularity Image segmentation Inpainting Linear programming Cell complexes
Unable to display preview. Download preview PDF.
- Bertalmío, M., Sapiro, G., Caselles, V., & Ballester, C. (2001). Image inpainting. In ACM SIGGRAPH, July 2001. Google Scholar
- Blake, A., & Zissermann, A. (1987). Visual reconstruction. Cambridge: MIT press. Google Scholar
- Boykov, Y., & Jolly, M. P. (2001). Interactive graph cuts for optimal boundary and region segmentation of objects in n-d images. In IEEE international conference on computer vision (ICCV), Vancouver, Canada, July 2001. Google Scholar
- Boykov, Y., & Kolmogorov, V. N. (2003). Computing geodesics and minimal surfaces via graph cuts. In IEEE international conference on computer vision (ICCV), Nice, France, October 2003. Google Scholar
- Cao, F., Gousseau, Y., Masnou, S., & Pérez, P. (2012). Geometrically guided expemplar-based inpainting. SIAM Journal on Imaging Sciences, submitted. Google Scholar
- El-Zehiry, N. Y., & Grady, L. (2010). Fast global optimization of curvature. In IEEE computer society conference on computer vision and pattern recognition (CVPR), San Francisco, California, June 2010. Google Scholar
- Goldlücke, B., & Cremers, D. (2011). Introducing total curvature for image processing. In IEEE international conference on computer vision (ICCV), Barcelona, Spain, November 2011. Google Scholar
- Greig, D. M., Porteous, B. T., & Seheult, A. H. (1989). Exact maximum a posteriori estimation for binary images. Journal of the Royal Statistical Society Series B Methodological, 51(2), 271–279. Google Scholar
- Kanizsa, G. (1971). Contours without gradients or cognitive contours. Giornale Italiano Di Psicologia, 1, 93–112. Google Scholar
- Klodt, M., Schoenemann, T., Kolev, K., Schikora, M., & Cremers, D. (2008). An experimental comparison of discrete and continuous shape optimization methods. In European conference on computer vision (ECCV), Marseille, France, October 2008. Google Scholar
- Masnou, S., & Morel, J. M. (1998). Level-lines based disocclusion. In International conference on image processing (ICIP), Chicago, Michigan, 1998. Google Scholar
- Nitzberg, M., Mumford, D., & Shiota, T. (1993). Filtering, segmentation and depth. In LNCS, vol. 662. Berlin: Springer. Google Scholar
- Schoenemann, T., & Cremers, D. (2007). Introducing curvature into globally optimal image segmentation: minimum ratio cycles on product graphs. In IEEE international conference on computer vision (ICCV), Rio de Janeiro, Brazil, October 2007. Google Scholar
- Schoenemann, T., Kahl, F., & Cremers, D. (2009). Curvature regularity for region-based image segmentation and inpainting: A linear programming relaxation. In IEEE international conference on computer vision (ICCV), Kyoto, Japan, September 2009. Google Scholar
- Schoenemann, T., Kuang, Y., & Kahl, F. (2011). Curvature regularity for multi-label problems—standard and customized linear programming. In International workshop on energy minimization methods in computer vision and pattern recognition, St. Petersburg, Russia, July 2011. Google Scholar
- Strandmark, P., & Kahl, F. (2011). Curvature regularization for curves and surfaces in a global optimization framework. In International workshop on energy minimization methods in computer vision and pattern recognition, St. Petersburg, Russia, July 2011. Google Scholar
- Sullivan, J. M. (1992). A crystalline approximation theorem for hypersurfaces. PhD thesis, Princeton University, Princeton, New Jersey. Google Scholar
- Toshev, A., Taskar, B., & Daniilidis, K. (2010). Object detection via boundary structure segmentation. In IEEE computer society conference on computer vision and pattern recognition (CVPR), San Francisco, California, June 2010. Google Scholar
- Weickert, J. (2003). Coherence-enhancing shock filters. In Pattern recognition (proc. DAGM), Magdeburg, Germany, September 2003. Google Scholar