Image Segmentation with Depth Information via Simplified Variational Level Set Formulation
- 832 Downloads
Image segmentation with depth information can be modeled as a minimization problem with Nitzberg–Mumford–Shiota functional, which can be transformed into a tractable variational level set formulation. However, such formulation leads to a series of complicated high-order nonlinear partial differential equations which are difficult to solve efficiently. In this paper, we first propose an equivalently reduced variational level set formulation without using curvatures by taking level set functions as signed distance functions. Then, an alternating direction method of multipliers (ADMM) based on this simplified variational level set formulation is designed by introducing some auxiliary variables, Lagrange multipliers via using alternating optimization strategy. With the proposed ADMM method, the minimization problem for this simplified variational level set formulation is transformed into a series of sub-problems, which can be solved easily via using the Gauss–Seidel iterations, fast Fourier transform and soft thresholding formulas. The level set functions are treated as signed distance functions during computation process via implementing a simple algebraic projection method, which avoids the traditional re-initialization process for conventional variational level set methods. Extensive experiments have been conducted on both synthetic and real images, which validate the proposed approach, and show advantages of the proposed ADMM projection over algorithms based on traditional gradient descent method in terms of computational efficiency.
KeywordsSegmentation with depth Nitzberg–Mumford–Shiota (NMS)functional Variational level set formulation Alternating direction method of multipliers (ADMM) Projection method Fast Fourier Transform (FFT) Soft thresholding formulas
The work has been partially supported by the National Natural Science Foundation of China with Grant numbers 61305045, 61170106, 61363066 and 61303079.
- 1.Nitzberg, M., Mumford, D.: The 2.1D sketch. In: Proceedings of the Third IEEE International Conference on Computer Vision, pp. 138–144 (1990)Google Scholar
- 30.Tai, X.-C.: Fast Numerical Schemes Related to Curvature Minimization: A Brief and Elementary Review, UCLA CAM Report14-40 (May, 2014)Google Scholar
- 33.Li, C., Xu, C., Gui, C., Fox, M. D.: Level set evolution without re-initialization: a new variational formulation. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2005, vol. 1, pp. 430–436, June 20 (2005)Google Scholar
- 35.Duan, J., Pan, Z., Yin, X., Wei, W., Wang, G. (2014) Some fast projection methods based on Chan–Vese model for image segmentation. EURASIP J. Image Video Process. 10.1186/1687-5281-2014-7
- 36.Yashtini, M.: Alternating Direction Method of Multiplier for Euler’s Elastica-Based Denoising, Scale Space and Variational Methods in Computer Vision, pp. 690–701. Springer, Berlin (2015)Google Scholar
- 39.Wang, Y., Yin, W., Zeng, J.: Global convergence of ADMM in nonconvex nonsmooth optimization. arXiv preprint arXiv:1511.06324, (2015)
- 40.Glowinski, R., Pan, T.W., Tai, X.C.: Some facts about operator splitting and alternating direction methods. UCLA CAM Report: 16-10 (2016)Google Scholar