Adaptive Stochastic Gradient Descent Optimisation for Image Registration
- 3.3k Downloads
We present a stochastic gradient descent optimisation method for image registration with adaptive step size prediction. The method is based on the theoretical work by Plakhov and Cruz (J. Math. Sci. 120(1):964–973, 2004). Our main methodological contribution is the derivation of an image-driven mechanism to select proper values for the most important free parameters of the method. The selection mechanism employs general characteristics of the cost functions that commonly occur in intensity-based image registration. Also, the theoretical convergence conditions of the optimisation method are taken into account. The proposed adaptive stochastic gradient descent (ASGD) method is compared to a standard, non-adaptive Robbins-Monro (RM) algorithm. Both ASGD and RM employ a stochastic subsampling technique to accelerate the optimisation process. Registration experiments were performed on 3D CT and MR data of the head, lungs, and prostate, using various similarity measures and transformation models. The results indicate that ASGD is robust to these variations in the registration framework and is less sensitive to the settings of the user-defined parameters than RM. The main disadvantage of RM is the need for a predetermined step size function. The ASGD method provides a solution for that issue.
KeywordsImage registration Optimisation Stochastic gradient descent Adaptive step sizes Parameter selection
- Collignon, A., Maes, F., Delaere, D., Vandermeulen, D., Suetens, P., & Marchal, G. (1995). Automated multi-modality image registration based on information theory. In Bizais, Y., Barillot, C., Di Paola, R. (Eds.), Information Processing in Medical Imaging (pp. 263–274). Dordrecht: Kluwer Academic. Google Scholar
- Cruz, P. (2005a). Almost sure convergence and asymptotical normality of a generalization of Kesten’s stochastic approximation algorithm for multidimensional case (Technical Report). Cadernos de Matemática, Série de Investigação, Collection of University of Aveiro, Department of Mathematics. http://22.214.171.124/dspace/handle/2052/74.
- Cruz, P. (2005b). Aproximação estocástica com valor do passo adaptativo. PhD thesis, University of Aveiro, Department of Mathematics. http://126.96.36.199/dspace/handle/2052/103.
- Petersen, K. B., & Pedersen, M. S. (2007). The Matrix Cookbook. http://matrixcookbook.com.
- Schäfer, J., & Strimmer, K. (2005). A shrinkage approach to large-scale covariance matrix estimation and implications for functional genomics. Statistical Applications in Genetics and Molecular Biology, 4(1), article 32. Google Scholar