Feature extraction is one of the most important steps in processing endoscopic data. The extracted features should be invariant to image scale and rotation to provide a robust matching across a substantial range of affine distortions and changes in 3D space. In this study, a method is proposed on the basis of the dual-tree complex wavelet transform. First, a map is estimated for each scale, and then a Gaussian weighted additive function (GWAF) is determined. Keypoints are selected from local peaks of GWAF. The matching and registration are performed by applying normalized mutual information and our modified iterative closest point. Results are reported in terms of robustness to rotation, noise, color, brightness, number of keypoints, index of matching and execution time for the building, standard clinical and phantom sinus datasets. Although the results are comparable to that of the speeded up robust features, scale invariant feature transform, and the Harris method, they are more robust to the variations in rotation, brightness, color, and noise than those obtained from other methods. Registration errors obtained for consequent frames for building, clinical and phantom datasets are 0.97, 1.46 and 1.1 mm, respectively.
This is a preview of subscription content, log in to check access.
Buy single article
Instant access to the full article PDF.
Tax calculation will be finalised during checkout.
Subscribe to journal
Immediate online access to all issues from 2019. Subscription will auto renew annually.
Tax calculation will be finalised during checkout.
Mirota, D.J., et al.: High-accuracy 3D image-based registration of endoscopic video to C-arm cone-beam CT for image-guided skull base surgery. In: Medical Imaging 2011: Visualization, Image-Guided Procedures, and Modeling, vol. 7964 (2011)
Mirota, D.J., Uneri, A., Schafer, S., Nithiananthan, S., Reh, D., Ishii, M., Gallia, G.L., Taylor, R.H., Hager, G.D., Siewerdsen, J.H.: Evaluation of a system for high-accuracy 3D image-based registration of endoscopic video to C-arm cone-beam CT for image-guided skull base surgery. IEEE Trans. Med. Imaging. 32(7), (2013)
Thormahlen, T., Broszio, H., Meier, P.N.: Three-dimensional endoscopy. In: Falk Symposium, Medical Imaging in Gastroenterology and Hepatology, 212 edn., vol. 124, pp. 199–212. Hannover (2002)
Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60(2), 91–110 (2004)
Harris, C., Stephens, M.: A combined corner and edge detector. In: Alvey Vision Conference, pp. 147–151 (1988)
Mikolajczyk, K., Schmid, C.: A performance evaluation of local descriptors. IEEE Trans. Pattern Anal. Mach. Intell. 27(10), 1615–1630 (2005)
Bay, H., Tuytelaars, T., Van Gool, L.: SURF: speeded up robust features. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) Computer Vision—ECCV 2006, pp. 404–417. Springer, Berlin (2006)
Loupias, E. et al.: Wavelet-based salient points for image retrieval. In: IEEE International Conference on Image Processing (2000)
Neumann, J., Steidl, G.: Dual-tree complex wavelet transform in the frequency domain and an application to signal classification. Int. J. Wavelets Multiresolut Inf. Process. 3(43), (2005). doi:10.1142/S0219691305000749
Kingsbury, N.G.: Complex wavelets for shift invariant analysis and filtering of signals. J. Appl. Comput. Harmonic Anal. 10(3), 234–253 (2001)
Selesnick, I.W., Baraniuk, R.G., Kingsbury, N.G.: The dual-tree complex wavelet transform. IEEE Signal Process. Mag. 22(6), 123–151 (2005)
Papademetris, X., et al.: Integrated intensity and point-feature nonrigid registration. In: Barillot, C., Haynor, D.R., Hellier, P. (eds.) MICCAI (1), pp. 763–770. Springer, Berlin (2004)
Nabatchian, A., Abdel-Raheem, E., Ahmadi, M.: Illumination invariant feature extraction and mutual-information-based local matching for face recognition under illumination variation and occlusion. Pattern Recognit. 44(10–11), 2576–2587 (2011)
Wells III, W.M., et al.: Multi-modal volume registration by maximization of mutual information. Med. Image Anal. 1(1), 35–51 (1996)
Maes, F., et al.: Multimodality image registration by maximization of mutual information. IEEE Trans. Med. Imaging 16(2), 187–198 (1997)
Estevez, P.A., et al.: Normalized mutual information feature selection. IEEE Trans. Neural Netw. 20(2), 189–201 (2009)
Besl, P.J., McKay, N.D.: A method for registration of 3-D shapes. IEEE Trans. Pattern Anal. Mach. Intell. 14(2), 239–256 (1992)
Rusinkiewicz, S., Levoy, M.: Efficient variants of the ICP algorithm. In: 3-D Digital Imaging and Modeling. Quebec City, QC (2001)
Nazem, F., et al.: Two-stage point-based registration method between ultrasound and CT imaging of the liver based on ICP and unscented Kalman filter: a phantom study. Int. J. Comput. Assist. Radiol. Surg. 9(1), 39–48 (2014)
Ahmadian, A., et al.: An efficient method for estimation of soft tissue deformation based on intra-operative stereo image features and point-based registration. Int. J. Imaging Syst. Technol. 23(4), 294–303 (2013)
Bendale, P., Triggs, B., Kingsbury, N.: Multiscale keypoint analysis based on complex wavelets. In: Proceedings of the British Machine Vision Conference. BMVA Press (2010)
Fauqueur, J., Kingsbury, N., Anderson, R.: Multiscale keypoint detection using the dual-tree complex wavelet transform. In: International Conference Image Processing (2006)
Studholme, C., Hill, D.L.G., Hawkes, D.J.: An overlap invariant entropy measure of 3D medical image alignment. Pattern Recognit. 32(1), 71–86 (1999)
Abretske, D., et al.: Intelligent frame selection for anatomic reconstruction from endoscopic video. In: WACV, pp. 1–5. IEEE Computer Society (2009)
Serej, N.D., Ahmadian, A., Mohagheghi, S., Sadrehosseini, S.M.: A projected landmark method for reduction of registration error in image-guided surgery systems. Int. J. Comput. Assist. Radiol. Surg. 10(5), 541–554 (2015)
This research has been supported by Tehran University of Medical Sciences & health Services grant 90-04-30-15836. Also, the authors would like to thank Research Center for Biomedical Technology & Robotics, RCBTR for supporting and providing an environment to carry on this project.
Electronic supplementary material
Below is the link to the electronic supplementary material.
About this article
Cite this article
Serej, N.D., Ahmadian, A., Kasaei, S. et al. A robust keypoint extraction and matching algorithm based on wavelet transform and information theory for point-based registration in endoscopic sinus cavity data. SIViP 10, 983–991 (2016). https://doi.org/10.1007/s11760-015-0849-2
- Endoscopic sinus images
- Repeatable and reproducible keypoints
- Modified ICP
- Gaussian weighted function