A robust keypoint extraction and matching algorithm based on wavelet transform and information theory for point-based registration in endoscopic sinus cavity data

Abstract

Feature extraction is one of the most important steps in processing endoscopic data. The extracted features should be invariant to image scale and rotation to provide a robust matching across a substantial range of affine distortions and changes in 3D space. In this study, a method is proposed on the basis of the dual-tree complex wavelet transform. First, a map is estimated for each scale, and then a Gaussian weighted additive function (GWAF) is determined. Keypoints are selected from local peaks of GWAF. The matching and registration are performed by applying normalized mutual information and our modified iterative closest point. Results are reported in terms of robustness to rotation, noise, color, brightness, number of keypoints, index of matching and execution time for the building, standard clinical and phantom sinus datasets. Although the results are comparable to that of the speeded up robust features, scale invariant feature transform, and the Harris method, they are more robust to the variations in rotation, brightness, color, and noise than those obtained from other methods. Registration errors obtained for consequent frames for building, clinical and phantom datasets are 0.97, 1.46 and 1.1 mm, respectively.

This is a preview of subscription content, log in to check access.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20

References

  1. 1.

    Mirota, D.J., et al.: High-accuracy 3D image-based registration of endoscopic video to C-arm cone-beam CT for image-guided skull base surgery. In: Medical Imaging 2011: Visualization, Image-Guided Procedures, and Modeling, vol. 7964 (2011)

  2. 2.

    Mirota, D.J., Uneri, A., Schafer, S., Nithiananthan, S., Reh, D., Ishii, M., Gallia, G.L., Taylor, R.H., Hager, G.D., Siewerdsen, J.H.: Evaluation of a system for high-accuracy 3D image-based registration of endoscopic video to C-arm cone-beam CT for image-guided skull base surgery. IEEE Trans. Med. Imaging. 32(7), (2013)

  3. 3.

    Thormahlen, T., Broszio, H., Meier, P.N.: Three-dimensional endoscopy. In: Falk Symposium, Medical Imaging in Gastroenterology and Hepatology, 212 edn., vol. 124, pp. 199–212. Hannover (2002)

  4. 4.

    Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60(2), 91–110 (2004)

    Article  Google Scholar 

  5. 5.

    Harris, C., Stephens, M.: A combined corner and edge detector. In: Alvey Vision Conference, pp. 147–151 (1988)

  6. 6.

    Mikolajczyk, K., Schmid, C.: A performance evaluation of local descriptors. IEEE Trans. Pattern Anal. Mach. Intell. 27(10), 1615–1630 (2005)

    Article  Google Scholar 

  7. 7.

    Bay, H., Tuytelaars, T., Van Gool, L.: SURF: speeded up robust features. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) Computer Vision—ECCV 2006, pp. 404–417. Springer, Berlin (2006)

    Google Scholar 

  8. 8.

    Loupias, E. et al.: Wavelet-based salient points for image retrieval. In: IEEE International Conference on Image Processing (2000)

  9. 9.

    Neumann, J., Steidl, G.: Dual-tree complex wavelet transform in the frequency domain and an application to signal classification. Int. J. Wavelets Multiresolut Inf. Process. 3(43), (2005). doi:10.1142/S0219691305000749

  10. 10.

    Kingsbury, N.G.: Complex wavelets for shift invariant analysis and filtering of signals. J. Appl. Comput. Harmonic Anal. 10(3), 234–253 (2001)

    MathSciNet  Article  MATH  Google Scholar 

  11. 11.

    Selesnick, I.W., Baraniuk, R.G., Kingsbury, N.G.: The dual-tree complex wavelet transform. IEEE Signal Process. Mag. 22(6), 123–151 (2005)

    Article  Google Scholar 

  12. 12.

    Papademetris, X., et al.: Integrated intensity and point-feature nonrigid registration. In: Barillot, C., Haynor, D.R., Hellier, P. (eds.) MICCAI (1), pp. 763–770. Springer, Berlin (2004)

    Google Scholar 

  13. 13.

    Nabatchian, A., Abdel-Raheem, E., Ahmadi, M.: Illumination invariant feature extraction and mutual-information-based local matching for face recognition under illumination variation and occlusion. Pattern Recognit. 44(10–11), 2576–2587 (2011)

    Article  Google Scholar 

  14. 14.

    Wells III, W.M., et al.: Multi-modal volume registration by maximization of mutual information. Med. Image Anal. 1(1), 35–51 (1996)

    Article  Google Scholar 

  15. 15.

    Maes, F., et al.: Multimodality image registration by maximization of mutual information. IEEE Trans. Med. Imaging 16(2), 187–198 (1997)

    Article  Google Scholar 

  16. 16.

    Estevez, P.A., et al.: Normalized mutual information feature selection. IEEE Trans. Neural Netw. 20(2), 189–201 (2009)

    Article  Google Scholar 

  17. 17.

    Besl, P.J., McKay, N.D.: A method for registration of 3-D shapes. IEEE Trans. Pattern Anal. Mach. Intell. 14(2), 239–256 (1992)

    Article  Google Scholar 

  18. 18.

    Rusinkiewicz, S., Levoy, M.: Efficient variants of the ICP algorithm. In: 3-D Digital Imaging and Modeling. Quebec City, QC (2001)

  19. 19.

    Nazem, F., et al.: Two-stage point-based registration method between ultrasound and CT imaging of the liver based on ICP and unscented Kalman filter: a phantom study. Int. J. Comput. Assist. Radiol. Surg. 9(1), 39–48 (2014)

    Article  Google Scholar 

  20. 20.

    Ahmadian, A., et al.: An efficient method for estimation of soft tissue deformation based on intra-operative stereo image features and point-based registration. Int. J. Imaging Syst. Technol. 23(4), 294–303 (2013)

    MathSciNet  Article  Google Scholar 

  21. 21.

    Bendale, P., Triggs, B., Kingsbury, N.: Multiscale keypoint analysis based on complex wavelets. In: Proceedings of the British Machine Vision Conference. BMVA Press (2010)

  22. 22.

    Fauqueur, J., Kingsbury, N., Anderson, R.: Multiscale keypoint detection using the dual-tree complex wavelet transform. In: International Conference Image Processing (2006)

  23. 23.

    Studholme, C., Hill, D.L.G., Hawkes, D.J.: An overlap invariant entropy measure of 3D medical image alignment. Pattern Recognit. 32(1), 71–86 (1999)

    Article  Google Scholar 

  24. 24.

    Abretske, D., et al.: Intelligent frame selection for anatomic reconstruction from endoscopic video. In: WACV, pp. 1–5. IEEE Computer Society (2009)

  25. 25.

    Serej, N.D., Ahmadian, A., Mohagheghi, S., Sadrehosseini, S.M.: A projected landmark method for reduction of registration error in image-guided surgery systems. Int. J. Comput. Assist. Radiol. Surg. 10(5), 541–554 (2015)

  26. 26.

    Kovesi, P.: http://www.csse.uwa.edu.au/~pk/research/matlabfns/

  27. 27.

    Kroon, D.: http://www.mathworks.com/matlabcentral/fileexchange/28300-opensurf-including-image-warp/

  28. 28.

    Lowe, D.: http://www.cs.ubc.ca/spider/lowe/keypoints/siftDemoV4.zip

Download references

Acknowledgments

This research has been supported by Tehran University of Medical Sciences & health Services grant 90-04-30-15836. Also, the authors would like to thank Research Center for Biomedical Technology & Robotics, RCBTR for supporting and providing an environment to carry on this project.

Author information

Affiliations

Authors

Corresponding author

Correspondence to Alireza Ahmadian.

Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary material 1 (docx 677 KB)

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Serej, N.D., Ahmadian, A., Kasaei, S. et al. A robust keypoint extraction and matching algorithm based on wavelet transform and information theory for point-based registration in endoscopic sinus cavity data. SIViP 10, 983–991 (2016). https://doi.org/10.1007/s11760-015-0849-2

Download citation

Keywords

  • Endoscopic sinus images
  • Repeatable and reproducible keypoints
  • DTCWT
  • NMI
  • Modified ICP
  • Gaussian weighted function