Abstract
It is usually desirable from a microscope imaging system to have an efficient auto-focusing and to maintain imaging quality throughout microscopy screening restricted automatically by the specimen borders. This paper presents a novel image fusion-based auto-focusing method and an automatic panorama confined with surroundings of the specimen so as to minimize the auto-scanning time for microscope imaging system. Multi-focus color image fusion is proposed to achieve the auto-focusing task for microscopic imaging. An image sequence is captured by using a microscope eyepiece camera with moving the microscope stage along Z-axis. Several images around a reference image are used to achieve in-focus image, instead of selecting a single image from the sequence. The reference image is an image given highest focus measurement value within the image sequence. Moreover, various evaluation criteria are utilized to analyze the performance of the proposed auto-focus approach on different color models for microscopic imaging. Microscope stage position along the Z-axis is automatically adjusted by image processing-based feedback system to maintain focus during scanning process. In this screening, the in-focus images with overlapped areas on the X–Y axes are stitched together to produce a mosaic image without any seams. In this process, the screening area is automatically constrained with the specimen regions which occupy 20–40 % of the glass surface. An artificial neural network-based learning algorithm is implemented to decide whether the specimen regions are within microscope objective field of view or not. The experimental studies of the proposed method were achieved on an image data set collected from the bright-field microscopy screening for Mycobacterium tuberculosis in specimen of Ziehl–Neelsen-stained sputum smears.
Similar content being viewed by others
References
Revised National Tuberculosis Control Programme: Module for Laboratory Technicians. Central TB Division, New Delphi (2005)
Santos, A., Solorzano, C.O., Vaquero, J.J., Pena, J.M., Malpica, N., Pozo, F.: Evaluation of autofocus functions in molecular cytogenetic analysis. J. Microsc. 188, 264–272 (1997)
Liu, X., Yu, M., Wang, Y., Jiang, G., Fu, S., Luo, T.: A novel time-domain focusing method for microscope imaging. Proced. Eng. 15, 2660–2664 (2011)
Hamm, P., Schulz, J., Englmeier, K.: Content-based autofocusing in automated microscopy. Image Anal. Stereol. 29, 173–180 (2010)
Chern, N.K., Neow, N.P.A., Ang, M.H.: Practical issues in pixel-based autofocusing for machine vision. In: IEEE International Conference on Robotics and Automation, Seoul, vol. 3, pp. 2791–2796 (2001)
He, J., Zhou, R., Hong, Z.: Modified fast climbing search auto-focus algorithm with adaptive step size searching technique for digital camera. IEEE Trans. Consum. Electron. 49(2), 257–262 (2003)
He, G., Li, J., Huang, X., Zou, Y.: An integrated auto-focusing system for biomedical digital microscope. In: 3rd International Conference on Biomedical and Informatics (BMEI 2010)
Chiu, L., Fuh, C.: An efficient auto focus method for digital still camera based on focus value curve prediction model. J. Inf. Sci. Eng. 26, 1261–1272 (2010)
Rahman, M.T., Kehtarnavaz, N.: Real-time face-priority auto focus for digital and cell-phone cameras. IEEE Trans. Consum. Electron. 54, 1506–1513 (2008)
Garnadia, M., Peddigari, V., Kehtarnavaz, N., Lee, S.Y., Cook, G.: Real-time implementation of autofocus on the TI DSC processor. In: Proceedings of SPIE the International Society for Optical Engineering, 5297, pp. 10–18 (2004)
Kuo, C.F.J., Chiu, C.: Improved auto-focus search algorithms for CMOS image sensing module. J. Inf. Sci. Eng. 27, 1377–1393 (2011)
Song, Y., Li, M., Sun, L.: A new auto-focusing algorithm for optical microscope based automated system. In: 9th International Conference on Control, Automation, Robotics and Vision, Singapore, pp. 1–5 (2006)
Tang, W., Liao, Y., Chen, Z., Coi, L., Yang, T., Guo, T.: Auto-focusing system for microscope based on computational verb controllers. In: 2th International Conference on Anti-counterfeiting, Security and Identification, Guiyang, pp. 84–87 (2008)
He, G., Li, J., Huang, X., Zou, Y.: An integrated auto-focusing system for biomedical digital microscope. In: 3rd International Conference on Biomedical Engineering and Informatics, Yantai, pp. 1420–1423 (2010)
Subramanyam, M.V.: Automatic image mosaic system using steerable corner detector. In: Machine Vision and Image Processing (MVIP), Taipei, pp. 14–15 (2012)
Bai, X., Ning, X., Wang, L.: Analysis and comparison of feature detection and matching algorithms for rovers vision navigation. In: 8th IEEE International Symposium Instrumentation and Control Technology, (ISICT), London, pp. 66–71 (2012)
Ali, S., Hussain, M.: Panoramic image construction using feature based registration methods. In: Multitopic Conference (INMIC), Islamabad, pp. 209–214 (2012)
Yongwei, M., Xinke, G., Xianjun, D., Jiayin, X.: A new method of microscopic images automatic mosaicing. In: 3rd International Conference Bioinformatics and Biomed, pp. 1–5 (2009)
Zhang, Y., Yang, L., Wang, Z: Research on video image stitching technology based on SURF. In: 5th International Symposium Computational Intelligence and Design, pp. 335–338 (2012)
Piccini, F., Bevilacqua, A., Lucarelli, E.: Automated image mosaics by non-automated light microscopes: the MicroMas software tool. J. Microsc. 252, 226–250 (2013)
Yang, F., Deng, Z., Fan, Q.: A method for fast automated microscope image stitching. Micron 48, 17–25 (2013)
Sahu, D.K., Parsai, M.P.: Different image fusion techniques: a critical review. Int. J. Mod. Eng. Res. 2, 4298–4301 (2012)
Bedi, S.S., Khandelwal, R.: Comprehensive and comparative study of image fusion techniques. Int. J. Soft. Comput. Eng. 3, 2231–2307 (2013)
Goshtasby, A.A.: Fusion of multifocus images to maximize image information. In: Intelligent Computing Theory and Applications, pp. 17–21 (2006)
Malviya, A., Bhirud, S.G.: Multi-focus image fusion of digital images. In: International Conference on Advance in Recent Technology in Communications and Computing, pp. 887–889 (2009)
Li, S., Yang, B., Hul, J.: Performance comparison of different multi-resolution transforms for image fusion. Inf. Fusion 12, 74–84 (2011)
Shi, H., Fang, M.: Multi-focus color image fusion based on SWT and IHS. In: Fourth International Conference on Fuzzy Systems and Knowledge Discovery, pp. 461–465 (2007)
Rattanapitak, W., Udomhunsakul, S.: Comparative efficiency of color models for multi-focus color image fusion. In: Proceedings of the International MultiConference of Engineers and Computer Scientist, 2 Hong Kong, pp. 1461–1466 (2010)
Penmetsa, K.R., Naraharsetti, V.G., Rao, N.V.: An image fusion technique for colour images using dual-tree complex wavelet transform. Int. J. Eng. Res. Technol. 1 (2012)
Li, G.: Image Fusion Based on Color Transfer Technique, Image Fusion and its Applications. Alcorn State University, USA, ISBN 978-953-307-182-4 (2011)
Kumar, S., Kumar, P., Gupta, M., Nagawat, A.K.: Performance comparison of median and Wiener filter in image de-noising. Int. J. Comput. Appl. 12, 27–31 (2010)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Dogan, H., Ekinci, M. Automatic panorama with auto-focusing based on image fusion for microscopic imaging system. SIViP 8 (Suppl 1), 5–20 (2014). https://doi.org/10.1007/s11760-014-0717-5
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11760-014-0717-5