Abstract
The process of acquiring microscopic images in life sciences often results in image degradation and corruption, characterised by the presence of noise and blur, which poses significant challenges in accurately analysing and interpreting the obtained data. This paper proposes LUCYD, a novel method for the restoration of volumetric microscopy images that combines the Richardson-Lucy deconvolution formula and the fusion of deep features obtained by a fully convolutional network. By integrating the image formation process into a feature-driven restoration model, the proposed approach aims to enhance the quality of the restored images whilst reducing computational costs and maintaining a high degree of interpretability. Our results demonstrate that LUCYD outperforms the state-of-the-art methods in both synthetic and real microscopy images, achieving superior performance in terms of image quality and generalisability. We show that the model can handle various microscopy modalities and different imaging conditions by evaluating it on two different microscopy datasets, including volumetric widefield and light-sheet microscopy. Our experiments indicate that LUCYD can significantly improve resolution, contrast, and overall quality of microscopy images. Therefore, it can be a valuable tool for microscopy image restoration and can facilitate further research in various microscopy applications. We made the source code for the model accessible under https://github.com/ctom2/lucyd-deconvolution/.
Keywords
- Deconvolution
- Deblurring
- Denoising
- Microscopy
This is a preview of subscription content, access via your institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Chen, J., et al.: Three-dimensional residual channel attention networks denoise and sharpen fluorescence microscopy image volumes. Nat. Meth. 18(6), 678–687 (2021). https://doi.org/10.1038/s41592-021-01155-x
Cho, S.J., Ji, S.W., Hong, J.P., Jung, S.W., Ko, S.J.: Rethinking coarse-to-fine approach in single image deblurring. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 4641–4650 (2021)
Dell’Acqua, F., et al.: A modified damped Richardson-Lucy algorithm to reduce isotropic background effects in spherical deconvolution. Neuroimage 49(2), 1446–1458 (2010). https://doi.org/10.1016/j.neuroimage.2009.09.033
Dey, N., et al.: Richardson–Lucy algorithm with total variation regularization for 3D confocal microscope deconvolution. Microsc. Res. Tech. 69(4), 260–266 (2006). https://doi.org/10.1002/jemt.20294
Eichstädt, S., et al.: Comparison of the Richardson-Lucy method and a classical approach for spectrometer bandpass correction. Metrologia 50(2), 107 (2013)
Guo, M., et al.: Rapid image deconvolution and multiview fusion for optical microscopy. Nat. Biotechnol. 38(11), 1337–1346 (2020). https://doi.org/10.1038/s41587-020-0560-x
Kaderuppan, S.S., Wong, E.W.L., Sharma, A., Woo, W.L.: Smart Nanoscopy: a review of computational approaches to achieve super-resolved optical microscopy. IEEE Access 8, 214801–214831 (2020). https://doi.org/10.1109/ACCESS.2020.3040319
Li, Y., et al.: Incorporating the image formation process into deep learning improves network performance. Nat. Meth. 19(11), 1427–1437 (2022)
Lucy, L.B.: An iterative technique for the rectification of observed distributions. Astron. J. 79, 745 (1974). https://doi.org/10.1086/111605
Qiao, C., et al.: Evaluation and development of deep neural networks for image super-resolution in optical microscopy. Nat. Meth. 18(2), 194–202 (2021). https://doi.org/10.1038/s41592-020-01048-5
Richardson, W.H.: Bayesian-based iterative method of image restoration\(\ast \). J. Opt. Soc. Am. 62(1), 55–59 (1972)
Sage, D., et al.: DeconvolutionLab2: an open-source software for deconvolution microscopy. Methods 115, 28–41 (2017). https://doi.org/10.1016/j.ymeth.2016.12.015
Tan, K., Li, W., Zhang, Q., Huang, Y., Wu, J., Yang, J.: Penalized maximum likelihood angular super-resolution method for scanning radar forward-looking imaging. Sensors 18(3), 912 (2018). https://doi.org/10.3390/s18030912
Vizcaíno, J.P., Saltarin, F., Belyaev, Y., Lyck, R., Lasser, T., Favaro, P.: Learning to reconstruct confocal microscopy stacks from single light field images. IEEE Trans. Comput. Imaging 7, 775–788 (2021). https://doi.org/10.1109/TCI.2021.3097611
Wagner, N., et al.: Deep learning-enhanced light-field imaging with continuous validation. Nat. Meth. 18(5), 557–563 (2021). https://doi.org/10.1038/s41592-021-01136-0
Wallace, W., Schaefer, L.H., Swedlow, J.R.: A workingperson’s guide to deconvolution in light microscopy. Biotechniques 31(5), 1076–1097 (2001). https://doi.org/10.2144/01315bi01
Weigert, M., et al.: Content-aware image restoration: pushing the limits of fluorescence microscopy. Nat. Meth. 15(12), 1090–1097 (2018). https://doi.org/10.1038/s41592-018-0216-7
Wiener, N.: Extrapolation, Interpolation, and Smoothing of Stationary Time Series. The MIT Press, Cambridge (1949). https://doi.org/10.7551/mitpress/2946.001.0001
Acknowledgements
Tomáš Chobola is supported by the Helmholtz Association under the joint research school “Munich School for Data Science - MUDS”.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Chobola, T. et al. (2023). LUCYD: A Feature-Driven Richardson-Lucy Deconvolution Network. In: Greenspan, H., et al. Medical Image Computing and Computer Assisted Intervention – MICCAI 2023. MICCAI 2023. Lecture Notes in Computer Science, vol 14227. Springer, Cham. https://doi.org/10.1007/978-3-031-43993-3_63
Download citation
DOI: https://doi.org/10.1007/978-3-031-43993-3_63
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-43992-6
Online ISBN: 978-3-031-43993-3
eBook Packages: Computer ScienceComputer Science (R0)
-
Published in cooperation with
http://miccai.org/
