Abstract
In this study, a novel adaptive wavefront correction (AWC) technique is implemented on a compactly developed structured illumination holographic tomography (SI-HT) system. We propose a mechanical movement-free compact scanning architecture for SI-HT systems with AWC, implemented by designing and displaying a series of computer-generated holograms (CGH) composed of blazed grating with phase Fresnel lens on a phase-only spatial light modulator (SLM). In the proposed SI-HT, the aberrations of the optical system are sensed by digital holography and are used to design the CGH-based AWC to compensate the phase aberrations of the tomographic imaging system. The proposed method was validated using a standard Siemens star target, its potential application was demonstrated using a live candida rugosa sample, and its label-free three-dimensional refractive index profile was generated at its subcellular level. The experimental results obtained reveal the ability of the proposed method to enhance the imaging performance in both lateral and axial directions.
Similar content being viewed by others
Introduction
Structured illumination microscopy (SIM) is a popular optical imaging technique used to achieve high resolution1,2,3,4,5,6, and recent studies have demonstrated its ability to achieve resolution-enhanced imaging of biological specimens7,8,9,10,11,12,13. In structured illumination (SI) techniques, SI patterns are generated through different methods using either coherent10,11,12,13,14,15,16,17,18,19,20 or incoherent sources21, and low-resolution moiré beat patterns are detected from the convolved signals of SI patterns with the high-frequency components of the sample. In general, SI uses a phase-shifting method to separate overlapped spatial frequencies using singular value decomposition (SVD) and a pseudoinverse approach15,22. The separated high spatial frequencies are corrected and synthesized, thus providing resolution-enhanced imaging15,19. In recent years, the SI method has been used as a substitute for the synthetic aperture (SA) method in digital holographic microscopy (DHM)23 to generate quantitative phase image and refractive index (RI) profiles of biological samples24,25,26,27,28,29. Furthermore, in DHM, wavefront aberrations induced from the illumination and detection process in the optical system can suppress the spatial resolution as well as the reconstructed image quality. Several numerical compensation and adaptive methods are available to correct aberrations during the post-image reconstruction process30,31,32,33,34. In DHM, a conventional adaptive optical element, such as a deformable mirror device (DM), is used for phase aberration correction, but the DM control relies on mechanical control with complex tuning procedures35,36,37. Another active element that may possibly be used for phase aberration correction is a spatial light modulator (SLM), which can also be used for aberration compensation38,39. Several theoretical studies have been conducted using conventional SI to study aberration formations and the implications of conventional SI systems, and these studies have proposed several correction methods based on DM or numerical-compensation methods35,36,37,40,41. To date, no other study has examined the implementation of compact mechanical movement-free holographic approaches for AWC in SI system; to our knowledge, this study is the first to develop such a SI holographic imaging system. The proposed AWC technique is implemented on a compactly developed mechanical movement-free scanning structured illumination holographic tomography (SI-HT) system. The SI-HT system subsequently developed has several advantages: First, compact mechanical movement-free SI scanning is achieved by designing and displaying the CGHs composed of blazed grating and a phase Fresnel lens onto the phase-only SLM. Second, a feedback process is integrated with digital holography to sense the phase aberrations of the tomographic imaging system; the same is used to compensate the phase aberrations using mechanical movement-free CGH-based AWC techniques to enhance tomographic imaging performance in lateral as well as axial directions. Furthermore, the phase error induced by the variation and misalignment of the imaging system or environment can be sensed and compensated using AWC techniques to promote the long-term stability during measurements. The proposed AWC-SI-HT system performance is evaluated using a standard Siemens star target. The prospective biological application is demonstrated using a live candida rugosa as a sample, and its label-free three-dimensional RI profile is generated at the subcellular level.
Working Principle
The principle operation of the CGH-based AWC technique implemented on a compactly developed SI-HT system using a phase-only SLM is shown in Fig. 1(a). The operation of the system involves four major steps. First, CGH design for the compact scanning; second, wavefront aberration sensing; third, adaptive CGH design for AWC, and the final step involves the AWC calibrated SI-HT measurements and its image reconstructions.
(a) Conceptual representation of AWC SI holographic tomography. (1) CGHs are displayed in phase-only SLM to execute SI scanning, and the corresponding SI holograms are recorded using an image sensor; (2) from the recorded holograms, the overlapped pass bands are separated, and the corresponding phase aberrations are estimated for all scanning angles; (3) new sequences of SI scanning CGHs are generated by mapping the collected aberration with a Zernike polynomial aberration model; and (4) holograms are recorded after aberration compensation and are used for further tomographic reconstruction. SLM (spatial light modulator), MO (microscope objective), and D1 and D2 are the passbands. (b) SLM based AWC SI-HT system, and (c) Spatial frequency coverages: single SI (upper); sequence of SI (lower).
In the first step, the key element to be considered for the CGH design is SLM. The main function of the phase-only SLM involves the development of the compact mechanical movement-free AWC SI-HT system. The conventional optical lens after the scanning element in the conventional SI system is replaced by the phase Fresnel lens as a CGH displayed on the SLM. The phase function of Fresnel lens can be expressed as, \({{\rm{\Phi }}}_{{\rm{FZL}}}(x,y)=\frac{\pi }{\lambda f}({x}^{2}+{y}^{2})\), where λ is the wavelength of the source, x and y are the spatial coordinates, and f is the focal length of the phase Fresnel lens. A compact mechanical movement-free scanning architecture are achieved by combining the binary blazed phase grating, \({{\Phi }}_{blazed}(x,y)=\frac{2\pi }{\wedge }(x+y)\) with phase Fresnel lens, and by rotating the grating period (Λ) the position of the probe beam are controlled in (x, y) directions42. The phase-only SLM are modulated by the phase functions Φ1and Φ2 to create SI as shown in Fig. 1(b). The expressions for Φ1and Φ2 are given as,
and
Then the developed CGHs are displayed on the phase-only SLM to achieve mechanical movement-free compact SI scanning, and the corresponding SI holograms are recorded using an image sensor. The frequency coverage corresponds to single SI and sequential SI imaging are shown in Fig. 1(d).
The second step involves the extraction of the phase aberrations from the recorded SI holograms. The wavefront distribution of the imaging system can be expressed as, \(P(x,y)=\exp (j\frac{2\pi }{\lambda }{P}_{abr}(x,y))\), where Pabr is the phase aberration of the imaging system. The resultant wavefront (RSI (x, y)) of the object excited with an SI pattern can be expressed as
The corresponding SI spectrum in the frequency domain (\({\tilde{R}}_{SI}(u,v)\)) can be expressed as
The symbols Sobj (u, v), I (u, v) and CTF (u, v) are the Fourier transforms of Sobj (u, v), I (u, v) and P (x, y), respectively. The illumination pattern is carefully controlled by Φ1 and Φ2. Accordingly, the SI wavefront spectrum (OSI (u, v)) of the two overlapped passbands can be expressed as18.
The passbands corresponding to the SI illuminations are
and
The symbols Ai and Ad are the transfer functions corresponding to the illumination and detection 4F systems of the object illumination18 as shown in Fig. 1(a), \({P^{\prime} }_{abr}^{1}\,\)and \(\,{P^{\prime} }_{abr}^{2}\) are the recorded aberrations, and the cut-off frequency, \({f}_{x,y}=\,\sin \,{\theta }_{x,y}/\lambda \), θx,y is the diffracted angle along x and y axes.
By subsequently solving the SVD and pseudoinverse approach the overlapped passbands are separated15,19. From the separated passbands, the phase aberrations, \({P}_{abr}^{1}(x,y)\) and \({P}_{abr}^{2}(x,y)\) are estimated iteratively for AWC. The third step in the operation of the system involves the CGH design for AWC. From the aberrations obtained, the corresponding compensation model is estimated at the conjugate image plane using a Zernike polynomial aberration model38,43,44, \({\tilde{P}}_{abr}={e}^{-j\frac{2\pi }{\lambda }(\sum _{p=0}^{q}{z}_{p})}\), where p is the polynomial order and zp is the corresponding Zernike mode. Therefore, the estimated wavefront aberration Pabr (x, y) is numerically diffracted to the conjugate image plane and combined with Φ1 and Φ2 to develop CGH-based adaptive aberration-compensated imaging as shown in Fig. 1(a)38.
Finally, step 4 consists of recording the SI holograms using the AWC CGHs designed in step 3. From the recorded holograms, as explained in the second step, the overlapped passbands are separated and synthesized to obtain an enlarged spatial frequency coverage. Thus, the resulting spatial frequency coverage (\({R}_{o}(\zeta ,\eta )\)) of the SI-HT system can be expressed as18
where, the symbol m, n denotes the number of passbands, and the symbol M, N denotes the number of hologram acquisitions. The calibrated measurement procedures of AWC SI-HT system showing each steps with its corresponding experimental results are described in Fig. 2.
Experiments and Results
The CGH-based AWC SI-HT experimental setup follows a vertical type of modified off-axis Mach-Zehnder interferometric architecture. This configuration is more suitable for live sample measurement. A spatially filtered and collimated beam from a diode-pumped solid state laser (DPSS) emitting at 532 nm is used as a source and split by a beam splitter (BS) as a probe beam and a reference beam, as shown in Fig. 3. The phase-only SLM (Jasper Display corp., pixel number: 1920 × 1080, pixel size: 6.4 µm × 6.4 µm) is used to display the designed phase CGHs. The blazed grating profile is optimized in the CGH design and aligned the probe beam in order to avoid the zero order diffraction from the SLM.
The probe beam hits the phase-only SLM and reflects it back to create an SI pattern after the objective MO1 (NA = 0.9, 100x), and the beam passes through the sample. The wavefield with sample information is allowed to enter the detection 4F system (MO2: NA = 0.9, 100x, L1: 250 mm) and interfere with the reference beam. The background SI holograms with phase shifts corresponding to 0° and 120° are scanned along the circular directions, and the SI holograms are recorded using a complementary metal-oxide-semiconductor (CMOS) image sensor. The SI holograms and its frequency spectrums corresponding to the phase shifts of 0° and 120° are shown in Fig. 4(a,b), respectively. The separated passbands and corresponding phase aberrations are shown in Fig. 4(c,d) respectively. By then mapping back the estimated aberration using a Zernike polynomial model to iteratively generate a new CGH which is displayed on the SLM for AWC. The reconstructed phase profile after AWC are shown in Fig. 4(e), which shows that the proposed method can work well for the aberration correction. The quantitative amplitude validation of the proposed method is conducted using a standard Siemens star target as a test object which has a minimal line width of 150 nm (300 nm/pair). The experimental results are compared in Fig. 5. Different segments of target objects are marked from S1 to S8.
(a) Raw hologram corresponds to the phase shift of 0° and 120°, inset region shows Moire beat pattern. (b) First order frequency spectrum of (a) shows the overlapped frequencies. (c) Separated frequencies using singular value decomposition and pseudoinverse approach. Reconstructed phase: (d) before AWC and (e) after AWC.
Figure 5(a) illustrates the normal aperture condition with an AWC scheme; for this case, the theoretical resolution at 532 nm can resolve only up to 455 nm, so high-frequency information cannot be resolved here. The SI scanning is performed in circular directions. The results without AWC and with AWC are compared in Fig. 5(b,c) respectively. Figure 5(b) shows that it can resolve only up to 230 nm, but our proposed AWC method can resolve high-frequency components of size 150 nm, as shown in Fig. 5(c). The cross-sectional profiles are compared in Fig. 5(d). The σ in Fig. 5(d) shows the resolvable resolution of the SI-HT system with AWC. We used 60 pairs of SI holograms (equivalent to 120 passbands) to achieve circular scanning within the numerical aperture of the objective lens. To achieve faster data acquisition, a LabVIEW-based software controller was developed to synchronize SLM and the image sensor, achieved a data acquisition time of less than 4 seconds.
For label-free RI tomographic image analysis, live candida rugosa (ATCC 14830) is used as a sample and is loaded into the microchannel (µ-Slide I0.4 Luer from ibidi) for the AWC SI-HT measurement procedures. The tomographic images are reconstructed45,46, and the different slices correspond to xy and xz directions, as elucidated in Fig. 6. Herein, the aberration data suffers to generate the cell structures; the cell wall and the inner organelles are not clearly visible, as illustrated in Fig. 6(a). Numerical aberration corrections were undertaken for the SI data, and the reconstructed results are shown in Fig. 6(b). It can resolve the cell wall and the inner structures but is still suffers to generate a high-quality sample profile compared with the proposed AWC technique shown in Fig. 6(c). After AWC was implemented, the cell structures and the cell’s inner organelles were observed clearly in xy and xz slices. The inset images are shown for all three cases in Fig. 6. This result demonstrates the ability of the proposed AWC to generate a high-quality sample profile in both lateral and axial directions and proves the potential applications for label-free imaging. Different 3D views are generated using the proposed AWC SI-HT approach. Based on the RI distribution the subcellular structures28,45,46,47,48,49, such as the cytoplasm, mitochondria distribution, and nuclei are clearly visible, as shown in Fig. 6(d). We posit that the proposed method could be used as a tool for generating a label-free 3D RI profile of a live sample.
Reconstructed SI-HT slices, in xy and xz directions, of a live candida rugosa sample. Different comparisons are made between cases (a) with aberration, (b) with numerical aberration correction, and (c) with adaptive wavefront correction (AWC). The inset figures (a,b) illustrate the reconstructed cell quality for the comparisons, which shows that the AWC technique can achieve superior reconstruction performance; and (d) different 3D views correspond to 5(c), illustrating the subcellular structures of live candida rugosa. Arrow indications: red for the cell wall, green for mitochondria distribution, yellow for cytoplasm and purple for the nucleus. Scale bar: 2 µm. The color bar represents the quantitative RI values varies from 1.34 to 1.42.
Conclusions
In summary, a novel CGH-based AWC technique was successfully demonstrated in the compactly developed mechanical-free scanning SI-HT system. The feasibility and the performance of the proposed method were studied in detail with a standard Siemens star target; the method was proven to resolve up to 150 nm, corresponding to a wavelength of 532 nm. Moreover, the method is not limited to the standard static targets but also demonstrated potential applications in label-free tomographic generation at subcellular levels using live candida rugosa samples (ATCC 14830). Therefore, it is expected that the proposed AWC SI-HT will be of use to the biomedical research community for the undertaking of further label-free quantitative analysis of native biological specimens at subcellular levels.
References
Gustafsson, M. G. L., Agard, D. A. & Sedat, J. W. Sevenfold improvement of axial resolution in 3D wide-field microscopy using two objective lenses, Proc. SPIE, 2412 (1995).
Gustafsson, M. G. L. Surpassing the lateral resolution limit by a factor of two using structured illumination microscopy. J. Microscopy. 198, 82–87 (2000).
Karadaglic, D. & Wilson, T. Image formation in structured illumination wide-field fluorescence microscopy. Micron. 39, 808–818 (2008).
Wei, F. & Liu, Z. Plasmonic structured Illumination microscopy. Nano Lett. 10, 2531–2536 (2010).
Saxena, M., Eluru, G. & Gorthi, S. S. Structured illumination microscopy. Adv. Opt. Photon. 7, 241–275 (2015).
Heintzmann, R. & Huser, T. Super-Resolution Structured Illumination Microscopy. Chem. Rev. 117, 13890–13908 (2017).
Hirvonen, L. M., Wicker, K., Mandula, O. & Heintzmann, R. Structured illumination microscopy of a living cell. Eur. Biophy. J. 38, 807–812 (2009).
Langhorst, M. F., Schaffer, J. & Goetze, B. Structure brings clarity: Structured illumination microscopy in cell biology. Biotech. J. 4, 858–865 (2009).
Kner, P., Chhun, B. B., Griffis, E. R., Winoto, L. & Gustafsson, M. G. L. Super-Resolution Video Microscopy of Live Cells by Structured Illumination. Nat. Methods. 6, 339–342 (2009).
Demmerle, J. et al. Strategic and practical guidelines for successful structured illumination microscopy. Nat Protoc. 12, 988–1010 (2017).
Chowdhury, S., Eldridge, W. J., Wax, A. & Izatt, J. A. Structured illumination multimodal 3D-resolved quantitative phase and fluorescence sub-diffraction microscopy. Biomed Opt. Exp. 8, 2496–2518 (2017).
Kraus, F. et al. Quantitative 3D Structured Illumination Microscopy of Nuclear Structures. Nat. Protoc. 12, 1011–1028 (2017).
Shin, S., Kim, D., Kim, K. & Park, Y. Super-resolution three-dimensional fluorescence and optical diffraction tomography of live cells using structured illumination generated by a digital micromirror device. Sci. Rep. 8, 9183 (2018).
Chang, B.-J., Chou, L.-J., Chang, Y.-C. & Chiang, S.-Y. Isotropic image in structured illumination microscopy patterned with a spatial light modulator. Opt. Exp. 17, 14710–14721 (2009).
Shroff, S. A., Fienup, J. R. & Williams, D. R. Phase-shift estimation in sinusoidally illuminated images for lateral superresolution. J. Opt. Soc. Am. 26, 413–424 (2009).
Ortiga, E. S., Corral, M. M., Saavedra, G. & Sucerquia, J. G. Enhancing spatial resolution in digital holographic microscopy by biprism structured illumination. Opt. Lett. 39, 2086–2089 (2014).
Halpern, A. R., Alas, G. C. M., Chozinski, T. J., Paredez, A. R. & Vaughan, J. C. Hybrid Structured Illumination Expansion Microscopy Reveals Microbial Cytoskeleton Organization. ACS Nano. 11, 12677–12686 (2017).
Lai, X.-J., Tu, H.-Y., Lin, Y.-C. & Cheng, C.-J. Coded aperture structured illumination digital holographic microscopy for superresolution imaging. Opt. Lett. 43, 1143–1146 (2018).
Lee, K., Kim, K., Kim, G., Shin, S. & Park, Y. Time-multiplexed structured illumination using a DMD for optical diffraction tomography. Opt. Lett. 42, 999–1002 (2017).
Hussain, A., Martínez, J. L. & Campos, J. Holographic superresolution using spatial light modulator. J Eur Opt Soc Rapid Publ. 8, 1990–2573 (2013).
Kashter, Y. K., Vijayakumar, A., Miyamoto, Y. & Rosen, J. Enhanced super resolution using Fresnel incoherent correlation holography with structured illumination. Opt. Lett. 41, 1558–1561 (2016).
Bailey, B., Krishnamurthi, V., Farkas, D. L., Taylor, D. L. & Lanni., F. Three-dimensional imaging of biological specimens with standing wave fluorescence microscopy. Proc. SPIE. 2184, 208–213 (1994).
Poon, T. C. & Liu, J. P. Introduction to Modern Digital Holography with MATLAB, (Cambridge University Press, 2014).
Kim, M. K. Tomographic three-dimensional imaging of a biological specimen using wavelength-scanning digital interference holography. Opt. Exp. 7, 305–310 (2000).
Ferraro, P., Wax, A. & Zalevsky, Z. Coherent Light Microscopy: Imaging and Quantitative Phase Analysis (Springer, 2011).
Cotte, Y. et al. Marker-free phase nanoscopy. Nat. Photonics. 7, 113–117 (2013).
Luo, W., Greenbaum, A., Zhang, Y. & Ozcan, A. Synthetic aperture-based on-chip microscopy. Light Sci. Appl. 4, e261 (2015).
Liu, P. Y. et al. Cell refractive index for cell biology and disease diagnosis: past, present and future. Lab Chip 16, 634–644 (2016).
Lai, X.-J., Cheng, C.-J., Lin, Y.-C. & Tu, H.-Y. Angular-polarization multiplexing with spatial light modulators for resolution enhancement in digital holographic microscopy. J. Opt 19, 055607 (2017).
Stadelmaier, A. & Massig, J. H. Compensation of lens aberrations in digital holography. Opt. Lett 25, 1630–1632 (2000).
Colomb, T. et al. Total aberrations compensation in digital holographic microscopy with a reference conjugated hologram. Opt. Exp 14, 4300–4306 (2006).
Montfort, F. et al. Purely numerical compensation for microscope objective phase curvature in digital holographic microscopy: influence of digital phase mask position. J. Opt. Soc. Am 23, 2944–2953 (2006).
Nguyen, T. et al. Automatic phase aberration compensation for digital holographic microscopy based on deep learning background detection. Opt. Exp 25, 15043–15057 (2017).
Deng, D. N. et al. Simple and flexible phase compensation for digital holographic microscopy with electrically tunable lens. Appl. Opt 56, 6007–6014 (2017).
Schaefer, L. H., Schuster, D. & Schaffer, J. Structured illumination microscopy: artefact analysis and reduction utilizing a parameter optimization approach. J. Microsc 216, 165–174 (2004).
Booth., M. J. Adaptive optics in microscopy. Phil. Trans. R. Soc. A 365, 2829–2843 (2007).
Debarre, D., Botcherby, E. J., Booth, M. J. & Wilson, T. Adaptive optics for structured illumination microscopy. Opt. Exp 16, 9290–9305 (2008).
Kus, A., Krauze, W. & Kujawińska, M. Active limited-angle tomographic phase microscope. J. Biomed. Opt 20, 111216 (2015).
Ji, N., Milkie, D. E. & Betzig, E. Adaptive optics via pupil segmentation for high-resolution imaging in biological tissues. Nat. Methods 7, 141–147 (2010).
Booth., M. J. Adaptive optical microscopy: the ongoing quest for a perfect image. LSA. 3, e165 (2014).
Booth, M. et al. Aberrations and adaptive optics in super-resolution microscopy. Microscopy 64, 251–261 (2015).
Pospiech, M., Emons, M., Vackenstedt, B., Palmer, G. & Morgner, U. Single-sweep laser writing of 3D-waveguide devices. Opt. Exp 18, 6994–7001 (2010).
Noll, R. J. Zernike polynomials and atmospheric turbulence. J. Opt. Soc. Am 66, 207–211 (1976).
Neil, M. A. A., Booth, M. J. & Wilson, T. New modal wavefront sensor: a theoretical analysis. J. Opt. Soc. Am 17, 1098–1107 (2000).
Lin, Y.-C., Chen, H.-C., Tu, H.-Y., Liu, C.-Y. & Cheng, C.-J. Optically driven full-angle sample rotation for tomographic imaging in digital holographic microscopy. Opt. Lett 42, 1321–1324 (2017).
Vinoth, B., Lai, X.-J., Lin, Y.-C., Tu, H.-Y. & Cheng, C.-J. Integrated dual-tomography for refractive index analysis of free-floating single living cell with isotropic superresolution. Sci. Rep 8, 5943 (2018).
Beauvoit, B. et al. Characterization of absorption and scattering properties of various yeast strains by time-resolved spectroscopy. Cell Biophys 23, 91 (1993).
Habaza, M., Gilboa, B., Roichman, Y. & Shaked, N. T. Tomographic phase microscopy with 180° rotation of live cells in suspension by holographic optical tweezers. Opt. Lett 40, 1881–1884 (2015).
Keisuke, H. et al. Significant correlation between refractive index and activity of mitochondria: single mitochondrion study. Biomed. Opt. Exp 6, 859–869 (2015).
Acknowledgements
We thank Guan-Chiun Lee for the technical assistance. The work was supported by the Ministry of Science and Technology, Taiwan (MOST).
Author information
Authors and Affiliations
Contributions
C.-J.C. and H.-Y.T. carried out the theoretical analysis and supervised the project. V.B. and X.-J.L. carried out the C.G.H. design, experiments and tomography reconstructions. All authors discussed the results and contributed to the manuscript.
Corresponding author
Ethics declarations
Competing Interests
The authors declare no competing interests.
Additional information
Publisher’s note: Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Balasubramani, V., Tu, HY., Lai, XJ. et al. Adaptive wavefront correction structured illumination holographic tomography. Sci Rep 9, 10489 (2019). https://doi.org/10.1038/s41598-019-46951-w
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41598-019-46951-w
- Springer Nature Limited
This article is cited by
-
Quantitative phase imaging based on holography: trends and new perspectives
Light: Science & Applications (2024)
-
Compensation of aberrations in holographic microscopes: main strategies and applications
Applied Physics B (2022)