Abstract
Computer-generated holograms are crucial for a wide range of applications such as 3D displays, information encryption, data storage, and opto-electronic computing. Orbital angular momentum (OAM), as a new degree of freedom with infinite orthogonal states, has been employed to expand the hologram bandwidth. However, in order to reduce strong multiplexing crosstalk, OAM holography suffers from a fundamental sampling criterion that the image sampling distance should be no less than the diameter of largest addressable OAM mode, which severely hinders the increase in resolution and capacity. Here we establish a comprehensive model on multiplexing crosstalk in OAM holography, propose a pseudo incoherent approach that is almost crosstalk-free, and demonstrate an analogous coherent solution by temporal multiplexing, which dramatically eliminates the crosstalk and largely relaxes the constraint upon sampling condition of OAM holography, exhibiting a remarkable resolution enhancement by several times, far beyond the conventional resolution limit of OAM holography, as well as a large scaling of OAM multiplexing capacity at fixed resolution. Our method enables OAM-multiplexed holographic reconstruction with high quality, high resolution, and high capacity, offering an efficient and practical route towards the future high-performance holographic systems.
Similar content being viewed by others
Introduction
Computer-generated holograms (CGHs) have received increasing attention in recent years because of its flexibility in manipulating optical wavefronts. Nowadays CGHs have been used in many applications, such as optoelectronic computing1,2, three-dimensional displays3,4,5,6,7,8,9, beam shaping10,11,12, and optical encryption13,14,15. Holographic multiplexing is an efficient solution to overcome the difficulty of generating CGHs in real-time, employing multiple physical degrees of freedom (DoFs) such as polarization16,17,18, wavelength, and incident angles19,20,21, but these DoFs have quite limited bandwidth. As a new DoF of multiplexing, the orbital angular momentum (OAM) of an optical vortex beam is very promising because of its theoretically unbounded orthogonal modes22,23,24,25. Recently, OAM holography was proposed, which offers the possibility to improve the bandwidth of multiplexed holography, and has been implemented on various platforms, including phase-only spatial light modulator (SLM)26, phase-only metasurface27, and complex-amplitude metasurface28.
In OAM holography, each pixel of the image retains the properties of the incident OAM beam by discretely sampling the target image in the Fourier plane of the holographic system; thus, a set of OAMs of incident beams can be employed as information carriers26, which however inevitably causes the resolution degradation with respect to the original image (Fig. 1a). Specifically, the ratio of the diameter of largest addressable OAM mode (dmax, denoting the OAM-multiplexing capacity) to the sampling distance (L, indicating the image resolution of OAM holography), γ = dmax/L, is a core factor termed as the sampling condition. It is greatly desirable to enlarge the value of γ as much as possible for OAM holography, since it corresponds to higher resolution with a certain number of OAM channels, or equivalently higher capacity at a certain resolution (Fig. 1b, see also Supplementary Note 1 for the calculation method of resolution).
a Schematic illustration of varied degrees of resolution degradation by sparse and dense discrete samplings in OAM holography. b Advantage of enlarging the sampling condition γ beyond unity in obtaining higher resolution (super-resolution) and higher capacity of OAM holography. c Schematic illustration of TMBH setup based on DMD. d Reconstructed super-resolution frames of the holographic video by the TMBH method, with sampling condition of γ = 4.7 and multiplexing channel number of K = 201. e Evolution of reconstructed image quality of TMBH and CAH methods based on the averaging results of initial 21 frames, evaluated by the metrics of SSIM and CV, versus the growing multiplexing channels. The empty box in the reconstructed frame marks the area where the CV is calculated for all frames. f Reconstructed frames by the CAH method at γ = 1 (corresponding to the conventional resolution limit at 201 multiplexing channels) and γ = 1.5.
However, for the general coherent OAM holography as previously reported, OAM property cannot be preserved in densely sampled high-resolution images due to interference, thereby imposing a fundamental resolution limit for a given OAM channel number by demanding γ ≤ 126,27,28, which severely suppresses the potentials of OAM holographic multiplexing towards high resolution and high capacity. Moreover, even under the operating condition of γ ≤ 1, OAM-multiplexing holography is not immune to multiplexing crosstalk during the image reconstruction, and in particular, OAM beams with a small helical mode index interval (Δl ~1) suffer from strong multiplexing crosstalk29. Due to these main bottlenecks, previous demonstrations of OAM holography usually set Δl above 2, sacrificing the multiplexing capacity, and the images reconstructed in experiments were mostly limited to low-resolution ones such as simple icons and basic geometric shapes26,27,28,30,31,32,33. Even though a recent approach of complex-amplitude OAM holography (CAH) based on metasurface28 reduced the multiplexing crosstalk to some degree, it was still clamped by γ ≤ 1.
In this work, we break the resolution barrier (L = dmax) of OAM holography imposed by the sampling criterion of γ ≤ 1, for the first time to the best of our knowledge. We realize high-quality reconstruction of OAM holography at γ far beyond 1, which signifies a much smaller sampling distance L < dmax compared with the previous approach using the same set of OAM-multiplexing channels (same dmax), i.e., achieving the super-resolution OAM holography. Equivalently, OAM-multiplexing capacity can be remarkably boosted (larger dmax) while maintaining the resolution (same L). It should be emphasized that the super-resolution concept in this work applies only to OAM holography that the case of γ = 1 represents the OAM holography at the resolution limit, and the cases of γ > 1 represent the super-resolution OAM holography. Comparison between the resolution limit in OAM holography and that in a conventional optical system is illustrated in Supplementary Note 1.
Specifically, we establish a comprehensive model on multiplexing crosstalk from two types of interference in OAM holography, and propose a pseudo incoherent case that is almost crosstalk-free for varying γ. Then we approximate the pseudo incoherent case in an alternative but realistic approach, by temporal multiplexing of coherent light, dramatically eliminating the multiplexing crosstalk and successfully obtaining high-quality super-resolution performance (Fig. 1d, e), where the image quality is assessed by the metrics of coefficient of variation (CV, see Methods) and structural similarity index measure (SSIM, see Methods). The temporal multiplexing binary OAM holography (TMBH) proposed in this work enables the OAM-addressed 201-frame video display (with a grayscale of 256) at a super-resolution of 200 × 200 pixels in one frame (see Fig. 1 and Supplementary Movie 1), largely enhancing the reconstructed resolution by a factor of 4.7, compared with the resolution limit of previous state-of-the-art coherent OAM holography26,27,28. In addition, we demonstrate the high-quality super-resolution reconstruction of binary images, with the resolution enhancement by a factor of 9.2. The approach proposed enables OAM-multiplexed holographic reconstruction with high quality, high resolution, and high capacity.
Results
Spatial frequency distributions in coherent and incoherent OAM holography
For the general coherent case (Fig. 2a) that uses a coherent illumination source, the constituent spatial frequencies (kg in the momentum space) of an OAM-conserving hologram add a linear spatial frequency shift to an incident OAM beam (kin)26,27. Considering a hologram that multiplexes two OAM channels as an example, a sparse sampling (γ = 0.56) can retain the OAM property of the incident beam (as denoted in the enlarged area i), however a denser sampling with γ = 1.75, which exceeds the sampling criterion limit, causes a complete loss of OAM property due to interference (see the enlarged area j), the reason of which will be studied in next subsection. On the other hand, for the general incoherent case (Fig. 2b) that uses an incoherent illumination source, the spatial frequencies of different incoherent wavefronts have deviated outgoing directions according to the Bragg diffraction formula, which brings serious undesired blurring to the reconstructed image (see the enlarged area of l).
Here we purpose a pseudo incoherent case (Fig. 2c), where, unlike the general incoherent case, we assume the outgoing wave vectors that leave the hologram coincide perfectly for all incoherent incident vectors (k1 to kn), so that individual diffraction patterns can be superposed in an intensity manner (see the enlarged area of n), without introducing blurring at all. However, this case is practically challenging to realize due to the violation of the Bragg diffraction formula; thus, a coherent analogy to that is alternatively carried out in this work, by temporal multiplexing of a coherent beam, thereby suppressing the coherence. It is shown in Fig. 2d that temporal multiplexing introduces time-varying phase delays to the incident vector, thereby creating multiple incoherent wavefronts within each modulating duration (see also Supplementary Note 2), which is akin to inherent multiple wavefronts in the pseudo incoherent case, and consequently enables high reconstruction quality at super-resolution condition as well (see the enlarged area of p).
Two types of interference in OAM holography
The reconstructed image of OAM holography is composed of a series of discrete pixels, and each pixel location contains one or more OAM modes. Before examining the multiplexing crosstalk and sampling criterion limit of coherent OAM holography, we present that there exist two types of interference for each pixel of the reconstructed image: (1) interference between different OAM channels at the same pixel (see Supplementary Note 3), termed as same pixel interference (SPI); (2) interference between OAM modes in adjacent pixels, termed as adjacent pixel interference (API), referring to the effect that OAM modes at adjacent pixels have interference and destroy the structure of a reconstructed image, when the distance between the discrete pixels is smaller than the diameter of OAM modes. We clarify in the following that SPI mainly arises from a small index interval (especially when Δl = 1), while the degree of API is influenced by both γ and lmax, the latter being the largest addressable OAM index.
Firstly, we consider the scenario of γ < <1, in which API is negligible since the OAM channels from adjacent pixels in the reconstructed image do not overlap with each other; hence only SPI may take effect. SPI is manifested by an instance shown in Fig. 3, where five sparsely sampled images of alphabet letters are encoded into a complex-amplitude OAM-multiplexed hologram (with helical mode indexes of l = 0, −1, −2, −3, −4) and the target images have a sampling interval of L = 30 λ/NA, corresponding to γ = 0.4, where λ and NA are the wavelength and numerical aperture of the holographic system respectively (see also Supplementary Note 1). When an OAM beam with l = 1 is incident on the hologram, five images carried by different OAM channels are displayed simultaneously on the image plane (Fig. 3a). For the coherent illumination case, these images are coherently superposed (top right corner of Fig. 3a); thus OAM mode in each pixel is replaced by various intensity patterns, due to interference between OAM modes from different channels with random phases. In particular, the intensity profiles of three representative superposed mode pixels (pixel q, r, and s) in the reconstructed image are shown in the left panel of Fig. 3b (experimentally observed superposed mode pixels are shown in Supplementary Fig. 21a), along with cross-sectional views. Note that the two vertical dotted lines in the subfigure of Fig. 3b indicate a circle area with full width at 70% of the maximum fundamental mode (l = 0) intensity profile, and this area is defined as the intensity integral region, hereinafter in this work, for calculating the intensity of a pixel in all cases. One can see the intensity peaks of pixels q, r, s are off-centered due to SPI, resulting in largely varied intensity values (ranging from 58% to 100%, normalized to the intensity of fundamental mode) and thus introducing undesired intensity fluctuation in the post-processed decoded image (Fig. 3c, dashed line).
a OAM beams with the helical mode index l = 1 is incident on the OAM-multiplexed hologram, and images carried by different OAM channels are displayed simultaneously (left). In the coherent case (top right), these coherently superposed images have the interference of different OAM modes at all pixels. In the pseudo incoherent case (bottom right), these images are superposed by the intensity and demonstrate no interference. b Three representative pixels from the reconstructed image in a, for the coherent (left) and pseudo incoherent (right) cases. Intensity distributions are presented in both 2D profiles and 1D cross-sectional views where the values indicate the normalized intensity integral within the region as denoted by vertical dotted lines. c Intensities of all pixels in the post-processed results of the reconstructed image in a.
In contrast, for the pseudo incoherent case, the OAM modes with centrosymmetric intensity distribution is well maintained since all pixels are superposed in an intensity manner. As such, the Gaussian fundamental modes (at signal locations) and the OAM modes (at non-signal locations) are distinctively shown in the reconstruction results (bottom right corner of Fig. 3a, experimentally observed Gaussian fundamental modes and the OAM modes are shown in Supplementary Fig. 21b). The cross-sectional views in the left panel of Fig. 3b (pixel u, v, and w) indicates no center offset, and the normalized intensities among different pixels are much more consistent, ranging from 91 to 97%. Consequently, post-processed decoded images in the pseudo incoherent case exhibit much lower intensity fluctuation (Fig. 3c, solid line) and almost crosstalk-free feature. Notably, SPI becomes weaker as Δl increases, due to a much smaller spatial overlap among different OAM channels at the same pixel (see Supplementary Note 4).
Secondly, we consider the scenario of γ > 1, where the OAM channels from adjacent pixels cannot be completely separated from each other, thus, API starts to take effect and may introduce heavy crosstalk in the reconstructed image. To independently investigate the influence of API on the signal location of the reconstructed image, we examine an OAM-multiplexed example of all four OAM modes (l = 0, 5, 10, 15) as shown in Fig. 4a, where Δl is so large as 5 that SPI can be ignored (example with Δl = 1 is shown in Supplementary Note 5), and dmax, the diameter of OAM mode with l = 15 is marked. Specifically, we study the pixel of interest (marked as 0) at a signal location and its eight adjacent pixels (marked from 1 to 8), all incorporating four OAM modes as stated. Note that those eight adjacent pixels are assumed to have the same intensity here, while a more general API case considering the spot array with different intensities is studied in Supplementary Note 6. The API patterns in the coherent case are illustrated in the top row of Fig. 4b, compared with the intensity superposition pattern between adjacent pixels in the pseudo incoherent case. The bottom row of Fig. 4b describes the cross-sectional views of the intensity profile, implying that for the coherent case, API makes the intensity distribution at pixel 0 changes significantly from the peak value of 1.0 (red dotted line) to 1.5 (solid line), while it remains almost unchanged for the pseudo incoherent case.
a OAM modes involved in the multiplexing. b Schematic of API effect on a signal location, with densely packed OAM modes (l = 0, 5, 10, 15) at nine adjacent locations (top) as well as cross-sectional views (bottom). c Fluctuations of intensity integral in b versus γ. The CV value indicating the intensity fluctuations is calculated from 100 trials. Specific intensity results of each trial are shown for the cases of γ = 0.96 and γ = 2.90 (bottom). d Schematic of API effect on a non-signal location, with densely packed OAM modes (l = 5, 10, 15) at nine adjacent locations (top) as well as cross-sectional views (bottom). e Average intensity integral in d versus γ.
One can tell from the top row of Fig. 4c that for the coherent case, the intensity fluctuation, as evaluated by the CV, rises rapidly as γ enlarges from 4% at γ = 1 to 36% at γ = 2.9, which is also evident by the intensity values on 100 trials at the bottom row of Fig. 4c. As such, in order to suppress undesired intensity fluctuation, the upper limit of the multiplexing channel number in the coherent OAM holography is strictly set at γ = 1, where the outermost modes of adjacent pixels just intersect (see the upper left inset of Fig. 4c). In contrast, the pseudo incoherent case ultimately breaks this limit, allowing the reconstruction of signal location with zero CV and absolutely no intensity fluctuation at the condition far beyond γ = 1 (equivalently to supporting much more OAM channels at the same resolution).
In addition, the schematic of Fig. 4d (4e) is similar to Fig. 4b (4c), except that each pixel contains only three OAM modes (l = 5, 10, 15), in order to illustrate the influence of API on a non-signal location. Figure 4e shows that the average intensity at the non-signal location of the reconstructed image increases sharply when γ > 2 for both coherent and incoherent case, but remains at a rather low level relative to the signal intensity in Fig. 4c, because the outermost mode with lmax as high as 15 has very weak intensity and barely contributes to adjacent pixels.
In short, the key to achieving high-resolution OAM holography is to attenuate the intensity fluctuations of the reconstructed image, while the background noise, which represents a constant image offset, has little effect on the quality of the reconstructed image when the multiplexed number is relatively small. The models of SPI and API for the case of temporal multiplexing of 50 holograms are presented in Supplementary Note 7. The combinative effect of SPI and API is illustrated in Supplementary Note 8.
Principle of temporal multiplexing binary OAM holography
The coherent analogy to the pseudo incoherent case is inspired by temporal multiplexing holography34,35,36, where the reconstructed images are constantly updated by refreshing CGHs with the same image but uncorrelated initial random phases at a high frame rate, leading to the reconstructed images observed being the accumulation of multiple independent images in a narrow time duration, thereby dramatically reducing the degree of coherence in the reconstructed results. This method requires high-speed spatial light modulating devices such as digital micromirror device (DMD) and ferro-electronic liquid crystal on silicon (FLCOS), thus restricting the available types of CGHs to amplitude binary holograms (for DMD) and phase binary holograms (for FLCOS). Here we use amplitude binary holograms for simulation and experiment.
The design process of a binary OAM-selective hologram is shown in Fig. 5a. To achieve the OAM holography, a sampling array with a random phase function samples the target image in the image plane28. Then the inverse Fourier transform of the sampled image yields a complex-amplitude OAM hologram. To achieve OAM selectivity, the phase portion of the complex-amplitude OAM hologram is added with a helical phase mask. We encode the complex-amplitude OAM-selective hologram into an amplitude OAM-selective hologram using a modified off-axis encoding method37, then binarize the amplitude OAM-selective hologram to obtain a binary OAM-selective hologram. To suppress the inherent binary quantization noise from the binary holograms, here we use the SWMAE algorithm38 (see Supplementary Note 9) to create a low-noise region in the spatial frequency domain and successfully achieve binary OAM holograms experimentally (see Supplementary Fig. 22).
The flowchart of the TMBH method is illustrated in Fig. 5b. First, we select multiple target images to be encoded. Each image is transformed into a complex-amplitude OAM hologram Ω according to Fig. 5a. Next, in each channel a specific helical phase mask is added to the phase of the complex-amplitude OAM hologram, in order to create multiple orthogonal, independent complex-amplitude OAM-selective holograms. Then these OAM-selective holograms are superposed in a complex-amplitude manner to synthesize a complex-amplitude OAM-multiplexed hologram. Finally, after amplitude encoding and binary quantization, a binary OAM-multiplexed hologram N is obtained. A series of binary OAM-multiplexed holograms are generated by repeating the above process. In different loops, different random phase functions Ψ are added to each image, which results in different arrangements of binary OAM holograms with the same multiplexed information. In order to illustrate the similarity of TMBH with the pseudo incoherent case in detail, the temporal multiplexing results of 50 binary holograms are shown in Supplementary Note 10. The analysis of OAM content in the reconstructed image of TMBH and that of a single moment is presented in Supplementary Note 11.
Characterization of temporal multiplexing binary OAM holography
In this subsection, we compare in detail the performances of three classes of OAM holograms: phase-only OAM holography (PH, with single hologram), CAH (with single hologram), and TMBH (with 50 holograms temporally multiplexed) proposed in this work. For the first example of illustration, a set of 300 × 300 binary images of winter sport icons are encoded separately into multiple OAM channels, with the sampling distance of L = 8 λ/NA and index interval of Δl = 1. We numerically generate three classes of OAM-multiplexed holograms to carry information from multiple OAM channels. The reconstructed results for 7 and 11 OAM channels are demonstrated in Figs. 6a, b respectively, indicating that the TMBH method apparently has the best image quality and lowest CV value in each channel (see also Fig. 6c). Figure 6d shows TMBH has the CV value of 5.5% at the traditional boundary of γ = 1 (with seven channels), much lower than that of CAH (11.9%) and PH (27.9%), while at γ = 2 in the extended range (with 11 channels), TMBH still has a very low CV value of 6.5%, very close to the CV value of the pseudo incoherent case (3.2%), in striking contrast to the cases of CAH (20.7%) and PH (33.9%).
a Reconstructed results (partially shown) with 7 OAM channels. b Reconstructed results (partially shown) with 11 OAM channels. c Quantitative comparison of reconstruction quality. d Evolution of intensity fluctuation of reconstructed images versus the number of OAM-multiplexing channels, where the multiplexing channel numbers for γ = 1 and γ = 2 are marked.
Furthermore, the example of the winter sport icon is verified in the experiment. To demonstrate the effectiveness of the TMBH method in an experiment, we developed three prototypes of OAM holographic displays (see Supplementary Note 12). First prototype implements the TMBH method, based on a DMD to time-sequentially upload OAM-multiplexed holograms. The second prototype employs the PH method as a baseline comparison, using an SLM with phase-only OAM-multiplexed holograms. The third prototype employs the CAH method as a baseline comparison, using two SLMs (an amplitude-only one and a phase-only one) for complex-amplitude modulation. In the experiment, eleven icons are encoded separately into eleven OAM channels with the helical mode index ranging from −5 to 5 at an interval of Δl = 1 that for each of OAM channels, 50 binary OAM-multiplexed holograms are generated and time-sequentially uploaded onto a DMD at 10 kHz, following the procedure of Fig. 5. To further improve the OAM selectivity, a fundamental mode filtering aperture array is added during post-processing to rule out high-order OAM mode pixels with doughnut-shaped intensity distributions, with the post-processed results shown in Supplementary Note 13 (raw data is demonstrated in Supplementary Figs. 24 and 25).
In the experimentally reconstructed results of TMBH in Supplementary Note 13, the structure of the OAM mode pixel at each pixel is distinctive and stable, making the post-processing results clear and almost crosstalk-free. In contrast, the reconstructed results of CAH and PH contain a huge number of speckles due to inevitable interference, leading to strong crosstalk in the post-processed results. Furthermore, we verify the operating condition beyond the sampling limit (γ = 2.5) in the experiment by scaling the multiplexed channels to 17 while maintaining the image resolution, as shown in Supplementary Fig. 26. We also experimentally verify that TMBH can significantly reduce the multiplexing crosstalk at the sampling limit (γ = 1), and thus significantly improve the image quality with respect to PH method (seven channels in Supplementary Fig. 27). Besides, Supplementary Fig. 28 shows the reconstructed images of sparsely sampled letters and numbers using 33 channels (γ = 2).
For the second example, the sampling condition is significantly pushed to γ = 9.2, while a series of different 800 × 800 binary images are separately encoded by up to 81 OAM channels with Δl = 1. Figure 7a, b indicate the potentials of capacity scaling with fixed resolution (L = 10 λ/NA) that as the channel number K increases from 11 to 81, the TMBH method always exhibits high-quality images with CV value slightly rising from 7.6 to 17.6%, while CAH method fails to recover the object, having CV dramatically going up to 55.5% at γ = 3.8 and 80.0% at γ = 9.2. Notably, the super-resolution capability of the presented method over the conventional resolution limit of OAM holography is clearly shown by comparing the reconstructed results of the TMBH method (γ = 9.2, K = 81) in Fig. 7b (top row) and CAH method (γ = 1, K = 81) in Fig. 7c (bottom row), demonstrating a significant resolution enhancement by 9.2 times (from L = 92 λ/NA to L = 10 λ/NA) at 81 OAM channels. The experimental reconstruction results are presented in Supplementary Note 14.
a Intensity fluctuations of reconstructed images versus increasing OAM-multiplexing channel number. b Comparison between TMBH and CAH methods in terms of reconstruction quality at the same resolution, operating far beyond the sampling criterion limit. c Reconstruction results of the CAH method at the resolution limit of high capacity (γ = 1, K = 81).
The third example targets the gray images with large grayscale, which are inherently far more sensitive to intensity fluctuation than binary images. The images chosen are five gray figures of famous landmarks in China (“Forbidden City”, “Oriental Pearl Tower”, “Giant Wild Goose Pagoda”, “Temple of Heaven”, and “Yellow Crane Tower”), each with a grayscale of 256 and a resolution of 300 × 300. The decoding results of the OAM-multiplexed hologram are shown in Fig. 8, with the mode index of l = 2, 1, 0, −1, −2. In this instance, the target images are sampled by a denser array (L = 6 λ/NA), leading to large intensity fluctuations and strong speckle noises in the post-processed decoded images of PH and CAH methods in Fig. 8. In contrast, the TMBH method faithfully reconstructs the ground truth, demonstrating a significant improvement in image quality of decoded results, as denoted by SSIM values. Notably, while keeping the high reconstructed resolution unchanged, the TMBH method allows further enhancement of the multiplexing capacity by 2.6 times, expanding the numbers of OAM channels and reconstructed images from 5 (γ = 2) to 13 (γ = 5), as shown in Supplementary Fig. 23.
Furthermore, the example of densely sampled grayscale is experimentally investigated. As the incident OAM beam changes (l = −2, −1, 0, 1, 2), the corresponding five different images of landmarks encoded are displayed in turn and captured by the camera, while the post-processed experimental results are shown in Fig. 9. The SSIM values of experimental results by TMBH method are very consistent with the simulated results. One can see the TMBH method faithfully reconstructs each of the high-resolution images with 256 gray levels, clearly exhibiting the local structures and boundaries of buildings, while in the results of the PH method, targets are buried in heavy noise and can hardly be recognized. The experiment results demonstrate the strong capability of the TMBH method to recover dense gray images, which remarkably satisfies the urgent needs of OAM-based holography systems towards practical scenarios.
Finally, we illustrate the potential of TMBH for applications in holographic video display (Fig. 1). We extracted 201 images with 256 grayscale and 7600 × 7600 resolution from an original video of “aircraft landing”. All images are sampled with L = 38 λ/NA and encoded into 201 OAM channels ranging from −100 to 100 at the interval of Δl = 1, so that one can only reconstruct the real video stream when the 201 OAM modes are incident on the hologram in the correct sequence, while the playback content and playing frame rate can be accurately controlled by switching OAM modes (Fig. 1d). Figure 1e compares the SSIM values of a reconstructed frame by TMBH and CAH methods. Note that the original quality of CAH at a few channels is superior to that of TMBH, since the TMBH method that employs amplitude binary holograms has inherent binary noise. However, the SSIM of the TMBH method remains almost unchanged at 0.47–0.48 against the growing number of OAM channels within the range of γ ≤ 2, beyond which it decreases very slowly, leading to an SSIM of 0.41 at 201 channels (γ = 4.7). By contrast, the SSIM value of CAH method that carries the same content decreases dramatically by 56%, from 0.54 to 0.24, as the channel number increases from 21 to 201. Figure 1e shows the fine details in two reconstructed frames of the 201-channel-multiplexing hologram of the TMBH method (see also Supplementary Movie 1), while the results of the CAH method, accompanied by strong scattering noise, are difficult to distinguish (see also Supplementary Movie 2). Comparison between Fig. 1e, f vividly indicates the superiority of TMBH in terms of high-quality, high-capacity holographic display, at a significantly enhanced resolution beyond the resolution limit of conventional OAM holography. Besides, we demonstrate that the TMBH method can be applied in three-dimensional holography, as shown in Supplementary Note 15.
Discussion
This work has elaborated that multiplexing crosstalk in OAM holography originates from two types of interferences, and claimed that the sampling criterion limit of OAM holography can be released by effectively suppressing the coherence and thus the crosstalk in reconstructed images, thereby breaking the conventional resolution limit and capacity limit. In terms of super-resolution reconstruction, we have demonstrated, theoretically and experimentally, high-quality OAM holography towards binary images, gray images, and video display, having exceptional resolution enhancement by several times. In terms of capacity boost, the TMBH method, as well as the pseudo incoherent concept, not only expands the largest addressable OAM index that dmax can be larger than L by an order of magnitude, but also allows OAM channels closely packed with dense index interval that all the high-quality results presented have Δl = 1, thereby leading to two-fold improvement in capacity, compared with previous demonstrations. In the experiment, we have achieved the multiplexed images with the maximum dot per inch (DPI) of 95 pixel/inch, while the number of multiplexed images is 45, reaching the super-resolution that is 5.6 times the resolution of conventional OAM holographic reconstructed images which has the DPI of only 17 pixel/inch under the same conditions. Further increasing the NA of an experimental system can improve the resolution of the reconstructed image, that can reach 1446 pixel/inch, for example, by increasing the NA from the current value of 0.02 to 0.3, which can be achieved by expanding the hologram size or reducing the focal length of Fourier lens.
Temporal multiplexing, rather than a partially coherent light source, is used to reduce the coherence of the reconstructed images, well-preventing damage in the structure of holographic images and OAM orthogonality. In addition, the computation process of binary OAM holograms is non-iterative; thus, the computation time is significantly reduced compared with the PH method (Supplementary Fig. 29). The presented approach is also compatible with other DoFs of light, achieving further enhancement in the multiplexing capacity while maintaining high reconstruction resolution.
Note that 50 pieces of binary holograms are multiplexed in time series for each object in this work; however, ten pieces is actually sufficient for suppressing the crosstalk, which is evident by the rapid decline of CV value in Supplementary Fig. 11c. Thus, TMBH method allows a holographic display rate of up to 2 kHz, using a commercial DMD operated at 20 kHz. Despite that our proof-of-principle experiments use DMD, which enjoys powerful programmability, low cost, and easy adaptiveness, the TMBH method is applicable to all types of reconfigurable holographic media. In a step towards ultrafast switching of image frames, the presented method can be potentially implemented by fully reprogrammable and actively tunable metasurfaces that are favored with very fast reconfiguration time (<33 ns) and compact size39, keeping in mind that existing individually addressable metasurfaces which enable only 2-bit encoding at maximum40,41,42 can operate well with binary OAM holograms. In addition, using a laser with tunable spatial coherence43,44,45 as the illumination source is beneficial to eliminate the inherent binary noise of binary holograms (Supplementary Note 9) and further enhance the reconstruction quality. Besides, the pseudo incoherent concept proposed might come true, by elaborately regularizing the directions of spatial frequencies of all incoherent incident vectors into coincidence, possibly with the help of machine-learning-based methods. This work opens up new perspectives for OAM holography, and illustrates a practical and feasible solution to high-resolution, high-quality, high-volume holographic systems, paving the way for performance improvement in a wide range of applications, including smart display, holographic encryption, augmented reality, and optical storage.
Methods
Coefficient of variation
The coefficient of variation (CV) is defined as the ratio between the standard deviation of intensity fluctuations and the average intensity in the evaluated area:
As an evaluation parameter that does not require a true value, CV is often used to evaluate the speckle contrast in images45. In this work, CV is used to evaluate the reconstructed results of binary images. A larger CV value represents a higher level of intensity fluctuation in the binary image, which suggests the image quality is getting worse.
Evaluation of image quality
To evaluate complex images with multiple grayscales, we introduce structural similarity index measure (SSIM)46 as an objective image quality evaluation function, which fully takes advantage of known characteristics of the human visual system (HVS). SSIM is generated by combining five functions:
where μt and μe are the mean values of the ground truth and evaluated images, respectively. σt and σe are the standard deviations of the ground truth and evaluated images, respectively. σe,t is the covariance between two images, c1 and c2 are two constants. The SSIM takes values between 0 and 1, while a larger SSIM means that the structure of the evaluated image has higher similarity with the ground truth.
Data availability
The Source data are available from the corresponding author upon request. All data needed to evaluate the conclusion are present in the main text and/or the Supplementary Information.
Code availability
Codes used for this work are available from the corresponding author upon request.
References
Zhou, T. et al. Large-scale neuromorphic optoelectronic computing with a reconfigurable diffractive processing unit. Nat. Photonics 15, 367–373 (2021).
Lin, X. et al. All-optical machine learning using diffractive deep neural networks. Science 361, 1004–1008 (2018).
Lin, S., Wang, D., Wang, Q. & Kim, E. Full-color holographic 3D display system using off-axis color-multiplexed hologram on single SLM. Opt. Laser Eng. 126, 105895 (2020).
Lin, X., Liu, J., Jia, J., Pan, Y. & Wang, Y. 3D dynamic holographic display by modulating complex amplitude experimentally. Opt. Express 21, 20577–20587 (2013).
Shi, L., Li, B., Kim, C., Kellnhofer, P. & Matusik, W. Towards real-time photorealistic 3D holography with deep neural networks. Nature 591, 234–239 (2021).
Choi, S., Gopakumar, M., Peng, Y., Kim, J. & Wetzstein, G. Neural 3D holography: learning accurate wave propagation models for 3D holographic virtual and augmented reality displays. ACM Trans. Graph. 40, 1–12 (2021).
Li, X. et al. Athermally photoreduced graphene oxides for three-dimensional holographic images. Nat. Commun. 6, 6984 (2015).
Blanche, P. A. Holography, and the future of 3D display. Light Adv. Manuf. 2, 28 (2021).
Blinder, D., Birnbaum, T., Ito, T. & Shimobaba, T. The state-of-the-art in computer generated holography for 3D display. Light Adv. Manuf. 3, 35 (2022).
Vyas, S., Chia, Y. & Luo, Y. Conventional volume holography for unconventional Airy beam shapes. Opt. Express 26, 21979–21991 (2018).
Wan, Z., Wang, Z., Yang, X., Shen, Y. & Fu, X. Digitally tailoring arbitrary structured light of generalized ray-wave duality. Opt. Express 28, 31043–31056 (2020).
Ngcobo, S., Litvin, I., Burger, L. & Forbes, A. A digital laser for on-demand laser modes. Nat. Commun. 4, 2289 (2013).
Kong, D., Cao, L., Jin, G. & Javidi, B. Three-dimensional scene encryption and display based on computer-generated holograms. Appl. Opt. 55, 8296–8300 (2016).
Georgi, P. et al. Optical secret sharing with cascaded metasurface holography. Sci. Adv. 7, eabf9718 (2021).
Zhou, H. et al. Correlated triple hybrid amplitude and phase holographic encryption based on a metasurface. Photonics Res. 10, 678–686 (2022).
Barrera, J. F., Henao, R., Tebaldi, M., Torroba, R. & Bolognini, N. Multiplexing encrypted data by using polarized light. Opt. Commun. 260, 109–112 (2006).
Wen, D. et al. Helicity multiplexed broadband metasurface holograms. Nat. Commun. 6, 8241 (2015).
Zhao, R. et al. Multichannel vectorial holographic display and encryption. Light Sci. Appl. 7, 95 (2018).
Mok, F. H. Angle-multiplexed storage of 5000 holograms in lithium niobate. Opt. Lett. 18, 915–917 (1993).
Li, X. et al. Multicolor 3D meta-holography by broadband plasmonic modulation. Sci. Adv. 2, e16011102 (2016).
Lim, K. T., Liu, H., Liu, Y. & Yang, J. K. Holographic colour prints for enhanced optical security by combined phase and amplitude control. Nat. Commun. 10, 1–8 (2019).
Bozinovic, N. et al. Terabit-scale orbital angular momentum mode division multiplexing in fibers. Science 340, 1545–1548 (2013).
Gibson, G., Courtial, J., Padgett, M., Vasnetsov, M. & Pas’ko, V. Free-space information transfer using light beams carrying orbital angular momentum. Opt. Express 12, 5448–5456 (2004).
Gong, L. et al. Optical orbital-angular-momentum-multiplexed data transmission under high scattering. Light Sci. Appl. 8, 27 (2019).
Lei, T. et al. Massive individual orbital angular momentum channels for multiplexing enabled by Dammann gratings. Light Sci. Appl. 4, e257 (2015).
Fang, X., Ren, H. & Gu, M. Orbital angular momentum holography for high-security encryption. Nat. Photonics 14, 102–108 (2020).
Ren, H. et al. Metasurface orbital angular momentum holography. Nat. Commun. 10, 2986 (2019).
Ren, H. et al. Complex-amplitude metasurface-based orbital angular momentum holography in momentum space. Nat. Nanotechnol. 15, 948–955 (2020).
Rubinsztein-Dunlop, H. et al. Roadmap on structured light. J. Opt. 19, 013001 (2017).
Zhu, G. et al. Ultra-dense perfect optical orbital angular momentum multiplexed holography. Opt. Express 29, 28452–28460 (2021).
Wang, F., Zhang, X., Xiong, R., Ma, X. & Jiang, X. Angular multiplexation of partial helical phase modes in orbital angular momentum holography. Opt. Express 30, 11110–11119 (2022).
Cheng, P., Huang, S. & Yan, C. Ellipticity-encrypted orbital angular momentum multiplexed holography. J. Opt. Soc. Am. A 38, 1875–1883 (2021).
Fang, X. et al. High-dimensional orbital angular momentum multiplexing nonlinear holography. Adv. Photon. 3, 015001 (2021).
Amako, J., Miura, H. & Sonehara, T. Speckle-noise reduction on kinoform reconstruction using a phase-only spatial light modulator. Appl. Opt. 34, 3165–3171 (1995).
Golan, L. & Shoham, S. Speckle elimination using shift-averaging in high-rate holographic projection. Opt. Express 17, 1330–1339 (2009).
Lee, B., Kim, D., Lee, S., Chen, C. & Lee, B. High-contrast, speckle-free, true 3D holography via binary CGH optimization. Sci. Rep. 12, 2811 (2022).
Liu, J., Jin, H., Ma, L., Li, Y. & Jin, W. Optical color image encryption based on computer generated hologram and chaotic theory. Opt. Commun. 307, 76–79 (2013).
Heggarty, K. & Chevallier, R. Signal window minimum average error algorithm for computer-generated holograms. J. Opt. Soc. Am. A 15, 625–635 (1998).
Jiang, Q., Jin, G. & Cao, L. When metasurface meets hologram: principle and advances. Adv. Opt. Photonics 11, 518–576 (2019).
Badloe, T., Lee, J., Seong, J. & Rho, J. Tunable metasurfaces: the path to fully active nanophotonics. Adv. Photonics Res. 2, 2000205 (2021).
Li, L. et al. Electromagnetic reprogrammable coding-metasurface holograms. Nat. Commun. 8, 197 (2017).
He, Q., Sun, S. & Zhou, L. Tunable/reconfigurable metasurfaces: physics and applications. Research 2019, 1849272 (2019).
Eliezer, Y. et al. Suppressing meta-holographic artifacts by laser coherence tuning. Light Sci. Appl. 10, 104 (2021).
Peng, Y., Choi, S., Kim, J. & Wetzstein, G. Speckle-free holography with partially coherent light sources and camera-in-the-loop calibration. Sci. Adv. 7, eabg5040 (2021).
Deng, Y. & Chu, D. Coherence properties of different light sources and their effect on the image sharpness and speckle of holographic displays. Sci. Rep. 7, 5893 (2017).
Wang, Z., Bovik, A., Sheikh, H. & Simoncelli, E. Image quality assessment: from error visibility to structural similarity. IEEE Trans. Image Process 13, 600–612 (2004).
Acknowledgements
X.F. acknowledges funding support from the National Natural Science Foundation of China (61975087). We thank Prof. Liangcai Cao, and Prof. Hao Zhang in Tsinghua University, and Prof. Xingpeng Yan in Army Academy of Armored Forces for their technical assistance with the experiment and useful discussions.
Author information
Authors and Affiliations
Contributions
Z.S. and X.F. proposed the idea and conceived the experiment. Z.S. performed the theoretical calculations. Z.S. constructed the experiment with the help of Z.W., Z.Z., and K.L., acquired the data, and carried out the data analysis. Z.S., X.F., and Q.L. completed the writing of the paper.
Corresponding authors
Ethics declarations
Competing interests
The authors declare no competing interests.
Peer review
Peer review information
Nature Communications thanks Xinyuan Fang and the anonymous reviewers for their contribution to the peer review of this work. Peer reviewer reports are available.
Additional information
Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Shi, Z., Wan, Z., Zhan, Z. et al. Super-resolution orbital angular momentum holography. Nat Commun 14, 1869 (2023). https://doi.org/10.1038/s41467-023-37594-7
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41467-023-37594-7
- Springer Nature Limited
This article is cited by
-
Level set methods for gradient-free optimization of metasurface arrays
Scientific Reports (2024)