Abstract
In the search for improved computational capabilities, conventional microelectronic computers are facing various problems arising from the miniaturization and concentration of active electronics. Therefore, researchers have explored wave systems, such as photonic or quantum devices, for solving mathematical problems at higher speeds and larger capacities. However, previous devices have not fully exploited the linearity of the wave equation, which as we show here, allows for the simultaneous parallel solution of several independent mathematical problems within the same device. Here we demonstrate that a transmissive cavity filled with a judiciously tailored dielectric distribution and embedded in a multi-frequency feedback loop can calculate the solutions of a number of mathematical problems simultaneously. We design, build, and test a computing structure at microwave frequencies that solves two independent integral equations with any two arbitrary inputs and also provide numerical results for the calculation of the inverse of four 5 x 5 matrices.
Similar content being viewed by others
Introduction
From nonlinear image processing1 to cryptography2, the ability to quickly solve mathematical problems involving linear algebra is the key for handling the increasing volume of information generated every day. As traditional electronic computers find it more difficult to increase their capabilities by achieving further miniaturization3, novel approaches based on different platforms have become closer to being functional. Researchers have managed to exploit the laws of physics in such a way that the response of well-known physical systems can be utilized to solve more abstract mathematical problems4. Among the most promising scenarios are those based on wave phenomena, such as quantum5,6,7,8,9 or wave systems10,11,12,13,14,15,16,17,18,19,20,21,22,23,24,25,26,27,28.
While earlier efforts using optical signal processing required extensive free-space propagation to do mathematical operations in a Fourier-transformed space29,30,31,32, more recent approaches have benefitted from the use of compact inverse-designed structures that can reliably reproduce the desired optical functionality in a more limited footprint17,33,34,35,36. Inverse-design techniques have been largely exploited for the design of complex nanophotonic structures, such as couplers for multiplexing,37 devices involving nonlinear phenomena38,39, and devices for sound classification35. Similar to other photonic devices, in the linear regime these structures can be characterized by a scattering matrix connecting a set of complex-valued input modes to a set of complex-valued output modes, thus capturing the operation of matrix multiplication40. Other researchers have exploited known resonant geometries to achieve differential equation solvers for time-envelope signals41, and an example of parallel photonic differentiation has also been recently proposed42.
By implementing feedback paths into linear systems the output and input modes can be linked together, resulting in platforms that, in addition to performing mathematical operations, can also compute the solution of mathematical problems requiring matrix inversion17. In an earlier work from our group, this concept was experimentally demonstrated with a reflective cavity, which necessitates symmetric kernels17.
In this work, we embark on a more ambitious approach to fulfill two important goals: (1) To design a single metamaterial structure that can simultaneously solve several independent equations with different kernels each with arbitrary input signals encoded on a wave with different frequency; and (2) to include more general, i.e., nonsymmetric and symmetric, kernels, using the transmissive cavity and feedback mechanism.
Results and discussion
Simultaneously solving two arbitrary integral equations
Our structures, which follow the scheme shown in Fig. 1, are capable of solving equations given by
which constitutes a Fredholm integral equation of the second kind. In a physical realization of the device based on N input and N output waveguides, this equation can be discretized into matrix form, g = e + Kg, where g represents a N × 1 vectorial solution obtained as the complex-valued signal at each waveguide, e is the N × 1 vector input signal and K is an N × N discretized version of the kernel K(u,v). The metamaterial device gives the output g = inv(Inxn − K)e, where Inxn represents the identity matrix of the same order as the kernel. This mathematical representation provides important insight on the capability of this metamaterial platform, as it allows for the fully analog inversion of a given matrix—an important mathematical process in diverse fields. The problem is then reduced to finding a dielectric distribution whose transmission parameters reproduce the N × N matrix form of the kernel, while having near-zero reflections, where the inputs and outputs are the waveguides on the left and on the right, respectively. In other words, we need to prescribe the transmission part of the S-matrix, T, to be K.
To achieve these goals, let us start by considering the following two complex kernels as our first example for two independent Fredholm integral equations of the second kind
which have been chosen to have a wide distribution of scattering parameter values in the complex plane for greater clarity and as a method to intentionally challenge our design process. These two kernels are realized simultaneously in a single metamaterial structure having five inputs and five outputs and dimensions 30 × 60 cm shown in Fig. 2a. We have found that the degrees of freedom increase with the size of the optimization domain. The size of the structure was chosen to be large enough to contain sufficient degrees of freedom while also being experimentally feasible. The transmission matrices, T1 and T2, are equal to the two kernels in the sampling grid within the interval u,v ∈[−2.5, 2.5] at two different frequencies, i.e., at f1 = 4 GHz for K1(u, v) and f2 = 5 GHz for K2(u, v), while requiring negligible reflection (more information about the choice of the kernels and their discretization can be found in the Supplementary Materials). The two frequencies of operation were chosen to balance the tradeoff between the optimization of the metamaterial structure and the waveguiding components involved. We assume a harmonic time dependence for the fields given by e−i2πft.
We utilize the method of inverse design17,37,38,39 to determine the required permittivity distribution of this structure while enforcing several fabrication constraints: (1) The structure is binary consisting of either air or the commercially available dielectric material Rexolite, with relative permittivity of 2.53 with a loss tangent lower than 10−4; and (2) The resulting dielectric distribution can be manufactured via standard CNC milling, imposing a minimum internal radius and feature size to allow for fabrication with conventional tooling. Minor postprocessing corrections were performed to reinforce these constraints where necessary. The results of this design process are shown in Fig. 2a.
In Fig. 2b, the resultant design was simulated using commercial software CST Microwave Studio®43 and the comparison between the simulation results for the complex-valued transmission part of the scattering matrices and the ideal values of the discretized desired kernels at the two frequencies of interest is presented, showing good agreement. The small errors are due to the aforementioned shape postprocessing needed for its in-house manufacturing.
Once the planar kernel design is completed, a transmission-based feedback and coupling mechanism is required to excite, recurse, and read the system. While this is theoretically possible in a fully two-dimensional (2D) geometry, a three-dimensional (3D) (i.e., two-level) feedback structure is a suitable way to ensure that the feedback waveguides are of equal length as shown in Fig. 2c, thus ensuring equal phase between the feedback lines. Slot couplers are designed to allow total transmission between the upper and lower levels at the two frequencies of interest, similar to those used in pillbox-type antennas44. To allow for the unidirectional excitation and evaluation of the system, excitation and measurement occur using two pairs of appropriately phased coaxial antennas, which act as a two element endfire array antenna45. Figure 2d is a photograph of the experimental setup (top off for clarity), showing the dielectric parts fixed in place using plastic pins, the input and output waveguides on either side, and the slot couplers bridging to the hidden waveguides on the backside.
To demonstrate the experimental functionality of our device, we have studied the solutions of our two discretized integral equations with the above selected kernels for five separate excitations, each being a unit-amplitude monochromatic signal at one of the five input ports, which indeed form the basis for any general input to the five input waveguides. These monochromatic signals have one of the two frequencies, f1 and f2 given above, each for one of the two integral equations. The experimentally extracted solutions at these two frequencies of interest are shown in Fig. 2e, compared with those obtained from the full-wave simulation of the complete structure as well as those obtained theoretically by directly inverting the discretized problems, showing an excellent agreement. The small deviations may be attributed to manufacturing imperfections, possible inconsistencies of the dielectric constant and loss tangent of the absorbing materials, or to leakages from the cavity. These results demonstrate the device’s ability to simultaneously solve two Fredholm equations of the second kind in a fully analog manner at multiple frequencies.
Simultaneous inversion of four arbitrary matrices
In the following, as a second example, we theoretically study the extension of our idea to the design of a single metamaterial platform that is able to reproduce four different mathematical kernels simultaneously. In contrast to the previous results, in this case we consider four different matrices, which we would like to invert using our metamaterial device. Here we find the dielectric distribution such that the transmissive part of the S-parameters, T, is equal to I−A, where A is the matrix we wish to invert, while the reflection part is required to be negligible. To demonstrate the multi-kernel capability of this approach, four different passive (i.e., that allow for energy conservation) complex-valued matrices have been chosen arbitrarily, A1, A2, A3, and A4. given by:
Following the previous approach, we select four frequencies within the band of operation of the waveguides, and we apply the optimization method to determine the dielectric distribution for our metamaterial device in order to render the transmission parts of the S-parameters associated with the four matrices at four frequencies f1 = 4 GHz, f2 = 4.5 GHz, f3 = 5 GHz, and f4 = 5.5 GHz. The resulting dielectric design is shown in Fig. 3a, with the associated transmission matrix, obtained using numerical simulations, shown in Fig. 3b. To show the large capability of the presented approach, in this design we imposed that the structure be binary with no other fabrication based constraints, as we did not plan to build this example. We obtained an excellent agreement for all 100 complex transmission coefficients.
Finally, in Fig. 3c we present the simulation results from our design showing the inverses of the four matrices, compared with the theoretical results expected for these inverses, revealing an excellent agreement.
In conclusion, in this article we have demonstrated the capability of single inverse-designed platforms that can simultaneously solve a number of mathematical problems such as integral equations and matrix inversion in a completely independent manner using a multifrequency approach. An experimental device was constructed and measured at microwave frequencies showing the ability of our approach to solve two independent integral equations simultaneously at two different frequencies involving kernels, which are nonsymmetric and nonseparable, through the use of feedback. The traditionally challenging feedback mechanism was implemented in a compact manner using a multilevel waveguide approach, leading to excellent agreement between the analog solution with respect to the theoretical and simulated solutions. In addition, we have presented a design for a dielectric distribution, which could be used for the inversion of four arbitrary matrices using the same approach. We believe that this technology has a strong potential for parallel integrated computing photonic circuitry for fast analog signal processing.
Methods
Inverse design and determination of dielectric distribution
The electromagnetic optimization problem of finding the dielectric distribution associated with the transmission matrix given by the mathematical kernel was undertaken using the topological optimization module commercially available within the finite-element method software COMSOL Multiphysics®. In the software, the objective was set to minimize the complex-plane “distance” between the S-parameters and their desired values, consistent with the transmission part being equal to that obtained from the kernel and the reflection part being zero. A separate “Physics Node” was used for each frequency and for each waveguide input, corresponding to a column in the S-Matrix. Therefore, the number of ‘”Physics Nodes” required was equal to NwgNf, with Nwg being the number of input waveguides and Nf being the number of frequencies for which the design is being optimized. The number of objectives is therefore equal to 2N2wgNf.
To reduce the family of solutions to those given by binary values of the relative permittivity, a soft step function was introduced as a weighting of the optimization variables when defining the relative permittivity as a function of the former. Several initial conditions were used until a preliminary experimentally feasible solution was found. The issues arising with radii of curvature and nonbinarized points within the distribution were solved by iteratively blurring and reoptimizing the distribution until the issues were resolved. To improve the resolution of the raster-based dielectric distribution before being exported for manufacturing, the mesh size was iteratively reduced and reoptimized until the desired resolution was achieved.
Once the final raster-based design was obtained within COMSOL Multiphysics®, a high-resolution image was exported and processed through an in-house developed contour-analyzer code, which extracted the vector-format shape of each of the closed-polygon structures of the dielectric distribution. This vector-format design was then imported into the three-dimensional (3D) design software SolidWorks® for the generation of the toolpath needed for the milling of the plastic pieces. The vector-based format of SolidWorks® was also used for its simulation in CST Microwave Studio® as a verification step.
Choice of the frequencies
Our design implies a balance between several constraints. Due to the fact that the two kernels were chosen to be drastically different, the two frequencies should be chosen distant enough as to allow for the scattered fields in the cavity to be sufficiently different from each other at the two frequencies, avoiding large quality factors that would require unrealistic precision in both geometry construction and material properties, which would make such a distribution difficult to find. Additionally, there were several practical concerns. The feedback loop includes specially designed elements such as the non-reflective 180-degree waveguide turn achieved via the use of a slot coupler, which has to be optimized to work at the two frequencies of operation. In addition, we exploited the lowest order mode (TE10) of the rectangular waveguide sections, which presents a cutoff frequency (2.8 GHz) while the complexity of the scattered fields could trigger the excitation of higher order modes in the waveguide (with cutoff frequency 5.6 GHz). Therefore, to balance the tradeoff between the easier dielectric optimization at distinct enough frequencies with the more difficult design of the microwave circuitry involved, 4 GHz and 5 GHz were chosen as the two final frequencies of operation.
Choice of Kernel functions
Each of the functions (kernels), K1(u,v) and K2(u,v), was chosen to have a wide distribution of scattering parameter values in the complex plane, as we felt that this would increase the difficulty and “arbitrariness” of the problem and that a wide spread had greater pedagogical value. These were scaled to achieve the passivity of the system, ensured by the integral over the interval of interest. In our case, we chose the interval given by u,v ∈[−2.5,2.5]. Due to our discrete implementation of the kernels using waveguiding structures, the integrals in the Fredholm integral equation are calculated using a numerical scheme, in the form of a midpoint integration approximation with five sampling points, each associated with an input-output waveguide pair.
Design of the feedback waveguides in the experimental setup
The challenge of designing a 3D waveguide structure with feedback was solved by implementing a two-level system. To achieve negligible reflections, a slot was designed to connect both levels, whose dimensions and positions were optimized to give minimal reflections at the frequencies of interest (i.e., 4 GHz and 5 GHz). To accommodate manufacturing limitations, rounded corners (1.59 mm radius) and the metal thickness (63.5 mm) were introduced in the model as provided by the manufacturer. The optimization method used was the trust-region optimization routine implemented in CST Microwave Studio®.
Design of the unidirectional excitation
The matrix inversion or integral equation solving functionality of the design requires that all waves propagate predominantly only along the direction in which the dielectric distribution is designed to reproduce the desired mathematical kernel. Therefore, to ensure this, we need to enforce that the couplers (which introduce the excitation of the waveguide systems) only excite the mode along the direction of the desired feedback. To do so, we have introduced a pair of coaxial antennas as sources, whose modes are excited with a given phase difference such that the amplitude of the back-propagating mode is zero. The correct phase difference was found through full-wave simulations at the frequencies of interest. To ensure that the presence of these couplers does not perturb the feedback, the length of the tip belonging to the inner conductor of the coaxial antenna has been designed to ensure a coupling coefficient of 5% in amplitude.
Manufacturing methods
The system was built using several layers. The main metal structure containing the waveguides on both sides and the cavity was manufactured by an external company (Ephrata Precision Parts Inc.) using industrial CNC milling capabilities. The plastic parts representing the mathematical kernels were manufactured in our lab using a table-top CNC milling machine. Once these pieces and the absorbing material were assembled, both the top and bottom of the system were sealed by laser-cut sheet metal. On top of these, the exciting and probing antennas were held in place using custom-made bridges. Four hundred screws and conductive tapes ensured the electromagnetic isolation of the system, including an additional rubber layer and customized ‘washer’ on the outside to achieve a uniform force was pressing the top and bottom covers against the sidewall edges. Additionally, the sidewall edges were recessed to ensure that the electrical conduction occurred at the inside corner of the cavity.
Data availability
The data that support the findings of this study are available from the corresponding author upon reasonable request.
Code availability
All codes produced during this research are available from the corresponding author at reasonable request.
References
Modersitzki, J. Numerical Methods for Image Registration. Numerical Methods for Image Registration (Oxford University Press, 2007).
Stallings, W. Cryptography and Network Security: Principles and Practices (Pearson, 2017).
Waldrop, M. M. The chips are down for Moore’s law. Nature 530, 144–147 (2016).
Feynman, R. P. Simulating physics with computers. Int. J. Theor. Phys. 21, 467–488 (1982).
Arute, F. et al. Quantum supremacy using a programmable superconducting processor. Nature 574, 505–510 (2019).
O’Brien, J. L. Optical quantum computing. Science 318, 1567–1570 (2007).
Aspuru-Guzik, A. & Walther, P. Photonic quantum simulators. Nat. Phys. 8, 285–291 (2012).
Peruzzo, A. et al. A variational eigenvalue solver on a photonic quantum processor. Nat. Commun. 5, 1–7 (2014).
O’Brien, J. L., Furusawa, A. & Vučković, J. Photonic quantum technologies. Nat. Photonics 3, 687–695 (2009).
Caulfield, H. J. & Dolev, S. Why future supercomputing requires optics. Nat. Photonics 4, 261–263 (2010).
Aaronson, S. & Arkhipov, A. The computational complexity of linear optics. in Proc. Annual ACM Symposium on Theory of Computing 333–342 (ACM Press, 2011).
Silva, A. et al. Performing mathematical operations with metamaterials. Science 343, 160–163 (2014).
Willner, A. E., Khaleghi, S., Chitgarha, M. R. & Yilmaz, O. F. All-optical signal processing. J. Light. Technol. 32, 660–680 (2014).
Solli, D. R. & Jalali, B. Analog optical computing. Nat. Photonics 9, 704–706 (2015).
Capmany, J., Gasulla, I. & Pérez, D. Microwave photonics: the programmable processor. Nat. Photonics 10, 6–8 (2016).
Kwon, H., Sounas, D., Cordaro, A., Polman, A. & Alù, A. Nonlocal metasurfaces for optical signal processing. Phys. Rev. Lett. 121, 173004 (2018).
Estakhri, N. M., Edwards, B. & Engheta, N. Inverse-designed metastructures that solve equations. Science 363, 1333–1338 (2019).
Cordaro, A. et al. High-index dielectric metasurfaces performing mathematical operations. Nano Lett. 19, 8418–8423 (2019).
Pai, S. et al. Parallel programming of an arbitrary feedforward photonic network. IEEE J. Sel. Top. Quantum Electron https://doi.org/10.1109/JSTQE.2020.2997849 (2020)
Zhou, Y., Zheng, H., Kravchenko, I. I. & Valentine, J. Flat optics for image differentiation. Nat. Photonics 14, 316–323 (2020).
Harris, N. C. et al. Linear programmable nanophotonic processors. Optica 5, 1623 (2018).
Prabhu, M. et al. Accelerating recurrent Ising machines in photonic integrated circuits. Optica 7, 551 (2020).
Miller, D. A. B. Self-configuring universal linear optical component. Photonics Res. 1, 1 (2013).
Pérez, D. et al. Multipurpose silicon photonics signal processor core. Nat. Commun. 8, 1–9 (2017).
Harris, N. C. et al. Quantum transport simulations in a programmable nanophotonic processor. Nat. Photonics 11, 447–452 (2017).
Azaña, J. Ultrafast analog all-optical signal processors based on fiber-grating devices. IEEE Photonics J. 2, 359–386 (2010).
Ferrera, M. et al. On-chip CMOS-compatible all-optical integrator. Nat. Commun. 1, 1–5 (2010).
Marpaung, D. et al. Integrated microwave photonics. Laser Photonics Rev. 7, 506–538 (2013).
Leger, J. R. & Lee, S. H. Coherent optical implementation of generalized two-dimensional transforms. Opt. Eng. 18, 185518 (1979).
Lee, S. H. Optical analog solutions of partial differential and integral equations. Opt. Eng. 24, 240141 (1985).
Rajbenbach, H., Fainman, Y. & Lee, S. H. Optical implementation of an iterative algorithm for matrix inversion. Appl. Opt. 26, 1024 (1987).
Cederquist, J. & Lee, S. H. The use of feedback in optical information processing. Appl. Phys. 18, 311–319 (1979).
Jensen, J. S. & Sigmund, O. Topology optimization for nano-photonics. Laser Photonics Rev. 5, 308–321 (2011).
Tierney, B. B. & Grbic, A. Designing anisotropic, inhomogeneous metamaterial devices through optimization. IEEE Trans. Antennas Propag. 67, 998–1009 (2019).
Hughes, T. W., Williamson, I. A. D., Minkov, M. & Fan, S. Wave physics as an analog recurrent neural network. Sci. Adv. 5, eaay6946 (2019).
Su, L. et al. Nanophotonic inverse design with SPINS: software architecture and practical considerations. Appl. Phys. Rev. 7, 011407 (2020).
Su, L., Piggott, A. Y., Sapra, N. V., Petykiewicz, J. & Vučković, J. Inverse design and demonstration of a compact on-chip narrowband three-channel wavelength demultiplexer. ACS Photonics 5, 301–305 (2018).
Sitawarin, C., Jin, W., Lin, Z. & Rodriguez, A. W. Inverse-designed photonic fibers and metasurfaces for nonlinear frequency conversion. Photonics Res. 6, B82 (2018).
Hughes, T. W., Minkov, M., Williamson, I. A. D. & Fan, S. Adjoint method and inverse design for nonlinear nanophotonic devices. ACS Photonics 5, 4781–4787 (2018).
Yariv, A. & Yeh, P. Photonics: optical electronics in modern communications (the oxford series in electrical and computer engineering) (Oxford University Press, Inc., 2006).
Zangeneh-Nejad, F. & Fleury, R. Topological analog signal processing. Nat. Commun. 10, 1–10 (2019).
Babaee, A., Momeni, A., Abdolali, A. & Fleury, R. Parallel optical computing based on MIMO metasurface processors with asymmetric optical response. arXiv https://arxiv.org/abs/2004.02948 (2020).
CST Studio Suite, “CST Microwave Studio” http://www.cst.com (2020).
Ettorre, M., Sauleau, R. & Le Coq, L. Multi-beam multi-layer leaky-wave SIW pillbox antenna for millimeter-wave applications. IEEE Trans. Antennas Propag. 59, 1093–1100 (2011).
Hansen, W. W. & Woodyard, J. R. A new principle in directional antenna design. Proc. Inst. Radio Eng. 26, 333–345 (1938).
Acknowledgements
This work is supported in part by the Vannevar Bush Faculty Fellowship program sponsored by the Basic Research Office of the Assistant Secretary of Defense for Research and Engineering, funded by the Office of Naval Research through grant N00014-16-1-2029.
Author information
Authors and Affiliations
Contributions
N.E. conceived the idea and supervised the project. M.C. developed the concept and conducted the simulations and inverse design. M.C. and B.E. designed and built the experimental setup. M.C. measured and processed the experimental results. All the authors contributed to the writing of the manuscript.
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing interests.
Additional information
Peer review information Nature Communications thanks Ari Sihvola and the other, anonymous, reviewer(s) for their contribution to the peer review of this work.
Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Camacho, M., Edwards, B. & Engheta, N. A single inverse-designed photonic structure that performs parallel computing. Nat Commun 12, 1466 (2021). https://doi.org/10.1038/s41467-021-21664-9
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41467-021-21664-9
- Springer Nature Limited
This article is cited by
-
Inverse-designed low-index-contrast structures on a silicon photonics platform for vector–matrix multiplication
Nature Photonics (2024)
-
Solving integral equations in free space with inverse-designed ultrathin optical metagratings
Nature Nanotechnology (2023)
-
Meta-programmable analog differentiator
Nature Communications (2022)
-
Electromagnetic wave-based extreme deep learning with nonlinear time-Floquet entanglement
Nature Communications (2022)
-
Metasurface-enabled on-chip multiplexed diffractive neural networks in the visible
Light: Science & Applications (2022)