Abstract
We develop and solve a constrained optimization model to identify an integrable optics rapid-cycling synchrotron lattice design that performs well in several capacities. Our model encodes the design criteria into 78 linear and nonlinear constraints, as well as a single nonsmooth objective, where the objective and some constraints are defined from the output of Synergia, an accelerator simulator. We detail the difficulties of optimizing within the 32-dimensional, simulation-constrained decision space and establish that the space is nonempty. We use a derivative-free manifold sampling algorithm to account for structured nondifferentiability in the objective function. Our numerical results quantify the dependence of approximate solutions on constraint parameters and the effect of the form of objective function.
Similar content being viewed by others
References
Abi R et al (2020) Deep Underground Neutrino Experiment (DUNE), Far Detector Technical Design Report, Volume II: DUNE Physics. Fermilab, Batavia, FERMILAB-PUB-20-025-ND . arxiv.org/abs/2002.03005
Ainsworth R, Dey J, Eldred J, Harnik R, Jarvis J, Johnson DE, Kourbanis I, Neuffer D, Pozdeyev E, Syphers MJ, Valishev A, Yakovlev VP, Zwaska R (2021) An upgrade path for the Fermilab accelerator complex. Fermilab, Batavia, Snowmass 2022 White Paper FERMILAB-TM-2754-AD-APC-PIP2-TD . arxiv.org/abs/2106.02133
Amundson J, Goldhaber S, Lebrun P, Lu Q, Macridin A, Michelotti L, Park CS, Spentzouris P, Stern E Synergia. synergia.fnal.gov/
Amundson JF, Spentzouris P, Qiang J, Ryne R (2006) Synergia: an accelerator modeling tool with 3-D space charge. J Comput Phys 211:229–248. https://doi.org/10.1016/j.jcp.2005.05.024
Antipov S, Broemmelsiek D, Bruhwiler D, Edstrom D, Harms E, Lebedev V, Leibfritz J, Nagaitsev S, Park C, Piekarz H, Piot P, Prebys E, Romanov A, Ruan J, Sen T, Stancari G, Thangaraj C, Thurman-Keup R, Valishev A, Shiltsev V (2017) IOTA (Integrable Optics Test Accelerator): Facility and experimental beam physics program. J Instrum 12(03):T03002–T03002. https://doi.org/10.1088/1748-0221/12/03/t03002
Audet C, Dennis JE Jr, Le Digabel S (2012) Trade-off studies in blackbox optimization. Optimiz Methods Softw 27(4–5):613–624. https://doi.org/10.1080/10556788.2011.571687
Audet C, Hallé-Hannan E, Digabel SL (2022) A general mathematical framework for constrained mixed-variable blackbox optimization problems with meta and categorical variables. Tech. Rep. 2204.00886, ArXiv . arxiv.org/abs/2204.00886
Audet C, Hare WL (2017). Derivative-Free and Blackbox Optimization. Springer. https://doi.org/10.1007/978-3-319-68913-5
Bagirov A, Karmitsa N, Mäkelä MM (2014) Introduction to Nonsmooth Optimization: Theory. Practice and Software, Springer. https://doi.org/10.1007/978-3-319-08114-4
Büeler B, Enge A (2000) Vinci . www.math.u-bordeaux.fr/~aenge
Chen Y, Dwivedi R, Wainwright MJ, Yu B (2018) Fast MCMC sampling algorithms on polytopes. J Mach Learn Res 19(1):2146–2231
Danilov V, Nagaitsev S (2010) Nonlinear accelerator lattices with one and two analytic invariants. Phys Rev Acceler Beams. https://doi.org/10.1103/PhysRevSTAB.13.084002
Duris J, Kennedy D, Hanuka A, Shtalenkova J, Edelen A, Baxevanis P, Egger A, Cope T, McIntire M, Ermon S, Ratner D (2020) Bayesian optimization of a free-electron laser. Phys Rev Lett 124(12):124801. https://doi.org/10.1103/physrevlett.124.124801
Edelen A, Neveu N, Frey M, Huber Y, Mayes C, Adelmann A (2020) Machine learning for orders of magnitude speedup in multiobjective optimization of particle accelerator systems. Phys Rev Acceler Beams 23(4):044601. https://doi.org/10.1103/physrevaccelbeams.23.044601
Edwards DA, Syphers MJ (1993) An Introduction to the Physics of High Energy Accelerators. Wiley-VCH. https://doi.org/10.1002/9783527617272
Eldred J (2019) Novel approaches to high-power proton beams. In: Proceedings of The 21st international workshop on neutrinos from accelerators vol. 369 pp. 055 https://doi.org/10.22323/1.369.0055
Eldred J, Lebedev V, Valishev A (2019) Rapid-cycling synchrotron for multi-megawatt proton facility at Fermilab. J Instrum 14(07):P07021. https://doi.org/10.1088/1748-0221/14/07/P07021
Eldred J, Valishev A (2017) Space-charge simulation of integrable rapid cycling synchrotron. Proceedings of the 8th international particle accelerator conference https://doi.org/10.18429/JACOW-IPAC2017-THPVA032
Eldred J, Valishev A (2018) Simulation of integrable synchrotron with space-charge and chromatic tune-shifts. In: Proceedings of the 9th international particle accelerator confernece https://doi.org/10.18429/JACOW-IPAC2018-TUPAF073
Fletcher R (1987) Practical methods of optimization, second edn. John Wiley & Sons, USA https://doi.org/10.1002/9781118723203
Huang X (2018) Robust simplex algorithm for online optimization. Phys Rev Acceler Beams. https://doi.org/10.1103/PhysRevAccelBeams.21.104601
Huang X, Safranek J (2014) Nonlinear dynamics optimization with particle swarm and genetic algorithms for SPEAR3 emittance upgrade. Nucl Instrum Methods Phys Res, Sect A 757:48–53. https://doi.org/10.1016/j.nima.2014.04.078
Khachiyan L, Boros E, Borys K, Elbassioni K, Gurvich V (2008) Generating all vertices of a polyhedron is hard. Discrete Computat Geometry 39(1–3):174–190. https://doi.org/10.1007/s00454-008-9050-5
Khan KA (2017) Branch-locking AD techniques for nonsmooth composite functions and nonsmooth implicit functions. Opti Methods Softw 33(4–6):1127–1155. https://doi.org/10.1080/10556788.2017.1341506
Khan KA, Larson J, Wild SM (2018) Manifold sampling for optimization of nonconvex functions that are piecewise linear compositions of smooth components. SIAM J Optim 28(4):3001–3024. https://doi.org/10.1137/17m114741x
Larson J, Menickelly M, Wild SM (2016) Manifold sampling for \(\ell _1\) nonconvex optimization. SIAM J Optim 26(4):2540–2563. https://doi.org/10.1137/15M1042097
Larson J, Menickelly M, Wild SM (2019) Derivative-free optimization methods. Acta Numer 28:287–404. https://doi.org/10.1017/s0962492919000060
Larson J, Menickelly M, Zhou B (2021) Manifold sampling for optimizing nonsmooth nonconvex compositions. SIAM J Optim 31(4):2638–2664. https://doi.org/10.1137/20M1378089
Le Digabel S, Wild SM (2015) A taxonomy of constraints in black-box simulation-based optimization. Preprint ANL/MCS-P5350-0515, Argonne National Laboratory, Mathematics and Computer Science Division (2015-01). http://www.mcs.anl.gov/papers/P5350-0515.pdf
Lebedev V, et al (2017) The PIP-II conceptual design report. Fermilab, Batavia, FERMILAB-TM-2649-AD-APC . pxie.fnal.gov/PIP-II_CDR/PIP-II_CDR_v.0.3.pdf
Lee SY (2011) Accelerator Physics, third edn. World Scientific https://doi.org/10.1142/8335
Li Y, Cheng W, Yu LH, Rainer R (2018) Genetic algorithm enhanced by machine learning in dynamic aperture optimization. Phys Rev Acceler Beams. https://doi.org/10.1103/PhysRevAccelBeams.21.054601
Macridin A, Burov A, Stern E, Amundson J, Spentzouris P (2015) Simulation of transverse modes with their intrinsic landau damping for bunched beams in the presence of space charge. Phys Rev Acceler Beams. https://doi.org/10.1103/PhysRevSTAB.18.074401
Martin LK, Kelliher DJ, Sheehy SL (2019) Can a Paul ion trap be used to investigate nonlinear quasi-integrable optics? J Phys: Conf Ser 1350:012132. https://doi.org/10.1088/1742-6596/1350/1/012132
Mete HO, Zabinsky ZB (2012) Pattern hit-and-run for sampling efficiently on polytopes. Oper Res Lett 40(1):6–11. https://doi.org/10.1016/j.orl.2011.11.002
Michelotti L, Ostiguy JF (2006) CHEF: A framework for accelerator optics and simulation. In: Proceedings of 9th international computational accelerator physics conference, pp. 2–6
Minty MG, Zimmermann F (2003) Measurement and Control of Charged Particle Beams. Springer. https://doi.org/10.1007/978-3-662-08581-3
Nagaitsev S, Lebedev V (2022) A cost-effective rapid-cycling synchrotron. Fermilab, Batavia, Snowmass 2022 White Paper FERMILAB-TM-2767-AD-DI arxiv.org/abs/2111.06932
Nelder JA, Mead R (1965) A simplex method for function minimization. Comput J 7(4):308–313. https://doi.org/10.1093/comjnl/7.4.308
Neveu N, Hudson S, Larson J, Spentzouris L (2019) Comparison of model-based and heuristic optimization algorithms applied to photoinjectors using libEnsemble. In: Proceedings of the 13th international computational accelerator physics conference, pp. 22–24 https://doi.org/10.18429/JACoW-ICAP2018-SAPAF03
Neveu N, Larson J, Power JG, Spentzouris L (2017) Photoinjector optimization using a derivative-free, model-based trust-region algorithm for the Argonne Wakefield Accelerator. J Phys: Conf Ser 874:012062. https://doi.org/10.1088/1742-6596/874/1/012062
Nocedal J, Wright SJ (2006) Numerical Optimization, second edn. Springer . https://doi.org/10.1007/978-0-387-40065-5
Pang X, Rybarcyk L (2014) Multi-objective particle swarm and genetic algorithm for the optimization of the LANSCE linac operation. Nucl Instrum Methods Phys Res, Sect A 741:124–129. https://doi.org/10.1016/j.nima.2013.12.042
Powell MJD (1994) A direct search optimization method that models the objective and constraint functions by linear interpolation. In: S. Gomez, J.P. Hennart (eds.) Advances in Optimization and Numerical Analysis, Mathematics and its Applications, vol. 275, pp. 51–67. Springer . https://doi.org/10.1007/978-94-015-8330-5_4
Ragonneau TM, Zhang Z PDFO: Cross-platform interfaces for Powell’s derivative-free optimization solvers (version 1.0). https://doi.org/10.5281/zenodo.3887569
Roussel R, Hanuka A, Edelen A (2021) Multiobjective Bayesian optimization for online accelerator tuning. Phys. Rev. Accel. Beams 24:062801. https://doi.org/10.1103/PhysRevAccelBeams.24.062801
Ruisard K, Komkov HB, Beaudoin B, Haber I, Matthew D, Koeth T (2019) Single-invariant nonlinear optics for a small electron recirculator. Phys Rev Acceler Beams 22(4):041601. https://doi.org/10.1103/PhysRevAccelBeams.22.041601
Scheinker A, Pang X, Rybarcyk L (2014) Model-independent particle accelerator tuning. Phys Rev Acceler Beams 16(10):10280. https://doi.org/10.1103/PhysRevSTAB.16.102803
Shang H, Borland M (2005) A parallel simplex optimizer and its application to high-brightness storage ring design. In: Proceedings of the 2005 particle accelerator conference, pp. 4230–4232. IEEE . https://doi.org/10.1109/pac.2005.1591774
Shiltsev V (2017) Fermilab proton accelerator complex status and improvement plans. Modern Phys Lett A 32(16) https://doi.org/10.1142/S0217732317300129
Sun Y (2017) Multi-objective online optimization of beam lifetime at APS. In: Proceedings of North American particle accelerator conference, 3, pp. 913–915 . https://doi.org/10.18429/JACoW-NAPAC2016-WEPOB12
Valishev A (2020) Research at FAST/IOTA: Strategy and priorities. IOTA Collaboration Meeting (2020). indico.fnal.gov/event/43231/contributions/187342/attachments/129553/157411/2020-06-15_Strategy_CollaborationMeeting.pdf
Webb S, Cook N, Eldred J (2020) Averaged invariants in storage rings with synchrotron motion. J Instrum 15(12):12032. https://doi.org/10.1088/1748-0221/15/12/p12032
Webb SD, Bruhwiler DL, Abell DT, Sishlo A, Danilov V, Nagaitsev S, Valishev A, Danilov K, Cary JR (2012) Effects of nonlinear decoherence on halo formation. Tech. Rep. 1205.7083, ArXiv . arxiv.org/abs/1205.7083
Webb SD, Bruhwiler DL, Valishev A, Nagaitsev SN, Danilov VV (2015) Chromatic and dispersive effects in nonlinear integrable optics. Tech. Rep. 1504.05981, ArXiv . arxiv.org/abs/1504.05981
Wei J (2003) Synchrotrons and accumulators for high-intensity proton beams. Rev Mod Phys 75(1383):1383–1432. https://doi.org/10.1103/RevModPhys.75.1383
Yang L, Li Y, Guo W, Krinsky S (2011) Multiobjective optimization of dynamic aperture. Phys Rev Acceler Beams. https://doi.org/10.1103/PhysRevSTAB.14.054001
Acknowledgements
We gratefully acknowledge the computing resources provided on Bebop, a high-performance computing cluster operated by the Laboratory Computing Resource Center at Argonne National Laboratory.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
This manuscript is based upon work supported by the applied mathematics and the Scientific Discovery through Advanced Computing (SciDAC) programs of the Office of Advanced Scientific Computing Research, Office of Science, U.S. Department of Energy, under Contract DE-AC02-06CH11357. This manuscript has been authored by Fermi Research Alliance, LLC under Contract DE-AC02-07CH11359 with the U.S. Department of Energy, Office of Science, Office of High Energy Physics. Synergia development has been supported by the Office of Advanced Scientific Computing Research and Office of High Energy Physics SciDAC program.
Rights and permissions
About this article
Cite this article
Eldred, J.S., Larson, J., Padidar, M. et al. Derivative-free optimization of a rapid-cycling synchrotron. Optim Eng 24, 1289–1319 (2023). https://doi.org/10.1007/s11081-022-09733-4
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11081-022-09733-4