Abstract
Multi-object adaptive optics (MOAO) is a novel adaptive optics (AO) technique dedicated to the special case of wide-field multi-object spectrographs (MOS). It applies dedicated wavefront corrections to numerous independent tiny patches spread over a large field of view (FOV). The control of each deformable mirror (DM) is done individually using a tomographic reconstruction of the phase based on measurements from a number of wavefront sensors (WFS) pointing at natural and artificial guide stars in the field. The output of this study helps the design of a new instrument called MOSAIC, a multi-object spectrograph proposed for the European Extremely Large Telescope (E-ELT). We have developed a novel hybrid pseudo-analytical simulation scheme that allows us to accurately simulate in detail the tomographic problem. The main challenge resides in the computation of the tomographic reconstructor, which involves pseudo-inversion of a large dense symmetric matrix. The pseudo-inverse is computed using an eigenvalue decomposition, based on the divide and conquer algorithm, on multicore systems with multi-GPUs. Thanks to a new symmetric matrix-vector product (SYMV) multi-GPU kernel, our overall implementation scores significant speedups over standard numerical libraries on multicore, like Intel MKL, and up to 60% speedups over the standard MAGMA implementation on 8 Kepler K20c GPUs. At 40,000 unknowns, this appears to be the largest-scale tomographic AO matrix solver submitted to computation, to date, to our knowledge and opens new research directions for extreme scale AO simulations.
Chapter PDF
References
CULA Dense Free Edition, http://www.culatools.com/
Matrix Algebra on GPU and Multicore Architectures. Innovative Computing Laboratory, University of Tennessee, http://icl.cs.utk.edu/magma/
Abdelfattah, A., Dongarra, J., Keyes, D., Ltaief, H.: Optimizing Memory-Bound SYMV Kernel on GPU Hardware Accelerators. In: Daydé, M., Marques, O., Nakajima, K. (eds.) VECPAR. LNCS, vol. 7851, pp. 72–79. Springer, Heidelberg (2013)
Bischof, C.H., Lang, B., Sun, X.: Algorithm 807: The SBR Toolbox—software for successive band reduction. ACM Transactions on Mathematical Software 26(4), 602–616 (2000)
Cuby, J.-G., Morris, S., Fusco, T., Lehnert, M., Parr-Burman, P., Rousset, G., Amans, J.-P., Beard, S., Bryson, I., Cohen, M., Dipper, N., Evans, C., Ferrari, M., Gendron, E., Gimenez, J.-L., Gratadour, D., Hastings, P., Hubert, Z., Hugot, E., Jagourel, P., Laporte, P., Lebrun, V., Le Mignant, D., Madec, F., Myers, R., Neichel, B., Morris, T., Robert, C., Schnetler, H., Swinbank, M., Talbot, G., Taylor, W., Vidal, F., Vivès, S., Vola, P., Welikala, N., Wells, M.: EAGLE: a MOAO fed multi-IFU NIR workhorse for E-ELT. In: Society of Photo-Optical Instrumentation Engineers (SPIE) Conference Series. Society of Photo-Optical Instrumentation Engineers (SPIE) Conference Series, vol. 7735 (July 2010)
Davies, R., Kasper, M.: Adaptive Optics for Astronomy. Annual Review of Astronomy and Astrophysics 50, 305–351 (2012)
Ellerbroek, B.L., Vogel, C.R.: TOPICAL REVIEW: Inverse problems in astronomical adaptive optics. Inverse Problems 25(6), 063001 (2009)
Evans, C., Puech, M., Barbuy, B., Bastian, N., Bonifacio, P., Caffau, E., Cuby, J.-G., Dalton, G., Davies, B., Dunlop, J., Flores, H., Hammer, F., Kaper, L., Lemasle, B., Morris, S., Pentericci, L., Petitjean, P., Schaerer, D., Telles, E., Welikala, N., Ziegler, B.: ELT-MOS White Paper: Science Overview and Requirements. ArXiv e-prints (February 2013)
Gendron, E., Vidal, F., Brangier, M., Morris, T., Hubert, Z., Basden, A., Rousset, G., Myers, R., Chemla, F., Longmore, A., Butterley, T., Dipper, N., Dunlop, C., Geng, D., Gratadour, D., Henry, D., Laporte, P., Looker, N., Perret, D., Sevin, A., Talbot, G., Younger, E.: MOAO first on-sky demonstration with CANARY. Astronomy and Astrophysics 529, L2 (2011)
Gratadour, D., Gendron, E., Rousset, G.: Intrinsic limitations of Shack-Hartmann wavefront sensing on an extended laser guide source. Journal of the Optical Society of America A 27(26), A260000 (2010)
Haidar, A., Ltaief, H., Dongarra, J.: Parallel Reduction to Condensed Forms for Symmetric Eigenvalue Problems using Aggregated Fine-Grained and Memory-Aware Kernels. In: Proceedings of 2011 International Conference for High Performance Computing, Networking, Storage and Analysis, SC 2011, pp. 8:1–8:11. ACM, New York (2011)
Haidar, A., Ltaief, H., Dongarra, J.: Toward a High Performance Tile Divide and Conquer Algorithm for the Dense Symmetric Eigenvalue Problem. SIAM J. Scientific Computing 34(6) (2012)
Intel. Math Kernel Library, http://software.intel.com/en-us/articles/intel-mkl/
Jolissaint, L., Christou, J., Wizinowich, P., Tolstoy, E.: Adaptive optics point spread function reconstruction: lessons learned from on-sky experiment on Altair/Gemini and pathway for future systems. In: Society of Photo-Optical Instrumentation Engineers (SPIE) Conference Series. Society of Photo-Optical Instrumentation Engineers (SPIE) Conference Series, vol. 7736 (July 2010)
Navarro, R., Chemla, F., Bonifacio, P., Flores, H., Guinouard, I., Huet, J.-M., Puech, M., Royer, F., Pragt, J.H., Wulterkens, G., Sawyer, E.C., Caldwell, M.E., Tosh, I.A.J., Whalley, M.S., Woodhouse, G.F.W., Spanò, P., di Marcantonio, P., Andersen, M.I., Dalton, G.B., Kaper, L., Hammer, F.: Project overview of OPTIMOS-EVE: the fibre-fed multi-object spectrograph for the E-ELT. In: Society of Photo-Optical Instrumentation Engineers (SPIE) Conference Series. Society of Photo-Optical Instrumentation Engineers (SPIE) Conference Series, vol. 7735 (July 2010)
Neichel, B., Fusco, T., Conan, J.-M., Petit, C., Rousset, G.: PSD-based simulation algorithm for Wide FoV AO design: application to ELT studies. In: Society of Photo-Optical Instrumentation Engineers (SPIE) Conference Series. Society of Photo-Optical Instrumentation Engineers (SPIE) Conference Series, vol. 7015 (July 2008)
Rigaut, F.J., Veran, J.-P., Lai, O.: Analytical model for Shack-Hartmann-based adaptive optics systems. In: Bonaccini, D., Tyson, R.K. (eds.) Adaptive Optical System Technologies. Society of Photo-Optical Instrumentation Engineers (SPIE) Conference Series, vol. 3353, pp. 1038–1048 (September 1998)
Tan, G., Li, L., Triechle, S., Phillips, E., Bao, Y., Sun, N.: Fast Implementation of DGEMM on Fermi GPU. In: Proceedings of 2011 International Conference for High Performance Computing, Networking, Storage and Analysis, SC 2011, pp. 35:1–35:11. ACM, New York (2011)
Veran, J.-P., Rigaut, F., Maitre, H., Rouan, D.: Estimation of the adaptive optics long-exposure point-spread function using control loop data. Journal of the Optical Society of America A 14, 3057–3069 (1997)
Vidal, F., Gendron, E., Rousset, G.: Tomography approach for multi-object adaptive optics. Journal of the Optical Society of America A 27(26), A260000 (2010)
Yamazaki, I., Dong, T., Solc, R., Tomov, S., Dongarra, J., Schulthess, T.: Tridiagonalization of a dense symmetric matrix on multiple GPUs and its application to symmetric eigenvalue problems. In: Concurrency and Computation: Practice and Experience (2013)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Abdelfattah, A. et al. (2014). High Performance Pseudo-analytical Simulation of Multi-Object Adaptive Optics over Multi-GPU Systems. In: Silva, F., Dutra, I., Santos Costa, V. (eds) Euro-Par 2014 Parallel Processing. Euro-Par 2014. Lecture Notes in Computer Science, vol 8632. Springer, Cham. https://doi.org/10.1007/978-3-319-09873-9_59
Download citation
DOI: https://doi.org/10.1007/978-3-319-09873-9_59
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-09872-2
Online ISBN: 978-3-319-09873-9
eBook Packages: Computer ScienceComputer Science (R0)