Abstract
Reconfiguration is a key feature characteristic of the LOFAR telescope. Software platforms are utilised to program out the required data transformations in the generation of scientific end-products. Reconfigurable resources nowadays often replace the hard-wired processing systems from the past. This paper describes how this paradigm is implemented in a purely general-purpose telescope back-end. Experiences from high performance computing, stream processing and software engineering have been combined, leading to a state-of-the-art processing platform. The processing platform offers a total processing power of 35 TFlops, which is used to process a sustained input data- stream of 320 Gbps. The architecture of this platform is optimised for streaming data processing and offers appropriate processing resources for each step in the data processing chains. Typical data processing chains include Fourier transformations and correlation tasks along with controlling tasks such as fringe rotation correction. These tasks are defined in a high level programming language and mapped onto the available resources at run time. A scheduling system is used to control a collection of concurrently executing observations, providing each associated application with the appropriate resources to meet its timing constraint and give the integrated system the correct on-line and off-line look and feel.
Similar content being viewed by others
References
Adiga, N.R., et al.: 2002, An Overview of the BlueGene/L Supercomputer, Proceedings of SC2002, http://sc-2002.org/paperpdfs/pap.pap207.pdf.
Butcher, H.R.: 2004, Proc. SPIE 5489, 537.
Clos, C.: 1953, Bell Syst. Tech. J. 32, 406.
de Vos, C.M., Schaaf, K.v.d. and Bregman, J.D.: 2001, Cluster Computers and Grid Processing in the First Radio-Telescope of a New Generation, Proceedings of IEEE CCGrid.
Hellwagner, H. and Reinefeld, A.: 1999, Sci: Scalable Coherent Interface: Architecture and Software for High-Performance Compute Clusters, Springer-Verlag, ISBN 3540666966.
Leiserson, C.E.: 1985, October, Fat-Trees: IEEE Trans. Comput. 34, 892.
Noordam, J.E.: 2004, Proc. SPIE 5489, 817.
Silva, L.M.E. and Buyya, R.: 1999, Parallel Programing Models and Paradigms, chapter 1 of High Performance Cluster Computing, Vol. 2, R. Buyya, Prentice Hall PTR 1999, ISBN 0130137855.
Snir, M.: 1998, MPI: The Complete Reference, MIT press, ISBN 0262692163.
Schaaf, K.v.d., Bregman, J.D. and de Vos, C.M.: 2003a, Hybrid Cluster Computing Hardware and Software in the LOFAR Radio Telescope, Proceedings of PDPTA, CSREA Press.
Schaaf, K.v.d., Bregman, J.D. and de Vos, C.M.: 2003b, Hybrid Cluster Computing Hardware and Software in the LOFARRadio Telescope, Proceedings of IEEE PDPTA.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Van Der Schaaf, K., Broekema, C., Van Diepen, G. et al. The Lofar Central Processing Facility Architecture. Exp Astron 17, 43–58 (2004). https://doi.org/10.1007/s10686-005-2865-7
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.1007/s10686-005-2865-7