Experimental Astronomy

, Volume 36, Issue 1, pp 59–76

An AIPS-based, distributed processing method for large radio interferometric datasets

  • Stephen Bourke
  • Huib Jan van Langevelde
  • Karl Torstensson
  • Aaron Golden
Original Article

DOI: 10.1007/s10686-012-9315-0

Cite this article as:
Bourke, S., van Langevelde, H.J., Torstensson, K. et al. Exp Astron (2013) 36: 59. doi:10.1007/s10686-012-9315-0

Abstract

The data output rates of modern radio interferometric telescopes make the traditional data reduction process impractical in many cases. We report on the implementation of a lightweight infrastructure, named AIPSLite, that enables the deployment of AIPS interferometric processing routines on distributed systems in an autonomous and fault tolerant manner. We discuss how this approach was used to search for sources of 6.7 GHz methanol maser emission in the Cep A region with the European VLBI Network (EVN). The field was searched out to a radius of 1.25 min−1 at milli-arcsecond spatial resolution and 1024 frequency channels with 0.088 km s−1 velocity resolution. The imaged data was on the order of 30 TB. Processing was performed on 128 processors of the Irish Centre for High End Computing (ICHEC) linux cluster with a run time of 42 h, and a total of 212 CPU days.

Keywords

Interferometry data processingDistributed processingAIPSParselTongueAIPSLite

Copyright information

© Springer Science+Business Media B.V. 2013

Authors and Affiliations

  • Stephen Bourke
    • 1
    • 2
  • Huib Jan van Langevelde
    • 1
  • Karl Torstensson
    • 1
    • 3
  • Aaron Golden
    • 2
  1. 1.Joint Institute for VLBI in EuropeDwingelooThe Netherlands
  2. 2.Centre for AstronomyNational University of IrelandGalwayIreland
  3. 3.Leiden ObservatoryLeiden UniversityLeidenThe Netherlands
  4. 4.Department of AstronomyCalifornia Institute of TechnologyPasadenaUSA
  5. 5.Department of GeneticsAlbert Einstein College of MedicineBronxUSA