Experimental Astronomy

, Volume 21, Issue 3, pp 125–149

Tailored data compression using stream partitioning and prediction: application to Gaia

  • Jordi Portell
  • Enrique García-Berro
  • Xavier Luri
  • Alberto G. Villafranca
Original article

DOI: 10.1007/s10686-007-9078-1

Cite this article as:
Portell, J., García-Berro, E., Luri, X. et al. Exp Astron (2006) 21: 125. doi:10.1007/s10686-007-9078-1

Abstract

Gaia is the most ambitious space astrometry mission currently envisaged and it will be a technological challenge in all its aspects. Here we describe a proposal for the data compression system of Gaia, specifically designed for this mission but based on concepts that can be applied to other missions and systems as well. Realistic simulations have been performed with our Telemetry CODEC software, which performs a stream partitioning and pre-compression to the science data. In this way, standard compressors such as bzip2 or szip boost their performance and decrease their processing requirements when applied to such pre-processed data. These simulations have shown that a lossless compression factor of 3 can be achieved, whereas standard compression systems were unable to reach a factor of 2.

Keywords

Instrumentation: miscellaneous Methods: data analysis Techniques: miscellaneous Astrometry 

PACS

07.87.+v 95.40.+s 95.55.Pe 95.10.Jk 95.80.+p 07.05.Hd 

Copyright information

© Springer Science+Business Media B.V. 2007

Authors and Affiliations

  • Jordi Portell
    • 1
    • 3
  • Enrique García-Berro
    • 2
    • 3
  • Xavier Luri
    • 1
    • 3
  • Alberto G. Villafranca
    • 2
    • 3
  1. 1.Departament d’Astronomia i Meteorologia, Facultat de FísicaUniversitat de BarcelonaBarcelonaSpain
  2. 2.Departament de Física Aplicada, Escola Politècnica Superior de CastelldefelsUniversitat Politècnica de CatalunyaCastelldefelsSpain
  3. 3.Institut d’Estudis Espacials de Catalunya (IEEC)BarcelonaSpain

Personalised recommendations