Tailored data compression using stream partitioning and prediction: application to Gaia
- First Online:
- Cite this article as:
- Portell, J., García-Berro, E., Luri, X. et al. Exp Astron (2006) 21: 125. doi:10.1007/s10686-007-9078-1
- 54 Downloads
Gaia is the most ambitious space astrometry mission currently envisaged and it will be a technological challenge in all its aspects. Here we describe a proposal for the data compression system of Gaia, specifically designed for this mission but based on concepts that can be applied to other missions and systems as well. Realistic simulations have been performed with our Telemetry CODEC software, which performs a stream partitioning and pre-compression to the science data. In this way, standard compressors such as bzip2 or szip boost their performance and decrease their processing requirements when applied to such pre-processed data. These simulations have shown that a lossless compression factor of 3 can be achieved, whereas standard compression systems were unable to reach a factor of 2.