Compressing Genomic Sequence Fragments Using SlimGene

  • Christos Kozanitis
  • Chris Saunders
  • Semyon Kruglyak
  • Vineet Bafna
  • George Varghese
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6044)


With the advent of next generation sequencing technologies, the cost of sequencing whole genomes is poised to go below $1000 per human individual in a few years. As more and more genomes are sequenced, analysis methods are undergoing rapid development, making it tempting to store sequencing data for long periods of time so that the data can be re-analyzed with the latest techniques. The challenging open research problems, huge influx of data, and rapidly improving analysis techniques have created the need to store and transfer very large volumes of data.

Compression can be achieved at many levels, including trace level (compressing image data), sequence level (compressing a genomic sequence), and fragment-level (compressing a set of short, redundant fragment reads, along with quality-values on the base-calls). We focus on fragment-level compression, which is the pressing need today.

Our paper makes two contributions, implemented in a tool, SlimGene. First, we introduce a set of domain specific loss-less compression schemes that achieve over 40× compression of fragments, outperforming bzip2 by over 6×. Including quality values, we show a 5× compression using less running time than bzip2. Second, given the discrepancy between the compression factor obtained with and without quality values, we initiate the study of using ‘lossy’ quality values. Specifically, we show that a lossy quality value quantization results in 14× compression but has minimal impact on downstream applications like SNP calling that use the quality values. Discrepancies between SNP calls made between the lossy and lossless versions of the data are limited to low coverage areas where even the SNP calls made by the lossless version are marginal.


Compression Scheme Personal Health Record Lossy Compression Generation Sequencing Technology Illumina Genome Analyzer 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Bellamy, J.C.: Digital Telephony, vol. 3rd. Wiley, Chichester (2000)Google Scholar
  2. 2.
    Brandon, M.C., Wallace, D.C., Baldi, P.: Data structures and compression algorithms for genomic sequence data. Bioinformatics 25, 1731–1738 (2009)CrossRefGoogle Scholar
  3. 3.
    The CASAVA software toolkit,
  4. 4.
    Chen, X., Li, M., Ma, B., Tromp, J.: DNACompress: fast and effective DNA sequence compression. Bioinformatics 18, 1696–1698 (2002)CrossRefGoogle Scholar
  5. 5.
    Christley, S., Lu, Y., Li, C., Xie, X.: Human genomes as email attachments. Bioinformatics 25, 274–275 (2009)CrossRefGoogle Scholar
  6. 6.
    Dublin, M.: So Long, Data Depression (2009),
  7. 7.
    Feuk, L., Carson, A.R., Scherer, S.W.: Structural variation in the human genome. Nat. Rev. Genet. 7(2), 85–97 (2006)CrossRefGoogle Scholar
  8. 8.
    Helicos Biosciences,
  9. 9.
    Iafrate, A.J., Feuk, L., Rivera, M.N., Listewnik, M.L., Donahoe, P.K., Qi, Y., Scherer, S.W., Lee, C.: Detection of large-scale variation in the human genome. Nat. Genet. 36(9), 949–951 (2004)CrossRefGoogle Scholar
  10. 10.
    The Illumina Genome Analyzer,
  11. 11.
    Li, H., Handsaker, B., Wysoker, A., Fennell, T., Ruan, J., Homer, N., Marth, G., Abecasis, G., Durbin, R.: The Sequence Alignment/Map format and SAMtools. Bioinformatics 25, 2078–2079 (2009)CrossRefGoogle Scholar
  12. 12.
    Li, M., Badger, J.H., Chen, X., Kwong, S., Kearney, P., Zhang, H.: An information-based sequence distance and its application to whole mitochondrial genome phylogeny. Bioinformatics 17, 149–154 (2001)CrossRefGoogle Scholar
  13. 13.
  14. 14.
    Newman, T.L., Tuzun, E., Morrison, V.A., Hayden, K.E., Ventura, M., McGrath, S.D., Rocchi, M., Eichler, E.E.: A genome-wide survey of structural variation between human and chimpanzee. Genome Res. 15(10), 1344–1356 (2005)CrossRefGoogle Scholar
  15. 15.
  16. 16.
    Roche 454 Sequencing,
  17. 17.
  18. 18.
    Sharp, A.J., Cheng, Z., Eichler, E.E.: Structural variation of the human genome. Annu. Rev. Genomics Hum. Genet. (June 2006)Google Scholar
  19. 19.
    Steven, E.A., Mccanne, S., Vetterli, E.: A Layered Dct Coder For Internet Video. In: Proceedings of the IEEE International Conference on Image Processing, pp. 13–16 (1996)Google Scholar
  20. 20.
    Ziv, J., Lempel, A.: Compression of Individual Sequences Via Variable-Rate Coding. IEEE Transactions on Information Theory (1978)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2010

Authors and Affiliations

  • Christos Kozanitis
    • 1
  • Chris Saunders
    • 2
  • Semyon Kruglyak
    • 2
  • Vineet Bafna
    • 1
  • George Varghese
    • 1
  1. 1.University of California San DiegoLa JollaUSA
  2. 2.Illumina IncSan DiegoUSA

Personalised recommendations