Computational Infrastructure and Basic Data Analysis for High-Throughput Sequencing

Abstract

Next-generation sequencing requires enormous computational infrastructure resources. A single sequencing run can generate up to 100 gigabases of sequence and requires almost 3 terabytes of data storage. In order to transfer and analyze data on this scale, the data infrastructure must be up to the task. There are many solutions to creating this infrastructure. Local servers and data storage can be purchased and installed by the group, which is using the sequencing instrument. Communal resources at the home institution can be used to create the necessary infrastructure, or newer external cloud-based solutions can be used to store and analyze data. Each sequencing platform has slightly different infrastructure requirements, and the IT solution must be tailored to the systems in use or generalized to cover all possible instruments. The majority of installed instruments are based on Illumina technology with a smaller portion being ABI or 454. What is presented here is a solution that is generalized for any instrument, including not just the IT requirements but the bioinformatics requirements as well.