High Throughput Comparison of Prokaryotic Genomes
This work handles the optimization of the grid computing performances for a data-intensive and high ”throughput” comparison of protein sequences. We use the word ”throughput” from the telecommunication science to mean the amount of concurrent independent jobs in grid. All the proteins of 355 completely sequenced prokaryotic organisms were compared to find common traits of prokaryotic life, producing in parallel tens of Gigabytes of information to store, duplicate, check and analyze. For supporting a large amount of concurrent runs with data access on shared storage devices and a manageable data format, the output information was stored in many flat files according to a semantic logical/physical directory structure. As many concurrent runs could cause reading bottleneck on the same storage device, we propose methods to optimize the grid computing based on the balance between wide data access and emergence of reading bottlenecks. The proposed analytical approach has the following advantages: not only it optimizes the duration of the overall task, but also checks if the estimated duration is compliant with the scientific requirements and if the related grid computing is really advantageous compared to an execution on a local farm.
KeywordsVirtual Organization Prokaryotic Genome Service Probability Blast Comparison Blast Output
Unable to display preview. Download preview PDF.
- 7.Foster, I., Kesselman, C., Tuecke, S.: The Anatomy of the Grid: Enabling Scalable Virtual Organizations. International J. Supercomputer Applications 15(3) (2001), http://www.globus.org/alliance/publications/papers/anatomy.pdf
- 8.Foster, I., Kesselman, C., Tuecke, S.: The Physiology of the Grid: An Open Grid Services Architecture for Distributed Systems Integration. Open Grid Service Infrastructure WG, Global Grid Forum (June 22, 2002), http://www.globus.org/alliance/publications/papers/ogsa.pdf
- 9.gLite - Lightweight Middleware for Grid Computing, http://glite.web.cern.ch/glite/
- 10.gLite User Guide. Data Management,107:130, https://edms.cern.ch/file/722398/1.1/gLite-3-UserGuide.pdf
- 11.Altshul, S.F., Gish, W., Myers, E.W., Lipman, D.J.: Basic local alignment search tool. J. Mol. Biol. 215, 403–410 (1990)Google Scholar
- 12.EGEE User s Guide. WMS Proxy Service, https://edms.cern.ch/file/674643/1/WMPROXY-guide.pdf
- 13.EGEE User s Guide. JDL Attributes Specification (submission via WMS WMProxy), https://edms.cern.ch/file/590869/1/EGEE-JRA1-TEC-590869-JDL-Attributes-v0-8.pdf