JobCenter: an open source, cross-platform, and distributed job queue management system optimized for scalability and versatility
Laboratories engaged in computational biology or bioinformatics frequently need to run lengthy, multistep, and user-driven computational jobs. Each job can tie up a computer for a few minutes to several days, and many laboratories lack the expertise or resources to build and maintain a dedicated computer cluster.
JobCenter is a client–server application and framework for job management and distributed job execution. The client and server components are both written in Java and are cross-platform and relatively easy to install. All communication with the server is client-driven, which allows worker nodes to run anywhere (even behind external firewalls or “in the cloud”) and provides inherent load balancing. Adding a worker node to the worker pool is as simple as dropping the JobCenter client files onto any computer and performing basic configuration, which provides tremendous ease-of-use, flexibility, and limitless horizontal scalability. Each worker installation may be independently configured, including the types of jobs it is able to run. Executed jobs may be written in any language and may include multistep workflows.
JobCenter is a versatile and scalable distributed job management system that allows laboratories to very efficiently distribute all computational work among available resources. JobCenter is freely available at http://code.google.com/p/jobcenter/.
- Altschul, SF, Gish, W, Miller, W, Myers, EW, Lipman, DJ (1990) Basic local alignment search tool. J Mol Biol 215: pp. 403-410
- Perkins, DN, Pappin, DJ, Creasy, DM, Cottrell, JS (1999) Probability-based protein identification by searching sequence databases using mass spectrometry data. Electrophoresis 20: pp. 3551-3567 CrossRef
- Yates, JR, Eng, JK, Mc Cormack, AL (1995) Mining genomes: correlating tandem mass spectra of modified and unmodified peptides to sequences in nucleotide databases. Anal Chem 67: pp. 3202-3210 CrossRef
- Deutsch, EW, Mendoza, L, Shteynberg, D, Farrah, T, Lam, H, Tasman, N, Sun, Z, Nilsson, E, Pratt, B, Prazen, B (2010) A guided tour of the Trans-Proteomic Pipeline. Proteomics 10: pp. 1150-1159 CrossRef
- Reynolds, SM, Kall, L, Riffle, ME, Bilmes, JA, Noble, WS (2008) Transmembrane topology and signal peptide prediction using dynamic bayesian networks. PLoS Comput Biol 4: pp. e1000213 CrossRef
- Lipman, DJ, Pearson, WR (1985) Rapid and sensitive protein similarity searches. Science 227: pp. 1435-1441 CrossRef
- Riffle, M, Davis, TN (2010) The Yeast Resource Center Public Image Repository: A large database of fluorescence microscopy images. BMC Bioinformatics 11: pp. 263 CrossRef
- Riffle, M, Malmstrom, L, Davis, TN (2005) The Yeast Resource Center Public Data Repository. Nucleic Acids Res 33: pp. D378-D382 CrossRef
- JobCenter: an open source, cross-platform, and distributed job queue management system optimized for scalability and versatility
- Open Access
- Available under Open Access This content is freely available online to anyone, anywhere at any time.
Source Code for Biology and Medicine
- Online Date
- July 2012
- Online ISSN
- BioMed Central
- Additional Links
- Computational biology
- Job management
- Grid computing
- Job scheduler
- Batch processing