JobCenter: an open source, cross-platform, and distributed job queue management system optimized for scalability and versatility
Laboratories engaged in computational biology or bioinformatics frequently need to run lengthy, multistep, and user-driven computational jobs. Each job can tie up a computer for a few minutes to several days, and many laboratories lack the expertise or resources to build and maintain a dedicated computer cluster.
JobCenter is a client–server application and framework for job management and distributed job execution. The client and server components are both written in Java and are cross-platform and relatively easy to install. All communication with the server is client-driven, which allows worker nodes to run anywhere (even behind external firewalls or “in the cloud”) and provides inherent load balancing. Adding a worker node to the worker pool is as simple as dropping the JobCenter client files onto any computer and performing basic configuration, which provides tremendous ease-of-use, flexibility, and limitless horizontal scalability. Each worker installation may be independently configured, including the types of jobs it is able to run. Executed jobs may be written in any language and may include multistep workflows.
JobCenter is a versatile and scalable distributed job management system that allows laboratories to very efficiently distribute all computational work among available resources. JobCenter is freely available at http://code.google.com/p/jobcenter/.
- Altschul SF, Gish W, Miller W, Myers EW, Lipman DJ: Basic local alignment search tool. J Mol Biol 1990,215(3):403–410.
- Perkins DN, Pappin DJ, Creasy DM, Cottrell JS: Probability-based protein identification by searching sequence databases using mass spectrometry data. Electrophoresis 1999,20(18):3551–3567. CrossRef
- Yates JR 3rd, Eng JK, Mc Cormack AL: Mining genomes: correlating tandem mass spectra of modified and unmodified peptides to sequences in nucleotide databases. Anal Chem 1995,67(18):3202–3210. CrossRef
- Deutsch EW, Mendoza L, Shteynberg D, Farrah T, Lam H, Tasman N, Sun Z, Nilsson E, Pratt B, Prazen B, et al.: A guided tour of the Trans-Proteomic Pipeline. Proteomics 2010,10(6):1150–1159. CrossRef
- Reynolds SM, Kall L, Riffle ME, Bilmes JA, Noble WS: Transmembrane topology and signal peptide prediction using dynamic bayesian networks. PLoS Comput Biol 2008,4(11):e1000213. CrossRef
- Lipman DJ, Pearson WR: Rapid and sensitive protein similarity searches. Science 1985,227(4693):1435–1441. CrossRef
- Riffle M, Davis TN: The Yeast Resource Center Public Image Repository: A large database of fluorescence microscopy images. BMC Bioinformatics 2010, 11:263. CrossRef
- Riffle M, Malmstrom L, Davis TN: The Yeast Resource Center Public Data Repository. Nucleic Acids Res 2005,33(Database issue):D378-D382. CrossRef
- JobCenter: an open source, cross-platform, and distributed job queue management system optimized for scalability and versatility
- Open Access
- Available under Open Access This content is freely available online to anyone, anywhere at any time.
Source Code for Biology and Medicine
- Online Date
- July 2012
- Online ISSN
- BioMed Central
- Additional Links
- Computational biology
- Job management
- Grid computing
- Job scheduler
- Batch processing