A Low-Cost Solution to Distribute Repetitive and Independent Tasks by Clustering
This paper evaluates three different solutions to distribute a list of independent tasks among the nodes of a cluster of computers. Operative systems are unable to take advantage of modern multicore or multiprocessor based computers in the execution of this kind of work when it is not paralellized, thus, the availability of a software tool that allows the concurrent use of a set of computers can be very useful in terms of reduction of the execution time and efficiency.
The three solutions have been evaluated using a set of tasks related to the implementation of digital electronic circuits in Field Programmable Gate Arrays (FPGAs), but they can be applied to any other set of independent tasks.
The results have been obtained using a cluster composed by four relatively old and low performance computers, and have been compared with the results obtained by a quad-core processor based computer executing the same task list in a purely sequential way. This comparison clearly shows the power of concurrent execution, that allows a reduction of execution time by a factor between three and four.
KeywordsField Programmable Gate Array Digital Circuit Task List Independent Task Remote Object
Unable to display preview. Download preview PDF.
- 1.Lucke, R.W.: Building Clustered Linux Systems. Prentice Hall (2004)Google Scholar
- 2.Ma Ángeles Cifredo Chacón: Un procedimiento para la verificación y clasificación priorizada de FPGAs de bajo coste ante aplicaciones sectoriales electrónicas. PhD Thesis (2010)Google Scholar
- 3.Gaj, K., Kaps, J.-P., et al.: ATHENa Automated Tool for Hardware EvaluatioN: Toward Fair and Comprehensive Benchmarking of Cryptographic Algorithms using FPGAsGoogle Scholar
- 4.Irmen de Jong, Pyro Documentation (2011), http://packages.python.org/Pyro/
- 5.Ben-Ari: M. Concurrent and Distributed Programming. Prentice Hall (1990)Google Scholar
- 6.Message Passing Interface Forum (2011), http://www.mpi-forum.org/
- 7.Thor Program Web, https://forja.rediris.es/projects/thor/