Abstract
Although clusters usually represent a single large resource for grid computing, most of the time they are utilized as individual resources for desktop grids. This chapter presents a lightweight, fault-tolerant approach for connecting firewalled already deployed clusters for desktop grid computing. It allows to easily offer cluster resources for desktop grids without requiring a large administrative overhead of connecting them separately. Our approach uses Condor for cluster management and an extended version of BOINC to connect those resources across the Internet or wide area networks. We describe security considerations and present our security model for the system and sharing resources. We present running projects where our solution is being used to utilize already deployed clusters requiring low effort from administrators.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
ADMEToxGrid. http://www.admetoxgrid.hu/
D.P. Anderson. BOINC: A system for public-resource computing and storage. In R. Buyya, editor, Fifth IEEE/ACM International Workshop on Grid Computing, pp. 4–10. IEEE Computer Society, 2004.
D.P. Anderson, J. Cobb, E. Korpela, M. Lebofsky, and D. Werthimer. SETI@home: An experiment in public-resource computing. Communications of the ACM, 45(11):56–61, November 2002.
Z. Balaton, Z. Farkas, G. Gombás, P. Kacsuk, R. Lovas, A.C. Marosi, A. Emmen, G. Terstyánszky, T. Kiss, I. Kelley, I. Taylor, O. Lodygensky, M. Cardenas-Montes, G. Fedak, and F. Araujo. EDGeS: The common boundary between service and desktop grids. Accepted for publication at the CoreGRID Integration Workshop 2008, Hersonissos-Crete, Greece, 2008.
Z. Balaton, G. Gombás, P. Kacsuk, Á. Kornafeld, A.C. Marosi, G. Vida, N. Podhorszki, and T. Kiss. SZTAKI desktop grid: A modular and scalable way of building large computing grids. In Workshop on Large-Scale and Volatile Desktop Grids, PCGrid 2007, 2007.
Project BinSYS. http://compalg.inf.elte.hu/projects/binsys/
F. Cappello, S. Djilali, G. Fedak, T. Herault, F. Magniette, V. Neri, and O. Lodygensky. Computing on large-scale distributed systems: XtremWeb architecture, programming models, security, tests and convergence with grid. Future Generation Computer Systems, 21(3): 417–437, 2005.
F. Costa, L. Silva, I. Kelley, and G. Fedak. Optimizing the data distribution layer of BOINC with BitTorrent. Accepted for publication at the Second Workshop on Desktop Grids and Volunteer Computing Systems (PCGrid), Miami, USA, 2008.
Z. Farkas, R. Lovas, and P. Kacsuk. CancerGrid: Enterprise desktop grid solution with workflow support for anti-cancer drug design. Proceedings of the Cracow Grid Workshop 2007, 2008.
P. Kacsuk, N. Podhorszki, and T. Kiss. Scalable desktop grid system. High Performance Computing for Computational Science – VECPAR 2006, pp. 27–38, 2007.
LHC@home. http://lhcathome.cern.ch/lhcathome/
O. Lodygensky, G. Fedak, F. Cappello, V. Neri, M. Livny, and D. Thain. XtremWeb & Condor : sharing resources between Internet connected Condor pool. Cluster Computing and the Grid, 2003. Proceedings. CCGrid 2003. 3rd IEEE/ACM International Symposium on, pp. 382–389, 2003.
A.C. Marosi, G. Gombas, Z. Balaton, P. Kacsuk, and T. Kiss. SZTAKI desktop grid: Building a scalable, secure platform for desktop grid computing. CoreGRID Workshop on Grid Programming Model Grid and P2P Systems Architecture Grid Systems, Tools and Environments, Heraklion – Crete, Greece, June 2007.
C. O’Donnell. Condor and firewalls. University of Wisconsin-Madison. http:// www.cs.wisc.edu/condor/, 2002.
J. G. Pedersen and C. U. Sottrup. Developing Distributed Computing Solutions Combining Grid Computing and Public Computing. M.sc., University of Copenhagen, 2005.
S. Son and M. Livny. Recovering internet symmetry in distributed computing. In Proceedings of the 3rd International Symposium on Cluster Computing and the Grid, Tokyo, Japan, May 2003.
Superlink@EGEE. http://cbl-link02.cs.technion.ac.il/cplan/
SZTAKI Desktop Grid. http://www.desktopgrid.hu/
D. Thain, T. Tannenbaum, and M. Livny. Condor and the grid. In F. Berman, A. Hey, and G. Fox, editors, Grid Computing – Making the Global Infrastructure a Reality, Chapter 11. John-Wiley & Sons, Ltd., 2003.
D. Wright. BOINC and Condor – Scavenging the Scavenger. 2nd Pan-Galactic BOINC Workshop, 2006.
Acknowledgments
The research and development published in this chapter is supported by the European Commission under contract numbers LSHC-CT-2006-037559 (FP6 STREP, CancerGrid), IST-2002-004265 (FP6 NoE, CoreGRID), and RI-211727 (FPF7 IST Capacities, EDGeS).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer Science+Business Media, LLC
About this paper
Cite this paper
Marosi, A., Balaton, Z., Kacsuk, P., Drótos, D. (2010). SZTAKI Desktop Grid: Adapting Clusters for Desktop Grids. In: Davoli, F., Meyer, N., Pugliese, R., Zappatore, S. (eds) Remote Instrumentation and Virtual Laboratories. Springer, Boston, MA. https://doi.org/10.1007/978-1-4419-5597-5_12
Download citation
DOI: https://doi.org/10.1007/978-1-4419-5597-5_12
Published:
Publisher Name: Springer, Boston, MA
Print ISBN: 978-1-4419-5595-1
Online ISBN: 978-1-4419-5597-5
eBook Packages: EngineeringEngineering (R0)