Recent Advances and Research Challenges in Desktop Grid and Volunteer Computing

  • Gilles Fedak
Conference paper


For over a decade, Desktop Grid systems have paved the way to high throughput computing over large scale network of Desktop PCs. Nowadays, the aggregate computing power of the main Volunteer Computing projects shows performance exceeding several PetaFlops . To achieve this outstanding result, many theoretical and experimental projects and researches have investigated on how to take advantage of idle CPU’s and derived the principles of Desktop Grids. After a decade of research in this prolific field of distributed computing science, time has come to survey the recent advances and results as well as understand what are the real challenge and technological issues. In this paper, we present and classify several Desktop Grid systems according to their principles and architectures.We discuss the opportunity for Data Desktop Grid and we present the future trends of this research at the age of Cloud Computing.


Cloud Computing Virtual Machine Desktop Grid Virtual Cluster Volunteer Computing 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    D. Anderson. BOINC: A System for Public-Resource Computing and Storage. In Proceedings of the 5th IEEE/ACM International GRID Workshop, Pittsburgh, USA, 2004. Google Scholar
  2. 2.
    E Cappello, G. Fedak, D. Kondo, P. Malécot, and A. Rezmeffta. Handbook of Research on Scalable Computing Technologies, chapter Desktop Grids: From Volunteer Distñbuted Computing to High Throughput Computing Production Platforms. IGI Global, 2009. Google Scholar
  3. 3.
    Man W. Mutka and Miron Livny. Profiling workstations’ available capacity for remote execution. In Proceedings of Performance-87, The 12th IFIP WG. 7.3 International Symposium on Computer Performance Modeling, Measurement and Evaluation, Brussels, Belgium, 1987. Google Scholar
  4. 4.
    M. Litzkow, M. Livny, and M. Mutka. Condor - A Hunter of Idle Workstations. In Proceedings of the 8th International Conference of Distributed Computing Systems (ICDCS), 1988. Google Scholar
  5. 5.
    D. Ghorniley, D. Petiou, S. Rodrigues, A. Vahdat, and T. Anderson. GLUnix: a Global Layer Unix for a Network of Workstations. Software-Practice and Experience, 28(9), July 1998. Google Scholar
  6. 6.
    A. Barak, S. Guday, and Wheeler R. The MOSIX Distributed Operating System, Load Balancing for UNLV, volume 672 of Lecture Notes in Computer Science. Spffnger-Verlag, 1993. Google Scholar
  7. 7.
    W. T. Sullivan, D. Werthimer, S. Bowyer, J. Cobb, G. Gedye, and D. Anderson. A new major SETI project based on Project Serendip data and 100,000 personal computers. In Proc. of the Fifth Intl. Conf on Bioastronomy, 1997. Google Scholar
  8. 8.
    A. Bamtloo, M. Karaul, Z. Kedem, and P. Wyckoff. Charlotte: Metacomputing on the Web. In Proc. of PDCS-96, 1996. Google Scholar
  9. 9.
    P. Cappello, B. Christiansen, M. lonescu, M. Neary, K. Schauser, and D. Wu. Javelin: Internet- Based Parallel Computing Using Java. In Proceedings of the Sixth ACM SIGPLANSymposium on Principles and Practice of Parallel Programming, 1997. Google Scholar
  10. 10.
    L. Sarmenta. Volunteer Computing. PhD thesis, MIT, March 2001. Google Scholar
  11. 11.
    A. D. Alexandrov, M. Ibel, K. E. Schauser, and C.J. Scheiman. SuperWeb: Towards a Global Web-Based Parallel Computing Infrastructure. In Proc. of the 11th IEEE International Parallel Processing Symposium (IPPS), April 1997. Google Scholar
  12. 12.
    N. Camiel, S. London, N. Nisan, and 0. Regev. The PopCorn Project: Distributed Computation over the Internet in Java. In Proc. of the 6th World Wide Web Conference, April 1997. Google Scholar
  13. 13.
    Gilles Fedak, Cécile Germain, Vincent Néri, and Franck Cappello. XtremWeb: A Generic Global Computing Platform. In Proceedings of 1st IEEE International Symposium on Cluster Computing and the Grid CCGRJD ‘2001, Special Session Global Computing on Personal Devices, pages 582—587, Bffsbane, Australia, May 2001. IEEE/ACM, IEEE Press. Google Scholar
  14. 14.
    Fmnck Cappello, Samir Djilali, Gilles Fedak, Thomas Herault, Frédéric Magniette, Vincent Néri, and Oleg Lodygensky. Computing on Large Scale Distributed Systems: XtremWeb Aithitecture, Prograimning Models, Security, Tests and Convergence with Grid. Future Generation Computer Systems, 21(3):417—437, mar 2005. Google Scholar
  15. 15.
    A. C. Marosi, P. Kacsuk, and G. Fedak. Sandboxing for desktop gffds using virtualization. In To appear in PDP 2010, Nsa, Italy, February 2010. Google Scholar
  16. 16.
    Ian T. Foster and Adriana lamnitchi. On death, taxes, and the convergence of peer-to-peer and gridcomputing. 2735:118—128, 2003. Google Scholar
  17. 17.
    A. Chien, B. Calder, S. Elbert, and K. Bhatia. Entropia: Architecture and Performance of an Enterprise Desktop Grid System. Journal of Parallel and Distributed Computing, 2003. Google Scholar
  18. 18. www .distributed, net. Google Scholar
  19. 19.
    Walfredo Cirne, Francisco Bmsileiro, Nazareno Andrade, Lauro Costa, Alisson Andrade, Reynaldo Novaes, and Miranda Mowbray. Labs of the world, unite! H Journal of Grid Computing, 4(3):225—246, September 2006. Google Scholar
  20. 20.
    J. Pruyne and M. Livny. A Worldwide Flock of Condors Load Sharing among Workstation Clusters . Journal on Future Generations of Computer Systems, 12, 1996. Google Scholar
  21. 21.
    H. Abbes, C. Cérin, and M. Jemni. Pastrygrid: decentralisation of the execution of distributed applications in desktop gffd. In MGC ‘08: Proceedings of the 6th international workshop on Middleware for grid computing, pages 1-6, New York, NY, USA, 2008. ACM. Google Scholar
  22. 22.
    B. Wei, G. Fedak, and E Cappello. Towards Efficient Data Distribution on Computational Desktop Grids with BitTorrent. Future Generation Computer Systems, November 2007. Google Scholar
  23. 23.
    Fernando Costa, Luis Silva, Gilles Fedak, and Ian Kelley. Optimizing Data Distribution in Desktop Grid Platforms. ParallelProcessing Letters, 18(3):391—410, September 2008. Google Scholar
  24. 24.
    C. Mastioianni, P. Cozza, D. Talia, I. Kelley, and I. Taylor. A scalable super-peer appmach for public scientific computation. Future Generation Computer Systems, 25(3):213 —223, 2009. Google Scholar
  25. 25.
    Ian Kelley and Ian Taylor. Bridging the data management gap between service and desktop grids. In Springer, editor, Distributed and Parallel Systems, Hungary, 2008. Google Scholar
  26. 26.
    Atticfs. http: // Google Scholar
  27. 27.
    Atul Adya and all. Faisite: Federated, Available, and Reliable Storage for an Incompletely Trusted Environment. SIGOPS Opei Syst. Rev., 36(SI):1—14, 2002. Google Scholar
  28. 28.
    5. Vazhkudai, V. Freeh X. Ma, J. Strickland, N. Tanimineedi, and S.L. Scott. FreeLoader:Scavenging Desktop Stomge Resouites for Scientific Data. In Proceedings of Supercomputing 2005 (SC’OS), Seattle, 2005. Google Scholar
  29. 29.
    X. Ma, S. S. Vazhkudai, and Z. Zhang. Improving data availability for better access performance: A study on caching scientific data on distributed workstations. Journal of Grid Computing—Special Issue on Volunteer Computing and Desktop Gridc, July 2009. Google Scholar
  30. 30.
    Gilles Fedak, Haiwu He, and Fmnck Cappello. A Data Management and Distribution Service with Multi-Protocol and Reliable File Transfet Journal of Network and Computer Applications, 32(5):961—975, 2009. Google Scholar
  31. 31.
    E. Cesaño, N. Caria, C. Mastroianni, and D. Talia. Distñbuted data mining using a public resoulte computing framework. In Proc. of CoreGrid Workshop, Delft, Nederlands, 2009. Google Scholar
  32. 32.
    Altschul, S. Gish, W. Miller, W. Myers, E.W., and D Lipman. A basic local alignment seawh tool. Journal of Molecular Biology, 215(7):403410, January 1990. Google Scholar
  33. 33.
    Haiwu He, Gilles Fedak, Bing Tran, and Fmnck Cappello. BLAST Application with Data- aware Desktop Grid Middleware. In Proceedings of 9th IEEE International Symposium on Cluster Computing and the Grid CCGRJD’09, pages 284—291, Shanghai, China, May 2009. Google Scholar
  34. 34.
    Bogdan Nicolae, Gabriel Antoniu, and Luc Boug. Enabling high data throughput in desktop grids through decentralized data and metadata management: The blobseer approach. In Proceedings of Euro-Par, Deift, Nederlands, 2009. Google Scholar
  35. 35.
    Samer A1-Kiswany, Matei Ripeanu, Sudharshan Vazhkudai, and Abdullah Gharaibeh. stdchk:A checkpoint storage system for desktop grid computing. In International Conference on Distributed Computing Systems (ICDCS’08), Beijing, China, 2008. Google Scholar
  36. 36.
    Fiipe Amujo, Patricio Domingues, Derrick Kondo, , and Luis Moura Silva. Using cliques of nodes to store desktop grid checkpoints. In Coregrid Integration Workslwp, Crete, Greece, April 2008. Google Scholar
  37. 37.
    Fatiha Bouabache, Thomas Hemult, Gilles Fedak, and Franck Cappello. Hiemrchical Replication Techniques to Ensure Checkpoint Storage Reliability in Grid Environments. In Proceedings of 8th IEEE International Symposium on Cluster Computing and the Grid CCGRID ‘08, pages 475—483, Lyon, France, may 2008. Google Scholar
  38. 38.
    Jeffrey Dean and Sanjay Ghemawat. Mapreduce: Simplified data prccessing on large clusters. pages 137—150, December 2004. Google Scholar
  39. 39.
    Dhruba Borthaku. The ha&op distributedfile system: Architecture and design, 2007. Google Scholar
  40. 40.
    EGEE. Google Scholar
  41. 41.
    Hai Jin. ChinaGrid: Making Grid Computing a Reality. In Lecture Notes in Computer Science, Volume 3334, pages 13—24, Springer-Veralag Berlin Heidelberg, 2004. Google Scholar
  42. 42.
    Amazon EC2. Google Scholar
  43. 43.
    D. S. Myers, A. L. Bazinet, and M. P. Cummings. Expanding the reach of Grid computing:combining Globus- and BOINC-based systems, chapter Grids for Bioinformatics and Computational Biology,. Wiley Book Series on Parallel and Distributed Computing., 2008. Google Scholar
  44. 44.
    Zoltan Balaton, Zoltan Farkas, Gabor Gombas, Peter Kacsuk, Robert Lovas, Attila Csaba Marosi, Ad Enimen, Gabor Terstyanszky, Tamas Kiss, Ian Kelley, Ian Taylor, Oleg Lodygensky, Miguel Cardenas-Montes, Gilles Fedak, and Fiipe Araujo. EDGeS: the Common Boundary Between Service and Desktop Grids. Parallel Processing Letters, 18(3):433—453, September 2008. Google Scholar
  45. 45.
    E. Urbah, P. Kacsuk, Z. Farkas, G. Fedak, G. Kecskemeti, 0. Lodygensky, A. Marosi, Z. Balaton, G. Caillat, G. Gombas, A. Kornafeld, J. Kovacs, H. He, and R. Lovas. EDGeS: Bffdging EGEE to BOINC and XtremWeb. Journal of Grid Computing, 2009. Google Scholar
  46. 46.
    Zoltan Balaton, Gabor Gombas, Peter Kacsuk, Adam Kornafeld, Jozsef Kovacs, Attila Csaba Marosi, Gabor Vida, Norbert Podhorszki, and Tamas Kiss. Sztaki desktop grid: a modular and scalable way of building large computing grids. In Proc. of the 2lth Inte national Parallel and Distributed Processing Symposium, 26-30 March 2007, Long Beach, Caflfomia, USA, 2007. Google Scholar
  47. 47.
    Oleg Lodygensky, Gilles Fedak, Franck Cappello, Vincent Neff, Miron Livny, and Douglas Thain. XtremWeb & Condor: Sharing Resources Between Internet Connected Condor Pools. In Proceedings of CCGRJD ‘2003, Third International Workshop on Global and Peer-to-Peer Computing (GP2PC’03), pages 382—389, Tokyo, Japan, 2003. IEEE/ACM. Google Scholar
  48. 48.
    Douglas Thain and Mimn Livny. Building reliable clients and services. In The GRID2, pages 285—318. Morgan Kaufman, 2004. Google Scholar
  49. 49.
    loan Raicu, Yong Zhao, Catalin Dunfitrescu, Ian Foster, and Mike Wilde. Falkon: a fast and light-weight task execution framework. In IEEE/ACM SuperComputing, 2007. Google Scholar
  50. 50.
    Sfihigoil, 0 Koeroo2, G Venekamp2, D Yocuml, D Groep, and D Petravick. Addressing the Pilot security problem with gLExec. Technical Report FERMILAB-PUB-07-483-CD, Fermi National Laboratory, 2007. Google Scholar
  51. 51.
    Gabriel Caillat, Gilles Fedak, Haiwu He, Oleg Lodygensky, and Etienne Urbah. Towards a Security Model to Bridge Internet Desktop Grids and Service Grids. In Proceedings of the Euro-Par 2008 Workslwps (LNCS), Workslwp on Secure, Trusted, Manageable and Controllable Grid Senices (SGS’08), Las Palmas de Gran Canaria, Spain, August 2008. Google Scholar
  52. 52.
    Dan Nurmi, Rich Wolski, Chris Grzegorczyk, Graziano Obertelli, Sunil Soman, Lamia Youseff, and Dmitrii Zagorodnov. The eucalyptus open-source cloud-computing system. In Cloud Computing and Its Applications works lwp (CCA’08), Chicago, IL, 2008. Google Scholar
  53. 53.
    Gonzalez DL. Gil G.G. de Vega F.F. Segal B. Centralized boinc resources manager for institutional networks. IPDPS 2008, pages 1—8, 2008. Google Scholar
  54. 54.
    Lhc@home. http:/ Google Scholar
  55. 55.
    Boinc and atlas. Google Scholar
  56. 56.
    P. Ruth, P. Mcgachey, , and Dongyan Xu. Viocluster : Virtualization for dynamic computational domains. In IEEE International Conference on Cluster Computing, Tsukuba, Japan, 2005. Google Scholar
  57. 57.
    Affjit Ganguly, Abhishek Agrawal, P. Oscar Boykin, and Renato J. 0. Figueiredo. Wow : Selforganizing wide area overlay networks of virtual workstations. In In HPDCIS : Proceedings of the 15th IEEE International Sympo- sium on High Performance Distributed Computing, Paris, France, 2006. Google Scholar
  58. 58.
    Ala Rezmerita, Tangui Morlier, Vincent Neff, and Franck Cappello. Private virtual cluster infrastructure and protocol for instant gffds. In Proc. of the Int. Euro-Par Conf on Parallel Processing (Euro-Par 2006), Dresden, Germany, 2006. Google Scholar

Copyright information

© Springer US 2010

Authors and Affiliations

  1. 1.LIP/INRIA Rhône-Alpes  

Personalised recommendations