Skip to main content

Result Error Detection on Heterogeneous and Volatile Resources Via Intermediate Checkpointing

  • Chapter
Making Grids Work
  • 272 Accesses

Abstract

Desktop grids use the free resources in Intranet and Internet environments for large-scale computation and storage. While desktop grids offer tremendous computational power and a high return on investment, one critical issue is the validation of results returned by participating hosts that are volatile, anonymous, and potentially malicious. We conduct a benefit analysis of a mechanism for result validation that we proposed recently for the detection of errors in longrunning applications. This mechanism is based on using the digest of intermediate checkpoints, and we show in theory and simulation that the relative benefit of this method compared to the state-of-the-art is as high as 45%.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. EINSTEN@home. http://einstein.phys.uwm.edu.

  2. B. Allen, C. An, and T. Rattel. Personal communications, April 2006.

    Google Scholar 

  3. D. Anderson. Boinc: A system for public-resource computing and storage. In Proceedings of the 5th IEEE/ACM International Workshop on Grid Computing, Pittsburgh, USA, 2004.

    Google Scholar 

  4. F. Araujo, P. Domingues, D. Kondo, and L. M. Silva. Validating Desktop Grid Results By Comparing Intermediate Checkpoints. Submitted to 2nd Coregrid Integration Workshop, 2006.

    Google Scholar 

  5. T. Aven. Upper (lower) bounds on the mean of the maximum (minimum) of a number of random variables. Journal of Applied Probability, 22:723-728, 1985.

    Article  MATH  MathSciNet  Google Scholar 

  6. Catalog of boinc projects.http://boinc-wiki.ath.cx/index.php?title=Catalog\_of\_BOINC\_Powered\_Projects.

  7. H. Hartely and H. David. Universal bounds for mean range and extreme observations. The Annals of Mathematical Statistics, 25:85-89, 1954.

    Article  Google Scholar 

  8. D. Kondo, M. Taufer, C. Brooks, H. Casanova, and A. Chien. Characterizing and Eval-uating Desktop Grids: An Empirical Study. In Proceedings of the IPDPS’04, April 2004.

    Google Scholar 

  9. M. Litzkow, M. Livny, and M. Mutka. Condor - A Hunter of Idle Workstations. In Pro-ceedings of the 8th International Conference of Distributed Computing Systems (ICDCS), 1988.

    Google Scholar 

  10. P. Malecot, D. Kondo, and G. Fedak. Xtremlab: A system for characterizing internet desk-top grids (abstract). In in Proceedings of the 6th IEEE Symposium on High-Performance Distributed Computing, 2006.

    Google Scholar 

  11. A. Oltean. How to do atomic writes in a file. http://blogs.msdn.com/adioltean/archive/2005/12/28/507866.aspx, December 2005.

  12. R. Rivest. RFC-1321 The MD5 Message-Digest Algorithm. Network Working Group,IETF, April 1992.

    Google Scholar 

  13. M. Shirts and V. Pande. Screen Savers of the World, Unite! Science, 290:1903-1904,2000.

    Article  Google Scholar 

  14. W. T. Sullivan, D. Werthimer, S. Bowyer, J. Cobb, G. Gedye, and D. Anderson. A new major SETI project based on Project Serendip data and 100,000 personal computers. In Proc. of the Fifth Intl. Conf. on Bioastronomy, 1997.

    Google Scholar 

  15. M. Taufer, D. Anderson, P. Cicotti, and C. L. B. III. Homogeneous redundancy: a technique to ensure integrity of molecular simulation results using public computing. In Proceedings of the International Heterogeneity in Computing Workshop, 2005.

    Google Scholar 

  16. D. Kondo, F. Araujo, P. Domingues, P. Malecot, G. Fedak, F. Cappello Characterization Error Rates on Internet Desktop Grids. To appear in Proceedings of Euro-Par, 2007.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

Copyright information

© 2008 Springer Science+Business Media, LLC

About this chapter

Cite this chapter

Derrick, K., Filipe, A., Silva, L., Domingues, P. (2008). Result Error Detection on Heterogeneous and Volatile Resources Via Intermediate Checkpointing. In: Making Grids Work. Springer, Boston, MA. https://doi.org/10.1007/978-0-387-78448-9_19

Download citation

  • DOI: https://doi.org/10.1007/978-0-387-78448-9_19

  • Publisher Name: Springer, Boston, MA

  • Print ISBN: 978-0-387-78447-2

  • Online ISBN: 978-0-387-78448-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics