Skip to main content

Data-Oriented Distributed Computing for Science: Reality and Possibilities

  • Conference paper
  • 425 Accesses

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 4276))

Abstract

As is becoming commonly known, there is an explosion happening in the amount of scientific data that is publicly available. One challenge is how to make productive use of this data. This talk will discuss some parallel and distributed computing projects, centered around virtual astronomy, but also including other scientific data-oriented realms. It will look at some specific projects from the past, including Montage, Grist, OurOcean, and SCOOP, and will discuss the distributed computing, Grid, and Web-service technologies that have successfully been used in these projects.

An erratum to this chapter can be found at http://dx.doi.org/10.1007/11914952_55.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Stockinger, H.: Defining the Grid: A Snapshot on the Current View. J. of SuperComputing (Spec. Issue on Grid Computing) (Submitted) (June 26, 2006)

    Google Scholar 

  2. Jacob, J.C., Katz, D.S., Berriman, G.B., Good, J., Laity, A.C., Deelman, E., Kesselman, C., Singh, G., Su, M.-H., Prince, T.A., Williams, R.: Montage: A Grid Portal and Software Toolkit for Science-Grade Astronomical Image Mosaicking. Int. J. of Computational Science and Engineering (to appear)

    Google Scholar 

  3. Jacob, J.C., Williams, R., Babu, J., Djorgovski, S.G., Graham, M.J., Katz, D.S., Mahabal, A., Miller, C.D., Nichol, R., Vanden Berk, D.E., Walia, H.: Grist: Grid Data Mining for Astronomy. In: Proc. Astronomical Data Analysis Software & Systems (ADASS), vol. XIV (2004)

    Google Scholar 

  4. Williams, R., Steenberg, C., Bunn, J.: HotGrid: Graduated Access to Grid-based Science Gateways. In: Proc. IEEE SC 2004 Conf. (2004)

    Google Scholar 

  5. Steenberg, C., Bunn, J., Legrand, I., Newman, H., Thomas, M., van Lingen, F., Anjum, A., Azim, T.: The Clarens Grid-enabled Web Services Framework: Services and Implementation. Proc. Comp. for High Energy Phys. (2004)

    Google Scholar 

  6. Li, P., Chao, Y., Vu, Q., Li, Z., Farrara, J., Zhang, H., Wang, X.: OurOcean - An Integrated Solution to Ocean Monitoring and Forecasting. In: Proc. MTS/IEEE Oceans 2006 Conf. (2006)

    Google Scholar 

  7. Hankin, S., Davison, J., Callahan, J., Harrison, D.E., O’Brien, K.: A Configurable Web Server for Gridded Data: a Framework for Collaboration. In: Proc. 14th Int. Conf. on IIPS for Meteorology, Oceanography, and Hydrology, pp. 417–418 (1998)

    Google Scholar 

  8. Bogden, P., Allen, G., Stone, G., Bintz, J., Graber, H., Graves, S., Luettich, R., Reed, D., Sheng, P., Wang, H., Zhao, W.: The Southeastern University Research Association Coastal Ocean Observing and Prediction Program: Integrating Marine Science and Information Technology. In: Proc. MTS/IEEE Oceans 2005 Conf. (2005)

    Google Scholar 

  9. Davis, G.P., Rew, R.K.: The Unidata LDM: Programs and Protocols for Flexible Processing of Data Products. In: Proc. 10th Int. Conf. on IIPS for Meteorology, Oceanography, and Hydrology, pp. 131–136 (1994)

    Google Scholar 

  10. MacLaren, J., Allen, G., Dekate, C., Huang, D., Hutanu, A., Zhang, C.: Shelter from the Storm: Building a Safe Archive in a Hostile World. LNCS, vol. 3752, pp. 294–303 (2005)

    Google Scholar 

  11. Huang, D., Allen, G., Dekate, C., Kaiser, H., Lei, H., MacLaren, J.: getdata: A Grid Enabled Data Client for Coastal Modeling. In: Proc. High Performance Comp. Symp. (2006)

    Google Scholar 

  12. Zhang, C., Dekate, C., Allen, G., Kelley, I., MacLaren, J.: An Application Portal for Collaborative Coastal Modeling. Concurrency and Computation: Practice and Experience 18, 1–11 (2006)

    Article  Google Scholar 

  13. Beckman, P., Nadella, S., Beschastnikh, I., Trebon, N.: SPRUCE: Special PRiority and Urgent Computing Environment. In: University of Chicago DSL Workshop (2006)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2006 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Katz, D.S., Jacob, J.C., Li, P.P., Chao, Y., Allen, G. (2006). Data-Oriented Distributed Computing for Science: Reality and Possibilities. In: Meersman, R., Tari, Z. (eds) On the Move to Meaningful Internet Systems 2006: CoopIS, DOA, GADA, and ODBASE. OTM 2006. Lecture Notes in Computer Science, vol 4276. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11914952_2

Download citation

  • DOI: https://doi.org/10.1007/11914952_2

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-48274-1

  • Online ISBN: 978-3-540-48283-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics