Data-Oriented Distributed Computing for Science: Reality and Possibilities

  • Daniel S. Katz
  • Joseph C. Jacob
  • Peggy P. Li
  • Yi Chao
  • Gabrielle Allen
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4276)

Abstract

As is becoming commonly known, there is an explosion happening in the amount of scientific data that is publicly available. One challenge is how to make productive use of this data. This talk will discuss some parallel and distributed computing projects, centered around virtual astronomy, but also including other scientific data-oriented realms. It will look at some specific projects from the past, including Montage, Grist, OurOcean, and SCOOP, and will discuss the distributed computing, Grid, and Web-service technologies that have successfully been used in these projects.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Stockinger, H.: Defining the Grid: A Snapshot on the Current View. J. of SuperComputing (Spec. Issue on Grid Computing) (Submitted) (June 26, 2006)Google Scholar
  2. 2.
    Jacob, J.C., Katz, D.S., Berriman, G.B., Good, J., Laity, A.C., Deelman, E., Kesselman, C., Singh, G., Su, M.-H., Prince, T.A., Williams, R.: Montage: A Grid Portal and Software Toolkit for Science-Grade Astronomical Image Mosaicking. Int. J. of Computational Science and Engineering (to appear)Google Scholar
  3. 3.
    Jacob, J.C., Williams, R., Babu, J., Djorgovski, S.G., Graham, M.J., Katz, D.S., Mahabal, A., Miller, C.D., Nichol, R., Vanden Berk, D.E., Walia, H.: Grist: Grid Data Mining for Astronomy. In: Proc. Astronomical Data Analysis Software & Systems (ADASS), vol. XIV (2004)Google Scholar
  4. 4.
    Williams, R., Steenberg, C., Bunn, J.: HotGrid: Graduated Access to Grid-based Science Gateways. In: Proc. IEEE SC 2004 Conf. (2004)Google Scholar
  5. 5.
    Steenberg, C., Bunn, J., Legrand, I., Newman, H., Thomas, M., van Lingen, F., Anjum, A., Azim, T.: The Clarens Grid-enabled Web Services Framework: Services and Implementation. Proc. Comp. for High Energy Phys. (2004)Google Scholar
  6. 6.
    Li, P., Chao, Y., Vu, Q., Li, Z., Farrara, J., Zhang, H., Wang, X.: OurOcean - An Integrated Solution to Ocean Monitoring and Forecasting. In: Proc. MTS/IEEE Oceans 2006 Conf. (2006)Google Scholar
  7. 7.
    Hankin, S., Davison, J., Callahan, J., Harrison, D.E., O’Brien, K.: A Configurable Web Server for Gridded Data: a Framework for Collaboration. In: Proc. 14th Int. Conf. on IIPS for Meteorology, Oceanography, and Hydrology, pp. 417–418 (1998)Google Scholar
  8. 8.
    Bogden, P., Allen, G., Stone, G., Bintz, J., Graber, H., Graves, S., Luettich, R., Reed, D., Sheng, P., Wang, H., Zhao, W.: The Southeastern University Research Association Coastal Ocean Observing and Prediction Program: Integrating Marine Science and Information Technology. In: Proc. MTS/IEEE Oceans 2005 Conf. (2005)Google Scholar
  9. 9.
    Davis, G.P., Rew, R.K.: The Unidata LDM: Programs and Protocols for Flexible Processing of Data Products. In: Proc. 10th Int. Conf. on IIPS for Meteorology, Oceanography, and Hydrology, pp. 131–136 (1994)Google Scholar
  10. 10.
    MacLaren, J., Allen, G., Dekate, C., Huang, D., Hutanu, A., Zhang, C.: Shelter from the Storm: Building a Safe Archive in a Hostile World. LNCS, vol. 3752, pp. 294–303 (2005)Google Scholar
  11. 11.
    Huang, D., Allen, G., Dekate, C., Kaiser, H., Lei, H., MacLaren, J.: getdata: A Grid Enabled Data Client for Coastal Modeling. In: Proc. High Performance Comp. Symp. (2006)Google Scholar
  12. 12.
    Zhang, C., Dekate, C., Allen, G., Kelley, I., MacLaren, J.: An Application Portal for Collaborative Coastal Modeling. Concurrency and Computation: Practice and Experience 18, 1–11 (2006)CrossRefGoogle Scholar
  13. 13.
    Beckman, P., Nadella, S., Beschastnikh, I., Trebon, N.: SPRUCE: Special PRiority and Urgent Computing Environment. In: University of Chicago DSL Workshop (2006)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Daniel S. Katz
    • 1
    • 2
  • Joseph C. Jacob
    • 2
  • Peggy P. Li
    • 2
  • Yi Chao
    • 2
  • Gabrielle Allen
    • 1
  1. 1.Center for Computation & Technology, Louisiana State University 
  2. 2.Jet Propulsion Laboratory, California Institute of Technology 

Personalised recommendations