Skip to main content

Parameter Space Exploration Using Scientific Workflows

  • Conference paper

Part of the Lecture Notes in Computer Science book series (LNTCS,volume 5544)

Abstract

In recent years there has been interest in performing parameter space exploration across “scientific workflows”, however, many existing workflow tools are not well suited to this. In this paper we augment existing systems with a small set of special “actors” that implement the parameter estimation logic. Specifically, we discuss a set of new Kepler actors that support both complete and partial sweeps based on experimental design techniques. When combined with a novel parallel execution mechanism, we are able to execute parallel sweeps and searches across workflows that run on distributed “Grid” infrastructure. We illustrate our new system with a case study in cardiac cell modelling.

Keywords

  • distributed workflows
  • parameter exploration
  • Kepler

References

  1. Foster, I., Kesselman, C.: The Grid: Blueprint for a New Computing Infrastructure. Morgan Kaufmann, San Francisco (1999)

    Google Scholar 

  2. Foster, I., Kesselman, C.: Globus: A Metacomputing Infrastructure Toolkit. Int’l J. of Supercomputer Applications 11(2), 115–128 (1997)

    Google Scholar 

  3. The Globus Toolkit, http://www-unix.globus.org/toolkit/

  4. Abramson, D., Giddy, J., Kotler, L.: High Performance Parametric Modeling with Nimrod/G: Killer Application for the Global Grid. In: Int’l. Parallel and Distributed Processing Symposium (IPDPS), Cancun, Mexico (2000)

    Google Scholar 

  5. Kepler Project, http://kepler-project.org

  6. Ludäscher, B., Altintas, I., Berkley, C., Higgins, D., Jaeger-Frank, E., Jones, M., Lee, E., Tao, J., Zhao, Y.: Scientific Workflow Management and the Kepler System. In: Concurrency and Computation: Practice & Experience, Special Issue on Scientific Workflows (2005)

    Google Scholar 

  7. Altintas, I., Birnbaum, A., Baldridge, K., Sudholt, W., Miller, M., Amoreira, C., Potier, Y., Ludaescher, B.: A Framework for the Design and Reuse of Grid Workflows. In: Herrero, P., Pérez, M.S., Robles, V. (eds.) SAG 2004. LNCS, vol. 3458, pp. 120–133. Springer, Heidelberg (2005)

    CrossRef  Google Scholar 

  8. Altintas, I., Berkley, C., Jaeger, E., Jones, M., Ludäscher, B., Kepler, M.S.: Towards a Grid-Enabled System for Scientific Workflows. In: the Workflow in Grid Systems Workshop in GGF10 - The 10th Global Grid Forum, Berlin (2004)

    Google Scholar 

  9. Taverna Project, http://taverna.sourceforge.net

  10. Yu, J., Buyya, R.: A Taxonomy of Workflow Management Systems for Grid Computing. Technical Report GRIDS-TR-2005-1, Grid Computing and Distributed Systems Laboratory, Univ. of Melbourne (2005)

    Google Scholar 

  11. Box, G.E., Hunter, W.G., Hunter, J.S.: Statistics for Experimenters. Wiley, Chichester (1978)

    MATH  Google Scholar 

  12. Amirriazi, S., Chang, S., Peachey, T., Abramson, D., Michailova, A.: Optimizing Cardiac Excitation-Metabolic Model By Using Parallel Grid Computing. In: Biophysics 2008, Long Beach, California (2008)

    Google Scholar 

  13. Daniel, C.: Applications of Statistics to Industrial Experimentation. Wiley, Chichester (1976)

    CrossRef  Google Scholar 

  14. Lenth, R.V.: Quick and Easy Analysis of Unreplicated Factorials. Technometrics 31, 469–473 (1989)

    MathSciNet  CrossRef  Google Scholar 

  15. Hunter, P.J., Kohl, P., Noble, D.: Integrative Models of the Heart: Achievements and Limitations. Philosophical Transactions of the Royal Society of London: Mathematical, Physical and Engineering Sciences, 2001, 10.1098/rsta.2001.0816 (2001)

    Google Scholar 

  16. Michailova, A., Lorentz, W., McCulloch, A.: Modelling Transmural Heterogeneity of KATP current in Rabbit Ventricular Myocytes. AJP-Cell Physiology, 293, C542–C557 (2007)

    Google Scholar 

  17. Amirriazi, A., Chang, S., Peachey, T., Abramson, D., Michailova, A.: Optimizing Cardiac Excitation-Metabolic Model By Using Parallel Grid Computing. In: Biophysics 2008, Long Beach, California (February 2008)

    Google Scholar 

  18. Abramson, D., Enticott, C., Altinas, I.: Nimrod/K: Towards Massively Parallel Dynamic Grid Workflows. In: IEEE Supercomputing 2008, Austin, Texas (November 2008)

    Google Scholar 

  19. Taylor, I., Shields, M., Wang, I.: Resource Management of Triana P2P Services. In: Grid Resource Management. Kluwer, Netherlands (2003)

    Google Scholar 

  20. Abramson, D., Lewis, A., Peachey, T., Fletcher, C.: An Automatic Design Optimization Tool and its Application to Computational Fluid Dynamics. In: SuperComputing 2001, Denver (November 2001)

    Google Scholar 

  21. Peachey, T.C., Diamond, N.T., Abramson, D.A., Sudholt, W., Michailova, A., Amirriazi, S.: Fractional Factorial Design for Parameter Sweep Experiments using Nimrod/E. Journal of Scientific Programming 16(2,3) (2008)

    Google Scholar 

  22. Message Lab list of current and former e-Science projects, http://www.messagelab.monash.edu.au/EScienceApplications

  23. Lynch, A.H., Abramson, D., Beringer, K.J., Uotila, P.: Influence of savanna fire on Australian monsoon season precipitation and circulation as simulated using a distributed computing environment. Geophys. Res. Lett. 34, L20801 (2007)

    CrossRef  Google Scholar 

  24. Sher, A., Abramson, D., Enticott, C., Garic, S., Gavaghan, D., Noble, D., Noble, P., Peachey, T.: Incorporating local Ca2+ dynamics into single cell ventricular models using Nimrod/O. In: Bubak, M., van Albada, G.D., Dongarra, J., Sloot, P.M.A. (eds.) ICCS 2008, Part I. LNCS, vol. 5101, pp. 66–75. Springer, Heidelberg (2008)

    CrossRef  Google Scholar 

  25. Sudholt, W., Baldridge, K., Abramson, D., Enticott, C., Garic, S.: Parameter Scan of an Effective Group Difference Pseudopotential Using Grid Computing. New Generation Computing 22, 125–135 (2004)

    CrossRef  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and Permissions

Copyright information

© 2009 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Abramson, D., Bethwaite, B., Enticott, C., Garic, S., Peachey, T. (2009). Parameter Space Exploration Using Scientific Workflows. In: Allen, G., Nabrzyski, J., Seidel, E., van Albada, G.D., Dongarra, J., Sloot, P.M.A. (eds) Computational Science – ICCS 2009. Lecture Notes in Computer Science, vol 5544. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-01970-8_11

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-01970-8_11

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-01969-2

  • Online ISBN: 978-3-642-01970-8

  • eBook Packages: Computer ScienceComputer Science (R0)