Collaborative Interactivity in Parallel HPC Applications

Interactive Computational Steering of Grid Applications
  • M. Riedel
  • W. Frings
  • T. Eickermann
  • S. Habbinga
  • P. Gibbon
  • A. Streit
  • F. Wolf
  • T. Lippert
Conference paper

Abstract

Large-scale scientific research often relies on the collaborative use of massive computational power, fast networks, and large storage capacities provided by e-science infrastructures (e.g., deisa, egee) since the past several years. Especially within e-science infrastructures driven by high-performance computing (hpc) such as deisa, collaborative online visualization and computational steering (covs) has become an important technique to enable hpc applications with interactivity and visualized feedback mechanisms. In earlier work we have shown a prototype covs technique implementation based on the visualization interface toolkit (visit) and the Grid middleware of deisa named as Uniform Interface to Computing Resources (unicore). Since then the approach grew to a broader covs framework. More recently, we investigated the impact of using the computational steering capabilities of the covs framework implementation in unicore on large-scale hpc systems (i.e., ibm BlueGene/P with 65536 processors) and the use of attribute-based authorization. In this chapter we emphasize on the improved collaborative features of the covs framework and present new insights of how we deal with dynamic management of n participants, transparency of Grid resources, and virtualization of hosts of end-users. We also show that our interactive approach to hpc systems fully supports the necessary single sign-on feature required in Grid and e-science infrastructures.

Keywords

Scientific visualization Computational steering COVS VISIT UNICORE 

References

  1. 1.
    J. Cohen, A.S. McGough, J. Darlington, N. Furmento, G. Kong, and A. Mayer. RealityGrid: An integrated approach to middleware through ICENI. Philosophical Transactions of The Royal Society A, 363:1817–1827, 2005.CrossRefGoogle Scholar
  2. 2.
    Th. Eickermann, W. Frings, P. Gibbon, L. Kirtchakova, D. Mallmann, and A. Visser. Steering UNICORE applications with VISIT. Philosophical Transactions of the Royal Society Journal, 2005.Google Scholar
  3. 3.
    I. Foster. Globus Toolkit version 4: Software for Service-Oriented Science. In Proceedings of IFIP International Conference on Network and Parallel Computing, vol. LNCS 3779, pp. 213–223. Springer-Verlag, 2005.Google Scholar
  4. 4.
    German National Grid Initiative D-Grid. http://www.d-grid.de
  5. 5.
    P. Kleijera, E. Nakano, T. Takei, H. Takahara, and A. Yoshida. API for grid based visualization systems. In GGF 12 Workshop on Grid Application Programming Interfaces, 2004.Google Scholar
  6. 6.
    T. Köckerbauer, M. Polak, T. Stütz, and A. Uhl. GVid – Video coding and encryption for advanced grid visualization. In Proceedings of the first Austrian Grid Symposium, Linz, 2005.Google Scholar
  7. 7.
    A. Mayer, S. McGough, N. Furmento, J. Cohen, M. Gulamali, L. Young, A. Afzal, S. Newhouse, and J. Darlington. ICENI: An integrated Grid middleware to support e-Science. Component Models and Systems for Grid Applications, pp. 109–124, 2005.Google Scholar
  8. 8.
    NAREGI Project. http://www.naregi.org
  9. 9.
    S. Pfalzner and P. Gibbon. Many-body Tree Methods in Physics. Cambridge University Press, 1996. ISBN-10: 0521019168.Google Scholar
  10. 10.
    E. Khalisi R. Spurzem. Nbody6 Features of the Computer Code, 2003. http://ftp://ftp.ari.uni-heidelberg.de/pub/staff/spurzem/nb6mpi/nbdoc.tar.gz
  11. 11.
    R. Rateringa, A. Lukichev, M. Riedel, D. Mallmann, A. Vanni, C. Cacciari, S. Lanzarini, K. Benedyczak, M. Borcz, R. Kluszcynski, P. Bala, and G. Ohme. GridBeans: Supporting e-Science and grid applications. In Proceedings of the 2nd IEEE International Conference on e-Science and Grid Computing (e-Science 2006), Amsterdam, 2006.Google Scholar
  12. 12.
    M. Riedel, Th. Eickermann, W. Frings, S. Dominiczak, D. Mallmann, T. Düssel, A. Streit, P. Gibbon, F. Wolf, W. Schiffmann, and Th. Lippert. Design and evaluation of a collaborative online visualization and steering framework implementation for computational grids. In Proceedings of the 8th IEEE/ACM International Conference on Grid Computing, Austin, USA, 2007.Google Scholar
  13. 13.
    M. Riedel, Th. Eickermann, S. Habbinga, W. Frings, P. Gibbon, D. Mallmann, F. Wolf, A. Streit, Th. Lippert, F. Wolf, W. Schiffmann, A. Ernst, R. Spurzem, and W.E. Nagel. Computational steering and online visualization of scientific applications on large-scale HPC systems. In Proceedings of the 3rd IEEE International Conference on e-Science and Grid Computing (e-Science 2007), Bangalore, India, 2007.Google Scholar
  14. 14.
    M. Riedel, W. Frings, S. Dominiczak, Th. Eickermann, T. Düssel, P. Gibbon, D. Mallmann, F. Wolf, and W. Schiffmann. Requirements and design of a collaborative online visualization and steering framework for grid and e-Science infrastructures. In Online Proceedings of German e-Science Conference, Baden-Baden, 2007. http://edoc.mpg.de/display.epl?mode=doc&id=316630&col=100&grp=1414
  15. 15.
    M. Riedel, W. Frings, S. Dominiczak, Th. Eickermann, D. Mallmann, P. Gibbon, and Th. Düssel. VISIT/GS: Higher level grid services for scientific collaborative online visualization and steering in UNICORE grids. In Proceedings of 6th International Symposium on Parallel and Distributed Computing 2007 (ISPDC2007), Linz, Austria, 2007. ISBN 0-7695-2936-4.Google Scholar
  16. 16.
    M. Riedel, W. Frings, S. Habbinga, Th. Eickermann, D. Mallmann, A. Streit, F. Wolf, Th. Lippert, Extending the collaborative online visualization and steering framework for computational grids with attribute-based authorization. In Proceedings of the 9th IEEE/ACM International Conference on Grid Computing (GRID), Tsukuba, Japan, pp. 104–111, 2008.Google Scholar
  17. 17.
    A. Streit, D. Erwin, Th. Lippert, D. Mallmann, R. Menday, M. Rambadt, M. Riedel, M. Romberg, B. Schuller, and Ph. Wieder. UNICORE– From project results to production grids. Grid Computing: The New Frontiers of High Performance Processing, Advances in Parallel Computing, 14:357–376, 2005.CrossRefGoogle Scholar
  18. 18.
    UNICORE Website. http://www.unicore.eu
  19. 19.
    Visualization Interface Toolkit (VISIT). http://www.fz-juelich.de/zam/visit
  20. 20.
    Web Services Resource Framework (WSRF) Technical Committee (OASIS). http://www.oasis-open.org/committees/wsrf
  21. 21.
    B. Wilkinson and M. Allen. Parallel Programming. Prentice Hall, 1999. ISBN 0-13-671710-1.Google Scholar

Copyright information

© Springer Science+Business Media, LLC 2010

Authors and Affiliations

  • M. Riedel
    • 1
  • W. Frings
    • 1
  • T. Eickermann
    • 1
  • S. Habbinga
    • 1
  • P. Gibbon
    • 1
  • A. Streit
    • 1
  • F. Wolf
    • 1
    • 2
  • T. Lippert
    • 1
  1. 1.Forschungszentrum Jülich, Jülich Supercomputing CentreJülichGermany
  2. 2.Department of Computer ScienceRWTH Aachen UniversityAachenGermany

Personalised recommendations