Advertisement

Journal of Grid Computing

, Volume 8, Issue 2, pp 323–339 | Cite as

Experiment Dashboard for Monitoring Computing Activities of the LHC Virtual Organizations

  • Julia AndreevaEmail author
  • Max Boehm
  • Benjamin Gaidioz
  • Edward Karavakis
  • Lukasz Kokoszkiewicz
  • Elisa Lanciotti
  • Gerhild Maier
  • William Ollivier
  • Ricardo Rocha
  • Pablo Saiz
  • Irina Sidorova
Article

Abstract

The Large Hadron Collider (LHC) is preparing for data taking at the end of 2009. The Worldwide LHC Computing Grid (WLCG) provides data storage and computational resources for the high energy physics community. Operating the heterogeneous WLCG infrastructure, which integrates 140 computing centers in 33 countries all over the world, is a complicated task. Reliable monitoring is one of the crucial components of the WLCG for providing the functionality and performance that is required by the LHC experiments. The Experiment Dashboard system provides monitoring of the WLCG infrastructure from the perspective of the LHC experiments and covers the complete range of their computing activities. This work describes the architecture of the Experiment Dashboard system and its main monitoring applications and summarizes current experiences by the LHC experiments, in particular during service challenges performed on the WLCG over the last years.

Keywords

WLCG Distributed infrastructure LHC experiments Monitoring 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Evans, L., Bryant, P. (eds): LHC machine. J. Instr. 3:S08001. doi: 10.1088/1748-0221/3/08/S08001 (2008)
  2. 2.
    The ATLAS Computing Group: ATLAS computing technical design report. ATLAS-TDR-017, CERN-LHCC-2005-022 (2005)Google Scholar
  3. 3.
    The CMS Computing Group: CMS computing technical design report. CMS-TDR-007, CERN-LHCC-2005-023 (2005)Google Scholar
  4. 4.
    The ALICE Computing Group: ALICE computing technical design report. CMS-TDR-012, CERN-LHCC-2005-020 (2005)Google Scholar
  5. 5.
    The LHCb Computing Group: LHCb computing technical design report. CMS-TDR-0011, CERN-LHCC-2005-019 (2005)Google Scholar
  6. 6.
    European Organization for Nuclear Research, CERN. http://public.web.cern.ch/public/. Accessed 21 April 2010
  7. 7.
    Shiers, J.: The Worldwide LHC Computing Grid (worldwide LCG), Computer Physics communications, vol. 177, issues 1–2, July 2007, pages 219–223, Proceedings of the Conference on Computational Physics 2006 - CCP (2006)Google Scholar
  8. 8.
    Rehn, J., et al.: PhEDEx high-throughput data transfer management system. In: CHEP06, Conference on Computing in High Energy and Nuclear Physics Proceedings, Mumbai, India, (2006)Google Scholar
  9. 9.
    Tsaregorodsev A., et al.: Dirac: A community Grid solution. In: CHEP07, Conference on Computing in High Energy and Nuclear Physics Proceedings, Victoria, BC, Canada (2007)Google Scholar
  10. 10.
    Nilsson, P.: PanDA system in ATLAS Experiment. ACAT’08, Italy (2008)Google Scholar
  11. 11.
    Saiz, P., et al.: AliEn—ALICE environment on the GRID. Nucl. Instrum. Methods A502, 437–440 (2003)Google Scholar
  12. 12.
  13. 13.
    Laure, E., Fisher, S.M., Frohner, A., Grandi, C., Kunszt, P., et al.: Programming theGrid with gLite. Comput. Methods Sci. Technol. 12(1), 33–45 (2006)Google Scholar
  14. 14.
    Pordes, R., et al.: The open science Grid. J. Phys. Conf. Ser. 78, 012057 (2007)CrossRefGoogle Scholar
  15. 15.
    Eerola, P., et al.: Roadmap for the ARC Grid middleware. PARA LNCS 4699 (2006)Google Scholar
  16. 16.
    CMS Dashboard stats. http://lxarda18.cern.ch/awstats/awstats.pl?config=lxarda18.cern.ch. Accessed 21 April 2010
  17. 17.
    Karmady, R., et al.: GridView: a monitoring and visualization tool. In: CHEP06, Conference on Computing in High Energy and Nuclear Physics Proceedings, Mumbai, India (2006)Google Scholar
  18. 18.
    Martyniak, J., et al.: Real time monitor of Grid job executions. In: CHEP09, Conference on Computing in High Energy and Nuclear Physics Proceedings, Prague, Chech Republic (2009)Google Scholar
  19. 19.
    Ruda, M.: A uniform job monitoring service in multiple job universes. High Performance Distributed Computing, Proceedings of the 2007 workshop on Grid monitoring Monterey, California USA (2007)Google Scholar
  20. 20.
    Collados, D.: Evolution of SAM in an enhanced model for monitoring WLCG services. In: CHEP09, Conference on Computing in High Energy and Nuclear Physics Proceedings, Pargue, Chech Republic (2009)Google Scholar
  21. 21.
    Aiftimiei, C., P, et al.: Using CREAM and CEMON for job submission and management in the gLite middleware. In: CHEP09 Conference Proceedings, Pargue, Chech Republic (2009)Google Scholar
  22. 22.
    Moscicki, J., et al.: Ganga: a tool for computational-task management and easy access to Grid resources. Comput. Phys. Commun. arXiv:0902.2685v1
  23. 23.
    Spiga, D., et al.: The CMS remote analysis builder (CRAB). Lect. Notes Comput. Sci. 4873, 580–586 (2007)CrossRefGoogle Scholar
  24. 24.
    Legrand, I., Newman, H., Cirstoiu, C., Grigoras, C., Toarta, M., Dobre, C.: MonALISA: an agent based, dynamic service system to monitor, controland optimize Grid based applications. In: Proceedings of Computing for High Energy Physics, Interlaken, Switzerland (2004)Google Scholar
  25. 25.
    Casey, J., Rodrigues, D., Schwickerath, U., Silva, R.: Monitoring the efficiency of user jobs. In: CHEP’09: 17th International Conference on Computing in High Energy and Nuclear Physics, Prague, Czech Republic (2009)Google Scholar
  26. 26.
    Metson, S., et al.: CMS offline webtools. In: CHEP’07: Conference on Computing in High Energy and Nuclear Physics Procedings, Victoria, BC, Canada (2007)Google Scholar
  27. 27.
    Schulz, M., et al.: Building the WLCG file transfer service. In: CHEP07: Conference on Computing in High Energy and Nuclear Physics Proceedings, Victoria, BC, Canada (2007)Google Scholar
  28. 28.
    Cooke, W., et al.: The relational Grid monitoring architecture: mediating information about Grid. J. Grid Comput. 2(4), 1–17 (2004)CrossRefGoogle Scholar
  29. 29.
    Thain, D., Tannenbaum, T., Livny, M.: Distributed computing in practice: the condor experience. Concurrency Comput. Pract. Ex. 17(2–4), 323–356 (2005)CrossRefGoogle Scholar
  30. 30.
    Karavkis, E., et al.: CMS dashboard for monitoring of the user analysis activities. In: CHEP’09: 17th International Conference on Computing in High Energy and Nuclear Physics, Prague, Czech Republic (2009)Google Scholar
  31. 31.
    Agrawal, R., Srikant, R.: Fast algorithms for mining association rules in large databases. In: Proceedings of the 20th International Conference on Very Large Data Bases, VLDB, Santiago, Chile, 487–499 (1994)Google Scholar
  32. 32.
    Belforte, S., et al.: The commissioning of CMS sites: improving the site reliability. In: 17th International Conference on Computing in High Energy and Nuclear Physics Proceedings, Prague, Czech Republic (2009)Google Scholar
  33. 33.
    GridMap visualization, http://www.isgtw.org/?pid=1000728. Accessed 21 April 2010
  34. 34.
    Andreozzi, S., et al.: GridICE: a monitoring service for Grid systems. Future Gener. Comput. Syst. 21(4), 559–571 (2005)CrossRefGoogle Scholar
  35. 35.
    Smallen, S., et al.: User-level Grid monitoring with Inca 2. In: High Performance Distributed Computing, Proceedings of the 2007 workshop on Grid monitoring Monterey, California, USA (2007)Google Scholar
  36. 36.
    Andreeva, J., et al.: The experiment dsahboard for medical applications. In: 3rd EGEE User Forum, Clermont-Ferrand, France (2008)Google Scholar
  37. 37.

Copyright information

© Springer Science+Business Media B.V. 2010

Authors and Affiliations

  • Julia Andreeva
    • 1
    Email author
  • Max Boehm
    • 2
  • Benjamin Gaidioz
    • 1
  • Edward Karavakis
    • 1
    • 3
  • Lukasz Kokoszkiewicz
    • 1
  • Elisa Lanciotti
    • 1
  • Gerhild Maier
    • 1
  • William Ollivier
    • 1
  • Ricardo Rocha
    • 1
  • Pablo Saiz
    • 1
  • Irina Sidorova
    • 1
  1. 1.CERNEuropean Organization for Nuclear ResearchGeneva 23Switzerland
  2. 2.Hewlett-PackardRoselsheimGermany
  3. 3.School of Engineering and DesignBrunel UniversityUxbridgeUK

Personalised recommendations