Abstract
The influences of OS and system-specific effects on application performance are increasingly important in high performance computing. In this regard, OS kernel measurement is necessary to understand the interrelationship of system and application behavior. This can be viewed from two perspectives: kernel-wide and process-centric. An integrated methodology and framework to observe both views in HPC systems using OS kernel measurement has remained elusive. We demonstrate a new tool called KTAU (Kernel TAU) that aims to provide parallel kernel performance measurement from both perspectives. KTAU extends the TAU performance system with kernel-level monitoring, while leveraging TAU’s measurement and analysis capabilities. As part of the ZeptoOS scalable operating systems project, we report early experiences using KTAU in ZeptoOS on the IBM BG/L system.
Chapter PDF
Similar content being viewed by others
References
KTAU / ZeptoOS Integration. http://www.cs.uoregon.edu/research/ktau/docs.php
Sgi kernprof. http://oss.sgi.com/projects/kernprof/
TAU: Tuning and Analysis Utilities. http://www.cs.uoregon.edu/research/paracomp/tau/
ZeptoOS: The Small Linux for Big Computers, http://www.mcs.anl.gov/zeptoos/
Gara, A., et al.: Overview of the Blue Gene/L system architecture. IBM Journal of Research and Development 49(2/3), 195–212 (2005)
Mirgorodskiy, A., et al.: Crosswalk: A tool for performance profiling across the user-kernel boundary
Tamches, A., et al.: Fine-grained dynamic instrumentation of commodity operating system kernels. In: Operating Systems Design and Implementation (1999)
Cantrill, B.M., et al.: Dynamic instrumentation of production systems. In: Proceedings of the 2004 USENIX Annual Technical Conference, Boston, MA, USA (2004)
Petrini, F., et al.: The case of the missing supercomputer performance: Achieving optimal performance on the 8,192 processors of ASCI Q. In: SC 2003: Proceedings of the 2003 ACM/IEEE conference on Supercomputing, Washington, DC, USA (2003)
Moreira, J.E., et al.: Blue Gene/L programming and operating environment. IBM Journal of Research and Development 49(2/3), 367–376 (2005)
Yaghmour, K., et al.: Measuring and characterizing system behavior using kernel-level event logging. In: USENIX 2000: Proceedings of the 2000 USENIX Annual Technical Conference, Boston, MA, USA (2000)
Adiga, N.R., et al.: An overview of the Blue Gene/L supercomputer. In: SC 2002: Proceedings of the 2002 ACM/IEEE conference on Supercomputing (2002)
Wisniewski, R.W., et al.: Efficient, unified, and scalable performance monitoring for multiprocessor operating systems
Sharma, S., et al.: A Framework for Analyzing Linux System Overheads on HPC Applications. In: LACSI 2005: Proceedings of the 2005 Los Alamos Computer Science Institute Symposium, Santa Fe, NM, USA (2005)
Jones, T., et al.: Improving the scalability of parallel jobs by adding parallel awareness to the operating system. In: SC 2003: Proceedings of the 2003 ACM/IEEE conference on Supercomputing, Washington, DC, USA (2003)
Nagel, W.E., et al.: VAMPIR: Visualization and analysis of MPI resources. Supercomputer 12(1), 69–80 (1996)
Etsion, Y., et al.: Fine Grained Kernel Logging with KLogger: Experience and Insights
Ruan, Y., et al.: Making the “Box” Transparent: System Call Performance as a First-class Result. In: USENIX 2004: Proceedings of the 2004 USENIX Annual Technical Conference, Boston, MA, USA (2004)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Nataraj, A., Malony, A.D., Morris, A., Shende, S. (2006). Early Experiences with KTAU on the IBM BG/L. In: Nagel, W.E., Walter, W.V., Lehner, W. (eds) Euro-Par 2006 Parallel Processing. Euro-Par 2006. Lecture Notes in Computer Science, vol 4128. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11823285_11
Download citation
DOI: https://doi.org/10.1007/11823285_11
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-37783-2
Online ISBN: 978-3-540-37784-9
eBook Packages: Computer ScienceComputer Science (R0)