Abstract
Tera-scale high-performance computing has enabled scientists to tackle very large and computationally challenging scientific problems, making the advancement of scientific discovery at a faster pace. However, as computing scales to levels never seen before, it also becomes extremely data intensive, I/O intensive, and energy consuming. Amongst these, I/O is becoming a major bottleneck, impeding the expected pace of scientific discovery and analysis of data. Furthermore, the applications are becoming increasingly dynamic in terms of their computation patterns as well as data access patterns to cope with larger problems and data sizes. Due to the complexities of systems and applications and their high energy consumptions, it is, therefore, very important to address research issues and develop dynamic techniques at the level of run-time systems and compilers to scale I/O in the right proportions. This paper presents the details of a dynamic compilation framework developed specifically for I/O-intensive large-scale applications. Our dynamic compilation framework includes a set of powerful I/O optimizations designed to minimize execution cycles and energy consumption, and generates results that are competitive with hand-optimized codes in terms of energy consumption.
This work is supported by NSF grants #0444158, #0406340, #0093082 and a grant from GSRC.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Chase, J., Anderson, D., Thackar, P., Vahdat, A., Boyle, R.: Managing Energy and Server Resources in Hosting Centers. In: Proc. of the 18th Symposium on Operating Systems Principles, October 2001, pp. 103–116 (2001)
Chase, J., Doyle, R.: Balance of Power: Energy Management for Server Clusters. In: Proc. of the 8th Workshop on Hot Topics in Operating Systems, May 2001, p. 165 (2001)
Chen, L.T., Drach, R., Keating, M., Louis, S., Rotem, D., Shoshani, A.: Efficient Organization and Access of Multi-Dimensional Datasets on Tertiary Storage Systems. Information Systems Journal 20(2), 155–183 (1995)
Chen, L.T., Drach, R., Keating, M., Louis, S., Rotem, D., Shoshani, A.: Optimizing Tertiary Storage Organization and Access for Spatio-Temporal Datasets. In: Proc. of the NASA Goddard Conference on Mass Storage Systems (1995)
Choudhary, A., Thakur, R., Bordawekar, R., More, S., Kutipidi, S.: PASSION: Optimized Parallel I/O. IEEE Computer (June 1996)
Choudhary, A., Bordawekar, R., Harry, M., Krishnaiyer, R., Ponnusamy, R., Singh, T., Thakur, R.: PASSION: Parallel and Scalable Software for Input-Output. NPAC Technical Report SCCS-636, Syracuse, NY (September 1994)
Coyne, R.A., Hulen, H., Watson, R.: The High-Performance Storage System. In: Proc. of Supercomputing, Portland, OR (November 1993)
Darema, F.: Dynamic Data Driven Applications Systems: A New Paradigm for Application Simulations and Measurements. In: Bubak, M., van Albada, G.D., Sloot, P.M.A., Dongarra, J. (eds.) ICCS 2004. LNCS, vol. 3038, pp. 662–669. Springer, Heidelberg (2004)
Darema, F.: Dynamic Data Driven Applications Systems: New Capabilities for Application Simulations and Measurements. In: Sunderam, V.S., van Albada, G.D., Sloot, P.M.A., Dongarra, J. (eds.) ICCS 2005. LNCS, vol. 3515, pp. 610–615. Springer, Heidelberg (2005)
Gibson, G., Van Meter, R.: Network Attached Storage Architecture. Communications of the ACMÂ 43(11) (November 2000)
Memik, G., Kandemir, M., Choudhary, A.: APRIL: A Run-Time Library for Tape Resident Data. In: Proc. of the NASA Goddard Conference on Mass Storage Systems and Technologies, Baltimore, MD (April 2000)
Seamons, K.E., Chen, Y., Jones, P., Jozwiak, J., Winslett, M.: Server-Directed Collective I/O in Panda. In: Proc. of Supercomputing, San Diego, CA (December 1995)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Son, S.W., Chen, G., Kandemir, M., Choudhary, A. (2006). Dynamic Compilation for Reducing Energy Consumption of I/O-Intensive Applications. In: Ayguadé, E., Baumgartner, G., Ramanujam, J., Sadayappan, P. (eds) Languages and Compilers for Parallel Computing. LCPC 2005. Lecture Notes in Computer Science, vol 4339. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-69330-7_32
Download citation
DOI: https://doi.org/10.1007/978-3-540-69330-7_32
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-69329-1
Online ISBN: 978-3-540-69330-7
eBook Packages: Computer ScienceComputer Science (R0)