Capacity Estimation in HPC Systems: Simulation Approach
As HPC (high performance computing) systems are extensively employed for heavy computational problems throughout heterogeneous environments, the scale and complexity of applications raises the issue of capacity planning. A cardinal aspect of efficiency is the job scheduler in any HPC systems. The job scheduling techniques can worsen or mitigate issues such as job starvation, increased queue time, and decreased system utilization. Since the impact of scheduling techniques is dependent on the workload of a supercomputer, this research proposes to analyze various scheduling disciplines on a given workload. By simulating HPC system, for any given workload, we can find the paradigm that yields the best performance, i.e. minimizing the wait time of jobs in the queue while maximizing resource utilization. Furthermore, given a fixed configuration of a HPC system, this research can be used to determine an appropriate workload that optimizes the system’s performance. The development and implementation of such complex simulation framework for HPC does not yet exist in HPC’s literature. The efficiency of the proposed simulation framework is illustrated through simulation results of performance measures such as average queuing time, average number of jobs in the queue, and system utilization. These results are verified by a developed mathematical model for job load characterization.
Keywordsqueuing disciplines job load characterization model discrete event system simulation average queuing time utilization
Unable to display preview. Download preview PDF.
- 1.OMNeT++ (2010), http://www.omnetpp.org
- 4.Hurst, W.B., Ramaswamy, S., Lenin, R.B., Hoffman, D.: Development of generalized hpc simulator. In: Proc. of Acxiom Laboratory for Applied Research 2010 (2010)Google Scholar
- 5.Iqbal, S., Gupta, S.R., Fang, Y.-C.: Planning considerations for job scheduling in hpc clusters. Dell Power Solutions Magazine, 133–136 (February 2005)Google Scholar
- 6.Jackson, D.B., Jackson, H.L., Snell, Q.O.: Simulation based HPC workload analysis. In: Proc. of International Parallel and Distributed Processing Symposium (2001)Google Scholar
- 8.Lui, H.-L., Shooman, M.L.: Simulation of computer network reliability with congestion. In: Proc. of Annual Reliability and Maintainability Symposium, pp. 208–213 (1999)Google Scholar
- 9.Menascé, D.A., Almeida, V.A.F., Dowdy, L.W.: Capacity Planning and Performance Modeling: From Mainframes to Client-Server Systems. Prentice-Hall, Upper Saddle River (1994)Google Scholar
- 11.Riesen, R.: Simulating a supercomputer. Presentation, Sandia National Laboratories, Wildhaus, Switzerland (March 2008), http://sos12.epfl.ch/riesen.pdf
- 12.Streit, A.: The self-tuning dynp job-scheduler. In: Proc. of the 20th International Parallel and Distributed Processing Symposium, pp. 1530–2075 (2002)Google Scholar