Skip to main content

Modeling Grids in (Near) Real Time

  • Conference paper
  • 764 Accesses

Abstract

A Grid is a family of technologies for dynamically and opportunistically provisioning computing power from a pool of resources. Some experts believe that Grids are the next stage in the evolution of distributed systems. Enterprise-level Grids are beginning to be deployed, and researchers are investigating a number of novel Grid applications and services in Grid testbeds. Production-grade commercial Grids are expected to be large and widely-distributed systems.

Grids are enormously complex computing systems. They have large numbers of geographically dispersed resources at their disposal, and they lack some characteristics of earlier computing systems that simplified the analysis of those systems — e.g., homogeneous and closely-coupled components, low-latency communications paths, global state maintenance, and deterministic controls. Performance analysts have very little understanding of the dynamic behavior of Grid components at different layers and at different time scales, and of the complex interactions among Grid components — functionally, spatially, and temporally.

We describe an architecture for a scalable, modular, configurable, plug-and-play, “Grid-in-a-lab” tool for modeling Grids, and for analyzing the performance of applications and middleware services offered on Grids. The tool addresses all of the components that are relevant to Grid performance — hardware, middleware, infrastructure, services, applications, traffic — and the complex interrelationships among the components. It uses a novel combination of modeling techniques — e.g., analytical models with closed form expressions, discrete event simulation, emulators for protocol stacks and resource scheduling, rare event simulation methods, and measurement-based optimization. The tool’s components are modular and configurable so as to provide different degrees of fidelity over a range of time scales, and to provide insight about Grid dynamics and interactions among various components, applications, and services.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   169.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Agrawal S., “NetSolve: Past, Present, and Future; A Look at a Grid Enabled Server,” in Berman F. et al. (eds.), Grid Computing: Making the Global Infrastructure a Reality, Wiley, March 2003.

    Google Scholar 

  2. Allcock, B. et al., “Protocols and Services for Distributed Data-Intensive Science.” ACAT 2000 Proceedings, pp. 161–163, 2000.

    Google Scholar 

  3. Allcock B. et al., “High-Performance Remote Access to Climate Simulation Data: A Challenge Problem for Data Grid Technologies.” Proc. SC 2001, November 2001.

    Google Scholar 

  4. Allcock, B. et al., “Secure, Efficient Data Transport and Replica Management for High-Performance Data-Intensive Computing.” Proc. IEEE Mass Storage Conf., 2001.

    Google Scholar 

  5. Allen G. et al., “Supporting Efficient Execution in Heterogeneous Distributed Computing Environments with Cactus and Globus.” Proc. SC 2001, November 2001.

    Google Scholar 

  6. Allen G. et al., “The Cactus Worm: Experiments with Dynamic Resource Selection and Allocation in a Grid Environment.” Intl. J. High-Performance Computing Applications, Vol. 15(4) 2001.

    Google Scholar 

  7. Allcock, B. et al., “Data Management and Transfer in High Performance Computational Grid Environments.” Parallel Computing Journal, Vol. 28(5), May 2002.

    Google Scholar 

  8. Allcock W. et al., “Grid Mapper: A Tool for Visualizing the Behavior of Large-Scale Distributed Systems.” Proc. 11th IEEE Intl. Symp. on High Performance Distributed Computing (HPDC-11), July 2002.

    Google Scholar 

  9. Allen G., “Classifying and Enabling Grid Applications,” in Berman F. et al. (eds.), Grid Computing: Making the Global Infrastructure a Reality, Wiley, March 2003.

    Google Scholar 

  10. Allcock, W. et al., “Reliable Data Transport: A Critical Service for the Grid.” Building Service Based Grids Workshop, Global Grid Forum 11, June 2004.

    Google Scholar 

  11. Angulo, D. et al., “Design and Evaluation of a Resource Selection Framework for Grid Applications.” Proc. IEEE Intl. Symp. on High Performance Distributed Computing (HPDC-11), Edinburgh, July 2002.

    Google Scholar 

  12. Angulo, D. et al., “Toward a Framework for Preparing and Executing Adaptive Grid Programs.” IPDPS, 2002.

    Google Scholar 

  13. Atkinson M., “Towards a Grid Architecture Roadmap”, in Berman F. et al. (eds.), Grid Computing: Making the Global Infrastructure a Reality, Wiley, March 2003.

    Google Scholar 

  14. Au, P. et al., “Coordinating heterogeneous parallel computation,” Proc. EuroPar Conf. Berlin, 1996.

    Google Scholar 

  15. Baxevanidis K. et al., “Grids and Research Networks as Drivers and Enablers of Future Internet Architectures.” Computer Networks, 2002.

    Google Scholar 

  16. Baskett F. et al., “Open, closed and mixed networks of queues with different classes of customers”, J. ACM, 22:248–260, 1975.

    Article  MATH  MathSciNet  Google Scholar 

  17. Berman F. et al., “The GrADS Project: Software Support for High-Level Grid Application Development.” Intl. J. High-Performance Computing Applications, 15(4), 2002.

    Google Scholar 

  18. Berman, F. and R. Wolski, “The AppLeS Project: a status report.” Proc NEC Symp. On Metacomputing, 1997.

    Google Scholar 

  19. Benger W. et al., “Numerical Relativity in a Distributed Environment.” Ninth SIAM Conf. on Parallel Processing for Scientific Computing, April 1999.

    Google Scholar 

  20. Bester, J. et al., “A Data Movement and Access Service for Wide Area Computing Systems.” Sixth Workshop on I/O in Parallel and Distributed Systems, May 1999.

    Google Scholar 

  21. Berman, F., “High-Performance Schedulers”, in Foster and Kesselman (eds.), The Grid: Blueprint for a New Computing Infrastructure, Morgan-Kaufman, San Francisco, 1999.

    Google Scholar 

  22. Blythe, J. et al., “Planning for Workflow Construction and Maintenance on the Grid.” ICAPS 2003 Workshop on Planning for Web Services, 2003.

    Google Scholar 

  23. Bolla, R. et al., “Hybrid analytical/simulation mechanism for access control and on-line bandwidth optimization in diffserv environments”, Proc. PlanetIP Workshop, Courmayer Italy, January 2002.

    Google Scholar 

  24. Bourne P. and K. Baldridge, “The New Biology and the Grid,” in Berman F. et al. (eds.), Grid Computing: Making the Global Infrastructure a Reality, Wiley, March 2003.

    Google Scholar 

  25. Bragg A. “Simulations with self-similar traffic models.” In Ince A. (ed.). Modeling and Simulation Environments for Satellite and Terrestrial Communication Networks. September 2000. Kluwer.

    Google Scholar 

  26. Bragg A., et al. “Improving the performance of IP traffic over ATM networks”. Proc. World Telecommunications Congress XVII. Birmingham UK. May 2000.

    Google Scholar 

  27. Brady, M. et al., “eDiamond: a Grid-enabled federated database of annotated mammograms,” in Berman F. et al. (eds.), Grid Computing: Making the Global Infrastructure a Reality, Wiley, March 2003.

    Google Scholar 

  28. Bragg A., H. Perros and M. Devetsiokis. “An Architectural Framework and Tool for Modeling Grids”. Proc. SCS Spring Simulation Multiconf (ATS). San Diego CA. April 2005.

    Google Scholar 

  29. Bruell, S., Computational Algorithms for Closed Queuing Networks, Elsevier, 1980.

    Google Scholar 

  30. Bragg A. and W. Chou. “Traffic analysis for high-speed networks.” Proc. IEEE Globecom’ 91. Phoenix AZ. December 1991.

    Google Scholar 

  31. Bragg A. and W. Chou. “Analytic models and characteristics of video traffic in high-speed networks.” Proc. IEEE Second Intl. MASCOTS’ 94. January 1994.

    Google Scholar 

  32. Bragg A. and W. Chou. “The locality and transitional behavior of ARIMA network traffic models.” Proc. IEEE Third ICCCN’ 94. San Francisco CA. September 1994.

    Google Scholar 

  33. Bragg A. and W. Chou. “Real-time forecasting of bandwidth demand in high-speed communications networks.” Proc. 29th Conf. on Information Sciences and Systems (CISS’ 95). Baltimore MD. March 1995.

    Google Scholar 

  34. Bragg A. and W. Chou. “Real-time computation of empirical autocorrelation, and detection of non-stationary traffic conditions in high-speed networks.” Proc. IEEE Fourth ICCCN’ 95. September 1995.

    Google Scholar 

  35. Bresnahan, J. et al., “Communication Services for Advanced Network Applications.” Proc. Intl. Conf. on Parallel and Distributed Processing Techniques and Applications 1999, Las Vegas, June 1999.

    Google Scholar 

  36. Brown M. et al., “The Intl. Grid (iGrid): Empowering Global Research Community Networking Using High Performance Intl. Internet Services.” iGrid, April 1999.

    Google Scholar 

  37. Buyya R. and M. Murshed, “GridSim: A Toolkit for the Modeling and Simulation of Distributed Resource Management and Scheduling for Grid Computing,” J. Concur. and Computation (CCPE), 14(13), 2002.

    Google Scholar 

  38. Bunn J., “Data Intensive Grids for High Energy Physics,” in Berman F. et al. (eds.), Grid Computing: Making the Global Infrastructure a Reality, Wiley, March 2003.

    Google Scholar 

  39. Buzen, J. “Fundamental Operational Laws of Computer System Performance,” Acta Informatica 7,2, 1976.

    Article  MathSciNet  Google Scholar 

  40. Buzen, J., “Operational Derivations of some Basic Results in Queuing Theory”, Proc. Int. CMG Conference, pp. 356–361, 1982.

    Google Scholar 

  41. Budenske, J. et al., “On-line use of off-line derived mappings etc.” Proc. Heterogeneous Computing Workshop, IEEE Computer Society, 1997.

    Google Scholar 

  42. Cai, M. et al., “A Peer-to-Peer Replica Location Service Based on A Distributed Hash Table.” Proc. SC2004 Conf. (SC2004), November 2004.

    Google Scholar 

  43. Canarie, http://www.canarie.ca/canet4/.

    Google Scholar 

  44. Chervenak, A. et al., “The Data Grid: Towards an Architecture for the Distributed Management and Analysis of Large Scientific Datasets.” J. Network and Computer Applications, 23:187–200, 2001.

    Article  Google Scholar 

  45. Chervenak, A. et al., “A Framework for Constructing Scalable Replica Location Services.” Proc. Supercomputing 2002 (SC2002), November 2002.

    Google Scholar 

  46. Chien A., “Architecture of an Commercial Enterprise Desktop Grid: The Entropia System,” in Berman F. et al. (eds.), Grid Computing: Making the Global Infrastructure a Reality, Wiley, March 2003.

    Google Scholar 

  47. Chervenak, A. et al., “Performance and Scalability of a Replica Location Service.” Proc. Intl. IEEE Symp. on High Performance Distributed Computing (HPDC-13), June 2004.

    Google Scholar 

  48. Chandy, K. and A. Martin, “A Characterization of Product-Form Queuing Networks”, J. ACM, 30 n.2, p.286–299, April 1983.

    Article  MATH  MathSciNet  Google Scholar 

  49. Chbat M. W. et al. “Toward wide-scale all-optical transparent networking: The ACTS optical pan-European network (OPEN) project.” IEEE JSAC, 16(7): 1226–1244, September 1998.

    Google Scholar 

  50. Chien A., “Computing Platforms”, in Foster and Kesselman (eds.), The Grid: Blueprint for a New Computing Infrastructure, Morgan-Kaufman, San Francisco, 1999.

    Google Scholar 

  51. Courtois, P. J. Decomposability: Queuing and Computer System Applications, 1977.

    Google Scholar 

  52. Czajkowski K. et al., “Grid Information Services for Distributed Resource Sharing.” Proc. Tenth IEEE Intl. Symp. on High-Performance Distributed Computing (HPDC-10), IEEE Press, August 2001.

    Google Scholar 

  53. Czajkowski, A. et al., “Practical Resource Management for Grid-based Visual Exploration.” Proc. Tenth Intl. Symp. on High Performance Distributed Computing (HPDC-10), IEEE Press, August 2001.

    Google Scholar 

  54. Czajkowski, K. et al., “A Protocol for negotiating service level agreements and coordinating resource management in distributed systems.” Lecture Notes in Computer Science, 2537:153–183, 2002.

    Article  MATH  Google Scholar 

  55. Czajkowski, K. et al., “Resource Co-Allocation in Computational Grids.” Proc. Eighth IEEE Intl. Symp. on High Performance Distributed Computing (HPDC-8), pp. 219–228, 1999.

    Google Scholar 

  56. Demaine E. et al., “Generalized Communicators in the Message Passing Interface.” IEEE Trans. Parallel and Distributed Systems, 12(6):610–616, 2001.

    Article  Google Scholar 

  57. Deelman, E. et al., “Mapping Abstract Complex Workflows onto Grid Environments.” J. Grid Computing, 1(1), 25–39, 2003.

    Article  Google Scholar 

  58. DeRoure D., “The Semantic Grid: A Future e-Science Infrastructure,” in Berman F. et al. (eds.), Grid Computing: Making the Global Infrastructure a Reality, Wiley, March 2003.

    Google Scholar 

  59. Deelman, E. et al., “Grid-Based Metadata Services”. 16th Intl. Conf. on Scientific and Statistical Database Management (SSDBM04), June 2004.

    Google Scholar 

  60. Deelman, E. et al., “Pegasus Mapping Scientific Workflows onto the Grid.” Across Grids Conf., 2004.

    Google Scholar 

  61. Denning, P., and J. Buzen, “The Operational Analysis of Queuing Network Models”, ACM Computing Surveys, Vol. 10, No. 3, Sept. 1978, pp. 225–261.

    Article  MATH  Google Scholar 

  62. DeRose L. et al., “An Approach to Immersive Performance Visualization of Parallel and Wide-Area Distributed Applications.” Proc. Intl. Symp. High Performance Distributed Computing (HPDC’99), 1999.

    Google Scholar 

  63. DeFanti T. and R. Stevens, “Tele-immersion”, in Foster and Kesselman (eds.), The Grid: Blueprint for a New Computing Infrastructure, Morgan-Kaufman, San Francisco, 1999.

    Google Scholar 

  64. Disney R. and D. Konig, “Queuing Networks: a Survey of their Random Processes”, SIAM Review, 27:335–403, 1985.

    Article  MATH  MathSciNet  Google Scholar 

  65. Dolzer K. et al. “A simulation study on traffic aggregation in multi-service networks.” Proc. IEEE Conf. High Performance Switching and Routing (ATM 2000). 2000. 9 pp.

    Google Scholar 

  66. Duser Michael, et al., “Analysis of a dynamically wavelength-routed optical burst switched network architecture”, IEEE, Journal of Lightwave Technology, Vol. 20, no. 4, April 2002.

    Google Scholar 

  67. Dzemydiene H. and P. Pranevicius, “Integration of Aggregate Approach in the Multi-modal Transport Evaluation System”, Proc. Third Intl. Workshop on Databases and Information Systems, 1998.

    Google Scholar 

  68. http://www.cordis.lu/ist/grids/towards_a_european_research_area_for_grids.htm

    Google Scholar 

  69. http://europa.eu.int/information_society/policy/nextweb/grid/index_en.htm

    Google Scholar 

  70. http://www.cordis.lu/ist/rn/grids.htm

    Google Scholar 

  71. http://www.e-irg.org/meetings/2004-NL/EmilBroesterhuizen.html

    Google Scholar 

  72. http://www.ercim.org/publication/Ercim_News/enw59/keynote.html

    Google Scholar 

  73. http://www.celtic-initiative.org/Documents/CELTIC-PurpleBook-V2.pdf

    Google Scholar 

  74. http://www.cordis.lu/cost/src/285_indivpage.htm

    Google Scholar 

  75. Fall, K., “Network Emulation in the Vint/NS Simulator,” Proc. Fourth IEEE Symposium on Computers and Communications, pp. 244–250, July 1999.

    Google Scholar 

  76. Ferreira L., Introduction to Grid Computing with Globus, IBM, Oct. 2003 (http://publib-b.boulder.ibm.com/Redbooks.nsf/RedbookAbstracts/sg246895.html).

    Google Scholar 

  77. Fitzgerald S. et al., “A Directory Service for Configuring High-Performance Distributed Computations.” Proc. 6th IEEE Symp. on High-Performance Distributed Computing, pp. 365–375, 1997.

    Google Scholar 

  78. Foster I., A. Roy, V. Sander. “A Quality of Service Architecture that Combines Resource Reservation and Application Adaptation.” 8th Intl. Workshop on Quality of Service, 2000.

    Google Scholar 

  79. Foster, I. et al., “The Anatomy of the Grid: Enabling Scalable Virtual Organizations.” Intl. J. Supercomputer Applications, 15(3), 2001.

    Google Scholar 

  80. Foster, I. et al., “Grid Services for Distributed System Integration.” Computer, 35(6), 2002.

    Google Scholar 

  81. Foster, I. et al., “The Physiology of the Grid: An Open Grid Services Architecture for Distributed Systems Integration.” Open Grid Service Infrastructure WG, Global Grid Forum, June 22, 2002.

    Google Scholar 

  82. Foster I. and J. Nieplocha. “Disk Resident Arrays: An Array-Oriented I/O Library for Out-of-Core Computations.” High-Performance Mass Storage and Parallel I/O, Wiley, 2002.

    Google Scholar 

  83. Foster, I. et al., “Improving Data Availability through Dynamic Model-Driven Replication in Large Peer-to-Peer Communities.” Global and Peer-to-Peer Computing Workshop, Berlin, May 2002.

    Google Scholar 

  84. Foster, I. et al., “The Physiology of the Grid: An Open Grid Services Architecture for Distributed Systems Integration.” Open Grid Service Infrastructure WG, Global Grid Forum, June 22, 2002.

    Google Scholar 

  85. Fox G., “Education and the Enterprise with the Grid,” in Berman F. et al. (eds.), Grid Computing: Making the Global Infrastructure a Reality, Wiley, March 2003.

    Google Scholar 

  86. Fox G., “Peer-to-Peer Grids,” in Berman F. et al. (eds.), Grid Computing: Making the Global Infrastructure a Reality, Wiley, March 2003.

    Google Scholar 

  87. Foster I. et al., “The Grid 2003 Production Grid: Principles and Practice.” 13th Proc. Intl. IEEE Symp. on High Performance Distributed Computing, June 2004.

    Google Scholar 

  88. Foster, I. et al., “End-to-End Quality of Service for High-end Applications.” Computer Communications, 27(14): 1375–1388, 2004.

    Article  Google Scholar 

  89. Foster I. et al., “Managing Multiple Communication Methods in High-Performance Networked Computing Systems.” J. Parallel and Distributed Computing, 40:35–48, 1997.

    Article  Google Scholar 

  90. Foster, I. et al., “Remote I/O: Fast Access to Distant Storage.” Proc. Workshop on I/O in Parallel and Distributed Systems (IOPADS), 1997.

    Google Scholar 

  91. Foster I. et al., “Wide-Area Implementation of the Message Passing Interface.” Parallel Computing, 24(12): 1735–1749, 1998.

    Article  Google Scholar 

  92. Foster, I. et al., “Software infrastructure for the I_WAY metacomputing experiment.” Concurrency: Practice and Experience. Volume 10, Number 7, June 1998.

    Google Scholar 

  93. Foster I. and N. Karonis. “A Grid-Enabled MPI: Message Passing in Heterogeneous Distributed Computing Systems.” Proc. 1998 SC Conf., November, 1998.

    Google Scholar 

  94. Foster I. and C. Kesselman, “Computational Grids”, in Foster and Kesselman (eds.), The Grid: Blueprint for a New Computing Infrastructure, Morgan-Kaufman, San Francisco, 1999.

    Google Scholar 

  95. Foster I. et al., “Distance Visualization: Data Exploration on the Grid.” IEEE Computer Magazine, 32(12):36–43, 1999.

    Google Scholar 

  96. Foster I. “The Beta Grid: A National Infrastructure for Computer Systems Research.” Proc. 1999 NetStore Conf, 1999.

    Google Scholar 

  97. I. Foster et al., “A Distributed Resource Management Architecture that Supports Advance Reservations and Co-Allocation.” Intl Workshop on Quality of Service, 1999.

    Google Scholar 

  98. von Laszewski G. and I. Foster. “Grid Infrastructure to Support Science Portals for Large Scale Instruments.” Proc. Workshop on the Distributed Computing Web (DCW), Rostock, June 1999.

    Google Scholar 

  99. Foster I. et al., “Grid Services for Distributed System Integration,” Computer, June 2002.

    Google Scholar 

  100. Fox G. and D. Walker, “E-Science Gap Analysis,” 30 June 2003 (http://www.Grid2002.org/ukescience/gapresources/GapAnalysis30June03.pdf).

    Google Scholar 

  101. Fox, B. L., and Heine, G. W. “Monte Carlo and Quasi-Monte Carlo Methods in Scientific Computing.” In Lecture Notes in Statistics, #106. Springer-Verlag, Berlin, 1995.

    Google Scholar 

  102. Frey, J. et al., Condor-G: “A Computation Management Agent for Multi-Institutional Grids.” Proc. Tenth Intl. Symp. on High Performance Distributed Computing (HPDC-10), IEEE Press, August 2001.

    Google Scholar 

  103. Frey, J. et al., “A Computation Management Agent for Multi-Institutional Grids.” Cluster Computing, 5(3):237–246, 2002.

    Article  MathSciNet  Google Scholar 

  104. Frey G., “Combinatorial Chemistry and the Grid,” in Berman F. et al. (eds.), Grid Computing: Making the Global Infrastructure a Reality, Wiley, March 2003.

    Google Scholar 

  105. Fujimoto, R., Parallel and Distributed Simulation Systems, Wiley Interscience, New York, 2000.

    Google Scholar 

  106. Fujimoto, R., “Parallel discrete event simulation”, Communic. ACM, 33(10): 30–53, October 1990.

    Article  Google Scholar 

  107. Gannon D. “Grid Web Services and Application Factories”, in Berman F. et al. (eds.), Grid Computing: Making the Global Infrastructure a Reality, Wiley, March 2003.

    Google Scholar 

  108. Gelenbe, E., and R. Muntz, “Probabilistic models of computer systems—Part 1 (exact results)”, Acta Informatica 7, 35 60, 1976.

    MATH  MathSciNet  Google Scholar 

  109. Gehring J. and A. Reinefeld, “MARS — a framework for minimizing the job execution time ion a metacomputing environment.” Future Generation Computer Systems, 12(1):87–99, 1996.

    Article  Google Scholar 

  110. Gil, Y. et al., “Artificial Intelligence and Grids Workflow Planning and Beyond.” IEEE Intelligent Systems, January 2004.

    Google Scholar 

  111. Glynn, P. W. “Stochastic Approximation for Monte Carlo Optimization.” Proc. of the Winter Simulation Conference (Wilson, J., Henriksen, J. and Roberts, S. (eds), IEEE Press, 1986).

    Google Scholar 

  112. Globus Project, “GridFTP reference,” http://www.Globus.org/dataGrid/Gridftp.html.

    Google Scholar 

  113. Simeonidou D. (ed.), “Optical Network Infrastructure for Grid”, Grid High Performance Networking Research Group, September 2003, http://forge.Gridforum.org/projects/ghpn-rg/.

    Google Scholar 

  114. http://www.globus.org/research/papers.html

    Google Scholar 

  115. http://grid.uchicago.edu/grappa/bib/

    Google Scholar 

  116. http://tyne.dl.ac.uk/ReDRESS/WebServices/webServices_doc/node66.html

    Google Scholar 

  117. Hao, Q., Tartarelli, S., and Devetsikiotis, M. “Self-Sizing and Optimization of High Speed Multiservice Networks.” Proc. IEEE GLOBECOM(2000), vol. 3, pp. 1818–1823.

    Google Scholar 

  118. Hey T., “The Data Deluge: An e-Science Perspective,” in Berman F. et al. (eds.), Grid Computing: Making the Global Infrastructure a Reality, Wiley, March 2003.

    Google Scholar 

  119. Hingne V. et al., “Towards a Pervasive Grid”, Proc. Intl. Parallel and Distributed Processing Symposium, April 2003, Nice France.

    Google Scholar 

  120. Hoo, G. et al., “QoS as Middleware: Bandwidth Reservation System Design.” Proc. 8th IEEE Symp. on High Performance Distributed Computing, pp. 345–346, 1999.

    Google Scholar 

  121. Iamnitchi A. and I. Foster. “A Problem-Specific Fault-Tolerance Mechanism for Asynchronous, Distributed Systems.” Proc. 2000 Intl. Conf. on Parallel Processing, 2000.

    Google Scholar 

  122. Iamnitchi A. and I. Foster. “On Fully Decentralized Resource Discovery in Grid Environments.” Intl. Workshop on Grid Computing, Denver, CO, November 2001.

    Google Scholar 

  123. Iamnitchi A., M. Ripeanu and I. Foster. “Small-World File-Sharing Communities.” INFOCOM 2004, Hong Kong, March, 2004.

    Google Scholar 

  124. ACM SIGCOMM Internet Measurement Conference 2003, http://www.icir.org/vern/imc-2003 /program.html.

    Google Scholar 

  125. Measurement, Modeling and Analysis of the Internet, http://www.ima.umn.edu/complex/winter/c4.html.

    Google Scholar 

  126. “Grid Computing,” IT Professional Magazine, Vol. 6 No. 6, March 2004. IEEE Computer Society.

    Google Scholar 

  127. Jacob B. et al., Enabling Applications for Grid Computing with Globus, IBM, June 2003 (http://publib-b.boulder.ibm.com/Redbooks.nsf/RedbookAbstracts/SG246936.html).

    Google Scholar 

  128. Jackson, J., “Networks of Waiting Lines”, Oper. Res. 5:518–521, 1957.

    Google Scholar 

  129. Jelenkovic, B. and J. Melamed, “Automated TES modeling of compressed video”, Proc IEEE INFOCOM’ 95, pp. 746–752, 1995.

    Google Scholar 

  130. Johnston, B. “Implementing Production Grids”, in Berman F. et al. (eds.), Grid Computing: Making the Global Infrastructure a Reality, Wiley, March 2003.

    Google Scholar 

  131. Juiz C., R. Puigjaner and H. Perros, “Performance analysis of multi-class data transfer elements in soft real-time systems using semaphore queues”, Performance’ 99, August 99, Instabul, Turkey

    Google Scholar 

  132. Karonis N. et al., “High-Resolution Remote Rendering of Large Datasets in a Collaborative Environment.” Future Generation of Computer Systems (FGCS), 2003.

    Google Scholar 

  133. Keahey K. et al., “Computational Grids in Action: The National Fusion Collaboratory.” Future Generation Computer Systems, 18:8, October 2002.

    Article  MATH  Google Scholar 

  134. Keahey K. et al., “Dynamic Creation and Management of Runtime Environments in the Grid.” Workshop on Designing and Building Grid Services, GGF-9, October 2003.

    Google Scholar 

  135. Keahey K. et al., “Grids for Experimental Science The Virtual Control Room,” Proc. Challenges of Large Applications in Distributed Environments (CLADE), Honolulu, June 2004.

    Google Scholar 

  136. Kelly, F., Reversibility and Stochastic Networks, Wiley, 1979.

    Google Scholar 

  137. Kovalev, M. et al., “Self-Adapting Hybrid Simulation Models of Heterogeneous Telecommunication Networks”, Information Processing, Vol. 2, No. 2, 2002, http://www.jip.ru/2002/29.pdf.

    Google Scholar 

  138. Kunszt P. and L Guy, “The Open Grid Service Architecture and Data Grids” in Berman F. et al. (eds.), Grid Computing: Making the Global Infrastructure a Reality, Wiley, March 2003.

    Google Scholar 

  139. von Laszewski G. et al. “CoG Kits: A Bridge between Commodity Distributed Computing and High-Performance Grids.” ACM Java Grande 2000 Conf., San Francisco, June 2000.

    Google Scholar 

  140. von Laszewski G. et al. “Grid-based Asynchronous Migration of Execution Context in Java Virtual Machines.” Proc. EuroPar 2000, Lecture Notes in Computer Science, Munich, September 2000. Springer.

    Google Scholar 

  141. von Laszewski G. et al., “InfoGram: A Grid Service that Supports Both Information Queries and Job Execution.” Proc. 11th IEEE Intl. Symp. on High-Performance Distributed Computing (HPDC-11), 2002.

    Google Scholar 

  142. von Laszewski G., “Commodity Grid Kits-Middleware for Building Grid Computing Environments”, in Berman F. et al. (eds.), Grid Computing: Making the Global Infrastructure a Reality, Wiley, March 2003.

    Google Scholar 

  143. von Laszewski G. et al., “Real-Time Analysis, Visualization, and Steering of Microtomography Experiments at Photon Sources.” Ninth SIAM Conf. Parallel Processing Scientific Computing, April 1999.

    Google Scholar 

  144. von Laszewski G. and I. Foster. “Grid Infrastructure to Support Science Portals for Large Scale Instruments.” Proc. Workshop Distributed Computing on the Web (DCW), Rostock, June 1999.

    Google Scholar 

  145. Leigh J. et al., “A Review of Tele-Immersive Applications in the CAVE Research Network.” Proc. IEEE Virtual Reality 2000 Intl. Conf. (VR 2000).

    Google Scholar 

  146. Lee, J. et al., “Applied Techniques for High Bandwidth Data Transfers Across Wide Area Networks.” Proc. Intl. Conf. on Computing in High Energy and Nuclear Physics, Beijing, September 2001.

    Google Scholar 

  147. Lee B. and J. Schopf. “Run-time Prediction of Parallel Applications on Shared Environments.” Proc. Cluster 2003, December 2003.

    Google Scholar 

  148. Lee C, C. Kesselman, S. Schwab. “Near-real-time Satellite Image Processing: Metacomputing in CC++.” Computer Graphics and Applications, 16(4):79–84, 1996.

    Article  Google Scholar 

  149. Lee, C. et al., “A Network Performance Tool for Grid Computations.” Supercomputing’ 99, 1999.

    Google Scholar 

  150. Lucas, M. et al., “(M,P,S)-an efficient background traffic model for wide-area network simulation,” Proc. IEEE Globecom, Vol. 3, pp. 1572–1576, 1997.

    Google Scholar 

  151. Mann V., “Discovery and Computational Steering,” in Berman F. et al. (eds.), Grid Computing: Making the Global Infrastructure a Reality, Wiley, March 2003.

    Google Scholar 

  152. Mahinthakumar G. et al., “Multivariate Geographic Clustering in a Metacomputing Environment Using Globus.” Proc. Supercomputing 99, November 1999.

    Google Scholar 

  153. Morato D. et al. “On linear prediction of Internet traffic for packet and burst switching networks.” Proc. Tenth Intl. Conf. Computer Communications and Networks. 2001. 6 pp.

    Google Scholar 

  154. Moore R. and C. Baru “Virtualization Services for Data Grids”, in Berman F. et al. (eds.), Grid Computing: Making the Global Infrastructure a Reality, Wiley, March 2003.

    Google Scholar 

  155. Moab Grid Scheduler, www.clusterresources.com/

    Google Scholar 

  156. Morris, T., and Perros, H.G., “Approximate analysis of a discrete-time tandem network of cut-through queues with blocking and bursty arrivals”, Performance Evaluation J 17 (1993) 207–223.

    Article  MATH  Google Scholar 

  157. Murshed M. and R. Buyya, “Using the GridSim Toolkit for Enabling Grid Computing Education,” Proc. CNDS 2002, 2002.

    Google Scholar 

  158. Nabrzyski, J. et al. (eds.), Grid Resource Management. Kluwer, Fall 2003.

    Google Scholar 

  159. NC Networking Initiative, http://www.ncni.net/.

    Google Scholar 

  160. NC Research and Education Network, http://www.ncren.net/.

    Google Scholar 

  161. National LambdaRail, http://www.nationallambdarail.org/.

    Google Scholar 

  162. Report of NSF Workshop on Network Research Testbeds, http://www-net.cs.umass.edu/testbed_workshop/testbed_workshop_report_final.pdf, November 2002.

    Google Scholar 

  163. Pattnaik P., “Autonomic Computing and GRID,” in Berman F. et al. (eds.), Grid Computing: Making the Global Infrastructure a Reality, Wiley, March 2003.

    Google Scholar 

  164. QNA, http://www.columbia.edu/~ww2040/Alb.html.

    Google Scholar 

  165. Ramesh S. and H. Perros “A multi-layered queuing network model of a client-server system with synchronous and asynchronous messages”, IEEE Trans. Software Engineering. Vol 26, Nov. 2000.

    Google Scholar 

  166. Ramesh S., G. Rouskas and H. Perros “Computing blocking probabilities in multi-class wavelength routing networks”, ACM Trans. On Modeling and Computer Simulation, Vol 10, April 2000, 87–103.

    Article  Google Scholar 

  167. Ramesh S. and H. Perros, “A multi-layer client-server queuing network model with synchronous and asynchronous non-hierarchical messages”, Performance Evaluation J, Vol. 45(4) (2001) pp. 223–256.

    Article  MATH  Google Scholar 

  168. Ranganathan K. and I. Foster. “Design and Evaluation of Dynamic Replication Strategies for High Performance Data Grids.” Proc. Intl. Conf. Computing High Energy Nuclear Physics, September 2001.

    Google Scholar 

  169. Ranganathan K. and I. Foster. “Decoupling Computation and Data Scheduling in Distributed Data-Intensive Applications.” Proc. 11th IEEE Intl. Symp. HPDC-11, July 2002.

    Google Scholar 

  170. Ranganathan K. and I. Foster. “Identifying Dynamic Replication Strategies for High Performance Data Grids.” Proc. Intl. Workshop on Grid Computing, Denver, CO, November 2002.

    Google Scholar 

  171. Ranganathan, K. et al., “Improving Data Availability through Dynamic Model-Driven Replication in Large Peer-to-Peer Communities.” Proc. Global and Peer-to-Peer Computing Workshop, Berlin, May 2002.

    Google Scholar 

  172. Reed D. et al., “Performance Analysis of Parallel Systems: Approaches and Open Problems.” Proc. Joint Symposium on Parallel Processing (JSPP), June 1998.

    Google Scholar 

  173. Reed D. and R. Ribler, “Performance Analysis and Visualization”, in Foster and Kesselman (eds.), The Grid: Blueprint for a New Computing Infrastructure, Morgan-Kaufman, San Francisco, 1999.

    Google Scholar 

  174. Rhee Y. and H. Perros, “Analysis of an open tandem queuing network with population constraint and constant service times”, European J. of Operations Research. 92 (1996) 99–111.

    Article  MATH  Google Scholar 

  175. Rhee Y. and H. Perros, “An approximate analysis of an open tandem queuing network with population constraint and constant service times”, HE Trans. 1998 Oct. 30(10) 973–979.

    Google Scholar 

  176. Ripeanu M., A. Iamnitchi and I. Foster. “Cactus Application: Performance Predictions in Grid Environments.” EuroPar 2001, Manchester, UK, August 2001.

    Google Scholar 

  177. Ripeanu M., A. Iamnitchi and I. Foster. “Performance Predictions for a Numerical Relativity Package in Grid Environments.” Intl. J. High-Performance Computing Applications, Vol. 15(4) 2001.

    Google Scholar 

  178. Ripeanu M. and I. Foster; “A Decentralized, Adaptive, Replica Location Service.” 11th IEEE Intl. Symp. on High Performance Distributed Computing (HPDC-11), Edinburgh, July 2002.

    Google Scholar 

  179. Rizzo, L., “Dummynet: a simple approach to the evaluation of network protocols”, ACMCCR, January 1997.

    Google Scholar 

  180. Rizzo, L. “Dummynet and Forward Error Correction.” Proc. USENIX Technical Conf., June, 1998.

    Google Scholar 

  181. Russel M. et al., “The Astrophysics Simulation Collaboratory: A Science Portal Enabling Community Software Development.” Cluster Computing, 5(3):297–304, 2002.

    Article  Google Scholar 

  182. Rubinstein, R. Y. “Sensitivity Analysis and Performance Extrapolation for Computer Simulation Models.” Oper. Res. 37(1989), 72–81.

    Google Scholar 

  183. Sander, V. et al., “End-to-End Provision of Policy Information for Network QoS.” Proc. Tenth IEEE Symp. on High Performance Distributed Computing (HPDC-10), IEEE Press, August 2001.

    Google Scholar 

  184. Schopf J. and S. Vazhkudai. “Predicting Sporadic Grid Data Transfers.” 1lth IEEE Intl. Symp. on High-Performance Distributed Computing (HPDC-11), IEEE Press, Scotland, July 2002.

    Google Scholar 

  185. Shaffer E. et al., “Real-Time Immersive Performance Visualization and Steering,” ACM SIGGRAPH Computer Graphics Newsletter, May 2000.

    Google Scholar 

  186. Singh, G. et al., “A Metadata Catalog Service for Data Intensive Applications.” Proc. Supercomputing 2003 (SC2003), November 2003.

    Google Scholar 

  187. Sirbu M. and D. Marinescu. “A scheduling expert advisor for heterogeneous environments.” Proc. Heterogeneous Computing Workshop, IEEE Computer Society, 1997.

    Google Scholar 

  188. Smith W., I. Foster, V. Taylor. “Scheduling with Advanced Reservations.” Proc. IPDPS Conf., May 2000.

    Google Scholar 

  189. Smith, P. J., Shafi, M., and Gao, H. “Quick simulation: A review of importance sampling techniques in communications systems.” IEEE JSAC 15,4 (May 1997), 597–613.

    Google Scholar 

  190. Smith W., I. Foster, V. Taylor. “Predicting Application Run Times Using Historical Information.” Proc. IPPS/SPDP’ 98 Workshop on Job Scheduling Strategies for Parallel Processing, 1998.

    Google Scholar 

  191. Smith W., V. Taylor, I Foster. “Using Run-Time Predictions to Estimate Queue Wait Times and Improve Scheduler Performance.” Proc. IPPS/SPDP’ 99 Workshop Job Scheduling for Parallel Processing, 1999.

    Google Scholar 

  192. Snelling D. “Unicore and the Open Grid Services Architecture”, in Berman F. et al. (eds.), Grid Computing: Making the Global Infrastructure a Reality, Wiley, March 2003.

    Google Scholar 

  193. Stockinger, H. et al., “File and Object Replication in Data Grids.” Proc. Tenth Intl. Symp. on High Performance Distributed Computing (HPDC-10), IEEE Press, August 2001.

    Google Scholar 

  194. Stockinger, H. et al., “File and Object Replication in Data Grids.” J. Cluster Computing, 5(3) 305–314, 2002.

    Article  Google Scholar 

  195. Stadler, J. S., and Roy, S. Adaptive Importance Sampling.” IEEE J. Select. Areas in Commun. 11,3 (Apr. 1993), 309–316.

    Article  Google Scholar 

  196. Stelling P. et al., “A Fault Detection Service for Wide Area Distributed Computations.” Proc. 7th IEEE Symp. on High Performance Distributed Computing, pp. 268–278, 1998.

    Google Scholar 

  197. Stelling P. et al., “A Fault Detection Service for Wide Area Distributed Computations.” Cluster Computing, 2:117–128, 1999.

    Article  Google Scholar 

  198. Sulistio A., C. Yeo, and R. Buyya, “Visual Modeler for Grid Modelling and Simulation (GridSim) Toolkit,” Proc. ICCS 2003, Springer Verlag, June 2003.

    Google Scholar 

  199. Sulistio A. and R. Buyya, “A Grid Simulation Infrastructure Supporting Advance Reservation,” Proc 16th Conf. PDCS 2004, November 2004.

    Google Scholar 

  200. Sulistio A., C. Yeo, and R. Buyya, “A Taxonomy of Computer-based Simulations and its Mapping to Parallel and Distributed Systems Simulation Tools,” Intl. J. Software, 34(7), Wiley, June 2004.

    Google Scholar 

  201. de Supinski B. and N. Karonis. “Accurately Measuring MPI Broadcasts in a Computational Grid.” Proc. 8th IEEE Symp. on High Performance Distributed Computing, pp. 29–37, August 1999.

    Google Scholar 

  202. Towsley, D., “Queuing Network Models with State-Dependent Routing”, J. ACM, 27 n.2, p.323–337, April 1980.

    Article  MATH  MathSciNet  Google Scholar 

  203. Vahdat, A. et al., “Scalability and accuracy in a large-scale network emulator”, Proc. 5th Symp. Operating Systems Design and Implementation, December 2002.

    Google Scholar 

  204. Vahdat, A. et al., “Modelnet distribution, http://issg.cs.duke.edu/modelnet.html.

    Google Scholar 

  205. Vazhkudai, S. et al., “Predicting the Performance of Wide Area Data Transfers.” Proc. 16th Intl. Parallel and Distributed Processing Symp. (IPDPS 2002), April 2002.

    Google Scholar 

  206. Vazhkudai S. and J. Schopf. “Using Disk Throughput Data in Predictions of End-to-End Grid Transfers.” Proc. 3rd Intl. Workshop on Grid Computing (GRID 2002), November 2002.

    Google Scholar 

  207. Vazhkudai S. and J. Schopf. “Using Regression Techniques to Predict Large Data Transfers.” The Intl. J. High Performance Computing Applications, Vol 17, No. 3, August 2003.

    Google Scholar 

  208. Washington A.N. and Harry Perros, “Call blocking probabilities in a traffic-groomed tandem optical network”, Technical Report, Computer Science Dept., NC State University, 2003.

    Google Scholar 

  209. Watson P., “Databases and the Grid,” in Berman F. et al. (eds.), Grid Computing: Making the Global Infrastructure a Reality, Wiley, March 2003.

    Google Scholar 

  210. Watson W. “Storage Manager and File Transfer Web Services”, in Berman F. et al. (eds.), Grid Computing: Making the Global Infrastructure a Reality, Wiley, March 2003.

    Google Scholar 

  211. Washington, A. N., Hsu, C, Perros, H. G., and Devetsikiotis, M. “Approximation techniques for the analysis of large traffic-groomed tandem optical networks.” 38th Annual Simulation Symposium.

    Google Scholar 

  212. Weissman J. and X. Zhao, “Runtime support for scheduling parallel applications in heterogeneous NOWS.” Proc. Sixth IEEE Symp. On High Performance Distributed Computing, 1997.

    Google Scholar 

  213. White et al., “An integrated experimental environment for distributed systems and networks”, Proc. 5th Symp. Operating Systems Design and Implementation, 2002.

    Google Scholar 

  214. Williams R., “Grids and the Virtual Observatory,” in Berman F. et al. (eds.), Grid Computing: Making the Global Infrastructure a Reality, Wiley, March 2003.

    Google Scholar 

  215. Woodside CM., “Throughput calculation for basic stochastic rendezvous networks”, Performance Evaluation 9 (1989) 143–160.

    Article  MATH  MathSciNet  Google Scholar 

  216. Woodside C.M., J.E. Neilson, D.C. Petriu, S. Majumdar, “Stochastic rendezvous network model for performance of synchronous client-server like distributed software”, IEEE Trans. Computers 44 (1995).

    Google Scholar 

  217. Yang L., I. Foster, J. Schopf. “Homeostatic and Tendency-based CPU Load Predictions.” Proc. IPDPS 2003, April 2003.

    Google Scholar 

  218. Yang, L. et al., “Conservative Scheduling: Using Predicted Variance to Improve Scheduling Decisions in Dynamic Environments.” Supercomputing 2003, November 2003.

    Google Scholar 

  219. Yocum, K. et al. “Modelnet: scalability and accuracy in a large-scale network emulator”. Proc ACM SIGCOMM. August 2002.

    Google Scholar 

  220. Zhou Y., G. Rouskas and H. Perros, “A path decomposition approach for computing blocking probabilities in wavelength routing networks,” IEEE/ACM Trans. on Networking, 8 (2000) 747–762.

    Article  Google Scholar 

  221. Zhou Y., G. Rouskas and H. Perros, “A comparison of wavelength allocation policies in wavelength routed networks”, Photonic Network Communications Journal, Vol. 2 (2000), 265–293.

    Google Scholar 

  222. Zhou Y., G. Rouskas and H. Perros, “A comparison of allocation policies in wavelength routing networks”, SPIE Terabit Optical Networking, Vol 4123, November 6–7, 2000 Boston, pp:64–72.

    Google Scholar 

  223. Zhang X., J. Freschl, and J. Schopf. “A Performance Study of Monitoring and Information Services for Distributed Systems.” Proc. HPDC, August 2003.

    Google Scholar 

  224. Zhang, H. et al., “Providing Data Transfer with QoS as Agreement-Based Service.” 2004 Intl. Conf. on Services Computing (SCC 2004), Shanghai, September 2004.

    Google Scholar 

  225. Zhang X. and J. Schopf. “Performance Analysis of the Globus Toolkit Monitoring and Discovery Service,” MDS2. Proc. 23rd Intl. Performance Computing and Communications Workshop (IPCCC), April 2004.

    Google Scholar 

  226. Zhou Y., G. Rouskas and H. Perros, “Blocking in wavelength routing networks, Part I: the single path case”, INFOCOM’ 99, pp 321–328.

    Google Scholar 

  227. Zhou Y., G. Rouskas and H. Perros, “Blocking in wavelength routing networks, Part 2: mesh topologies”, ITC’ 99.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2006 Springer Science+Business Media, LLC

About this paper

Cite this paper

Bragg, A., Perros, H., Devetsikiotis, M., Baldine, I., Stevenson, D. (2006). Modeling Grids in (Near) Real Time. In: Nejat Ince, A., Topuz, E. (eds) Modeling and Simulation Tools for Emerging Telecommunication Networks. Springer, Boston, MA . https://doi.org/10.1007/0-387-34167-6_11

Download citation

  • DOI: https://doi.org/10.1007/0-387-34167-6_11

  • Publisher Name: Springer, Boston, MA

  • Print ISBN: 978-0-387-32921-5

  • Online ISBN: 978-0-387-34167-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics