Computational Economics

, 32:353 | Cite as

Multi-core CPUs, Clusters, and Grid Computing: A Tutorial

Article

Abstract

The nature of computing is changing and it poses both challenges and opportunities for economists. Instead of increasing clock speed, future microprocessors will have “multi-cores” with separate execution units. “Threads” or other multi-processing techniques that are rarely used today are required to take full advantage of them. Beyond one machine, it has become easy to harness multiple computers to work in clusters. Besides dedicated clusters, they can be made up of unused lab computers or even your colleagues’ machines. Finally, grids of computers spanning the Internet are now becoming a reality.

Keywords

Multi-core Cluster OpenMP MPI Grid 

References

  1. ATLAS—Automatically Tuned Linear Algebra Software. (2007). http://math-atlas.sourceforge.net/.
  2. Azzin, I., Girardi, R., & Ratto, M. (2007). Parallelization of Matlab codes under windows platform for Bayesian estimation: A DYNARE application. http://eemc.jrc.ec.europa.eu/Docs/CEF2007/Azzini_Girardi_Ratto_CEF2007.pdf.
  3. Beaumont, P. M., & Bradshaw, P. T. (1995). A distributed parallel genetic algorithm for solving optimal growth models. Computational Economics, 8(3), 159–179. http://www.springerlink.com/content/j84l561458032j35.
  4. Becker, D. (2005). PlayStation 3 chip has split personality. ZDNet, February 7 2005. http://news.zdnet.com/PlayStation+3+chip+has+split+personality/2100-1040_22-5566340.html?part=rss&tag=feed&subj=zdnn.
  5. Clark, D. (2005). New chips pose a challenge to software makers. Wall Street Journal, April 14 2005.Google Scholar
  6. Condor Team. (2007). Condor version 6.8.5 manual. May 25, 2007,  http://www.cs.wisc.edu/condor/manual/v6.6.9/condor-V6_6_9-Manual.pdf.
  7. CPU World. (2007). http://www.cpu-world.com/.
  8. Creel, M. (2005). User-friendly parallel computations with econometric examples. Computational Economics, 26(2), 107–128. http://www.springerlink.com/content/3u718v2721652471.Google Scholar
  9. Creel, M. (2007). I ran four million probits last night: HPC clustering with parallelKnoppix. Journal of Applied Econometrics, 22(1), 215–223. http://www3.interscience.wiley.com/cgi-bin/abstract/114182453/ABSTRACT.Google Scholar
  10. Delattre, F., & Prieur, M. (2006). Intel core 2 duo – test. July 2006, http://www.behardware.com/articles/623-1/intel-core-2-duo-test.html.
  11. Dongarra, J. J. (2007). Performance of various computers using standard linear equations software. July 2007, http://www.netlib.org/benchmark/performance.pdf.
  12. Doornik, J. A., Hendry, D. F., & Shephard, N. (2005). Parallel computation in econometrics: A simplifed approach. In E. J. Kontoghiorgies (Ed.), Handbook on parallel computing and statistics. Marcel Dekker. http://www.doornik.com/research.html.
  13. Doornik J.A., Shephard N., Hendry D.F. (2002) Computationally-intensive econometrics using a distributed matrix-programming language. Philosophical Transactions of the Royal Society of London, Series A 360: 1245–1266CrossRefGoogle Scholar
  14. Ekvall, N. (1994). Experiences in the pricing of trivariate contingent claims with finite difference methods on a massively parallel computer. Computational Economics, 7(2), 63–72. http://www.springerlink.com/content/l4435t1u873k546w.
  15. Ferrall, C. (2005). Solving finite mixture models: Efficient computation in economics under serial and parallel execution. Computational Economics, 25(4), 343–379. http://www.springerlink.com/content/km4jvk01224122ul.Google Scholar
  16. Foster, I. (2002). What is the grid. July 20 2002, http://www-fp.mcs.anl.gov/~foster/Articles/WhatIsTheGrid.pdf.
  17. Foster, I. (2003). The grid: Computing without bounds. Scientific American, April 2003. http://www.eweek.com/article2/0,1759,1737050,00.asp.
  18. Foster, I., & Kesselman, C. (Eds.). (2003). The grid 2: Blueprint for a new computer infrastructure, Chapter 4: Concepts and architecture. Kluwer.Google Scholar
  19. Gilli M., Pauletto G. (1993) Econometric model simulation on parallel computers. International Journal of Supercomputer Applications 7: 254–264CrossRefGoogle Scholar
  20. Gropp, W., Lusk, E., Doss, N., & Skjellum, A. (1996). A high-performance, portable implementation of the MPI message passing interface standard. Parallel Computing, 22, 789–828. http://www-unix.mcs.anl.gov/mpi/mpich/.
  21. Grove, A. (2002). Changing vectors of Moore’s law. December 10 2002, http://www.intel.com/pressroom/archive/speeches/grove_20021210.htm.
  22. Hachman, M. (2004). Intel firms up dual-core plans. eWeek.com, December 7 2004, http://www.eweek.com/article2/0,1759,1737050,00.asp.
  23. Hermanns, M. (2002). Parallel programming in Fortran 95 using OpenMP. http://www.openmp.org/presentations/miguel/F95_OpenMPv1_v2.pdf.
  24. Intel Core2 Duo Desktop Processor E6700. (2007). http://processorfinder.intel.com/details.aspx?sspec=sl9s7.
  25. Kontoghiorghes, E. J. (2000). Parallel strategies for solving SURE models with variance inequalities and positivity of correlations constraints. Computational Economics, 15(1), 89–106. http://www.springerlink.com/content/x37681221w4k6782.
  26. Kontoghiorghes E.J., Nagurney A., Rustem B. (2000) Parallel computing in economics, finance and decision-making. Parallel Computing 26: 507–509CrossRefGoogle Scholar
  27. Kontoghiorgies, E. J. (Ed.). (2000). Parallel algorithms for linear models: Numerical methods and estimation problems. Kluwer Academic Publishers.Google Scholar
  28. Kontoghiorgies, E. J. (Ed.). (2005). Handbook of parallel computing and statistics. Marcel Dekker.Google Scholar
  29. LAM/MPI Parallel Computing. (2007). http://www.lam-mpi.org.
  30. Lee, D., & Wiswall, M. (2007). A parallel implementation of the simplex function minimization routine. Computational Economics. http://www.springerlink.com/content/x278772220h8q084.
  31. Marr, D. T., Binns, F., Hill, D. L., Hinton, G., Koufaty, D. A., Miller, J. A., & Upton, M. (2002). Hyper-threading technology architecture and microarchitecture. Intel Technology Journal, 3(1), 4–21, February 14 2002, http://developer.intel.com/technology/itj/archive/2002.htm.Google Scholar
  32. MPI-2: Extensions to the Message-passing Interface. (1997). Message Passing Interface Forum. http://www.mpi-forum.org/docs/mpi-20-html/mpi2-report.html.
  33. Nagurney, A. (1996). Parallel computation. In H.M. Amman, D.A. Kendrick, & J. Rust (Eds.), Handbook of computational economics/handbooks in economics (Vol. 13, pp. 335–404). North-Holland: Elsevier Science.Google Scholar
  34. Nagurney A., Zhang D. (1998) A massively parallel implementation of a discrete-time algorithm for the computation of dynamic elastic demand and traffic problems modeled as projected dynamical systems. Journal of Economic Dynamics and Control 22: 1467–1485CrossRefGoogle Scholar
  35. Nagurney A., Takayama T., Zhang D. (1995) Massively parallel computation of spatial price equilibrium problems as dynamical systems. Journal of Economic Dynamics and Control 19: 3–37CrossRefGoogle Scholar
  36. OpenMP. (2007). http://www.openmp.org.
  37. OpenMP Architecture Review Board. (2005). OpenMP application program interface, version 2.5. http://www.openmp.org/drupal/mp-documents/spec25.pdf.
  38. Open MPI: Open Source High Performance Computing. (2007). http://www.open-mpi.org.
  39. Pauletto, G., & Gilli, M. (2000). Parallel Krylov methods for econometric model simulation. Computational Economics, 16(1), 173–186. http://www.springerlink.com/content/u2lr372823031867.
  40. Schmid, P., & Roos, A. (2005). Prescott reworked: The P4 600 series and extreme edition 3.73 GHz. Tom’s Hardware Guide, February 21 2005, http://www.tomshardware.com/2005/02/21/prescott_reworked/.
  41. Schmid, P., & Topelt, B. (2006). Game over? Core 2 duo knocks out Athlon 64. Tom’s Hardware Guide, July 14 2006, http://www.tomshardware.com/2006/07/14/core2_duo_knocks_out_athlon_64/index.html.
  42. Sloan, J. D. (2004). High performance Linux clusters with OSCAR, Rocks, OpenMosix, and MPI (1st ed.). O’Reilly Media.Google Scholar
  43. Strom, D., & Gruener, W. (2005). Pat Gelsinger: A shot at running Intel. Tom’s Hardware Guide, May 6 2005, http://www.tomshardware.com/business/20050506/index.html.
  44. Swann C.A. (2002) Maximum likelihood estimation using parallel computing: An introduction to MPI. Computational Economics 19: 145–178CrossRefGoogle Scholar
  45. The Five Big Ideas Behind the Grid. (2007). http://gridcafe.web.cern.ch/gridcafe/challenges/challanges.html.
  46. The Role of the Globus Toolkit in the Grid Ecosystem. (2007). http://www.globus.org/grid_software/role-of-gt.php.
  47. TOP500 Supercomputer Sites. (2007). http://www.top500.org.
  48. van der Steen, A. J., & Dongarra, J. (2004). Overview of recent supercomputers. http://www.top500.org/ORSC/2004/overview.html.
  49. Young, S. (2005). Why the glut in fiber lines remains huge. Wall Street Journal, May 12 2005, http://online.wsj.com/article/0,,SB111584986236831034,00.html.

Copyright information

© Springer Science+Business Media, LLC. 2008

Authors and Affiliations

  1. 1.Department of Economics and Economic History, Edifici BUniversitat Autònoma de BarcelonaBellaterraSpain
  2. 2.Department of EconomicsSUNY—OswegoOswegoUSA

Personalised recommendations