Informatik pp 197-220 | Cite as

A Perspective on Parallel and Distributed Computing

  • Miroslaw Malek


Trying to compress about 50 year history of parallel and distributed computing (which we call multicomputing for short) is a highly ambitious goal and would require an entire book to give justice to several developments that took place world wide. Instead, in this article in addition to some historical account, the author’s personal perspective is offered which includes experiences with multicom-puting in America, Europe and Japan. Starting from humble beginnings we travel in time through a period of flurry of developments in parallel computing and make an account of key events in distributed computing. Next, through the perspective of our NOMADS (Networks of Mobile Adaptive Dependable Systems) framework which provides the infrastructure for the Service-Oriented Computing, we present our view on today’s computing and also describe the things to come. Some speculations about the future and trends will end with conclusions.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    R. Rojas, U. Hashagen The First Computers — History and Architectures. 2002Google Scholar
  2. 2.
    G. Ifrah Universal History of Computing: From Abacus to the Quantum Computer. 2002Google Scholar
  3. 3.
    P.E. Ceruzzi A History of Modern Computing. MIT Press, 1998Google Scholar
  4. 4. Scholar
  5. 5. Scholar
  6. 6.
    M.J. Flynn Very High-Speed Computing Systems. Proceedings of IEEE, Vol. 54, No. 12, December 1966, pp. 1901–09.CrossRefGoogle Scholar
  7. 7.
    M.J. Flynn Some Computer Organizations and Their Effectiveness. IEEE Transactions on Computers, Vol. C-21, No. 9, September 1972, pp. 948–960.MathSciNetCrossRefGoogle Scholar
  8. 8.
    W. Handler Innovative computer architecture — how to increase parallelism but not complexity. Parallel Processing Systems, An Advanced Course, Evans DJ ed, Cambridge University Press, Cambridge, 1982, pp. 1–41Google Scholar
  9. 9.
    I. Hennessy, D. Patterson Computer Architecture — a Quantitative Approach. Palo Alto, 1990Google Scholar
  10. 10.
    R.W. Hockney, C.R. Jesshope Parallel Computers 2. Adam Hilger/IOP Publishing, Bristol, 1988zbMATHGoogle Scholar
  11. 11.
    G.M. Amdahl Validity of single-processor approach to achieving large-scale computing capability. Proceedings of AFIPS Conference, Reston, VA, 1967, pp. 483–485Google Scholar
  12. 12.
    J.L. Gustafson Reevaluating Amdahl’s Law. CACM, 31(5), 1988, pp. 532–533Google Scholar
  13. 13.
    C.L. Seitz The cosmic cube. Communications of the ACM, 28(1), January 1985–June 1984, pp. 22–33MathSciNetCrossRefGoogle Scholar
  14. 14.
    G.J. Lipovski, M. Malek Parallel Computing: Theory and Comparisons. Wiley-Interscience, New York, 1987Google Scholar
  15. 15.
    H.J. Siegel, L.J. Siegel, F.C. Kemmerer, P.T. Mueller, Jr., H.E. Smalley, S.D. Smith PASM: a partitionable SIMD/MIMD system for image processing. ACM SIGARCH Computer Architecture News, Vol. 12, Issue 4, September 1984, pp. 7–19CrossRefGoogle Scholar
  16. 16.
    J.T. Schwartz Ultracomputers. ACM Transactions on Programming Languages and Systems, Vol. 2, No. 4, October 1980, pp. 484–521zbMATHCrossRefGoogle Scholar
  17. 17.
    M. Malek High-Performance Computing in Europe. DIANE Publishing Company, 1993Google Scholar
  18. 18.
    L. Kleinrock Information Flow in Large Communication Nets. RLE Quarterly Progress Report, 1961Google Scholar
  19. 19.
    P. Baran On Distributed Communications Networks. The RAND Corporation, Paper-P2626, 1962Google Scholar
  20. 20.
    J.C.R. Licklider, R.W. Taylor The Computer as a Communication Device. Science and Technology, April 1968Google Scholar
  21. 21.
    M. Weiser Some Computer Science Issues in Ubiquitous Computing. ACM, 36(7), 1993, pp. 74–84Google Scholar
  22. 22.
    K. Hwang, F.A. Briggs Computer Architecture and Parallel Processing. Mc-Graw Hill, London, 1984, pp. 32–40zbMATHGoogle Scholar
  23. 23.
    M.J. Quinn Designing Efficient Algorithms for Parallel Computers. McGraw Hill, 1987Google Scholar
  24. 24.
    G.S. Almasi, A. Gottlieb Highly Parallel Computing, 2nd ed. Benjamin/Cummings division of Addison Wesley Inc., 1994 1st edition, 1989Google Scholar
  25. 25.
    A.S. Tanenbaum Distributed Operating Systems. Vrije University, Amsterdam, Prentice Hall, 1995zbMATHGoogle Scholar
  26. 26.
    M. Ben-Ari Principles of Concurrent and Distributed Programming. Prentice Hall International Inc., Englewood Cliffs, NJ, 1989zbMATHGoogle Scholar
  27. 27.
    M. Malek CobWeb: Challenge of Billions in the Web. Proceedings of Future Directions in Distributed Computing, Bertinoro, Italy, 2002Google Scholar
  28. 28.
    M. Malek The NOMADS Republic. Proceedings of SSGRR 2003, Telecom Italia, L’Aquila, Italy, 2003Google Scholar
  29. 29.
    N. Milanovic, V. Stantchev, J. Richling, M. Malek Towards Adaptive and Composable Services. Proceedings of IPSI 2003, Sveti Stefan, Montenegro, 2003Google Scholar
  30. 30.
    N. Milanovic, J. Richling, M. Malek Lightweight Services for Embedded Systems. Proceedings of 2nd IEEE Workshop on Software Technologies for Embedded and Ubiquitous Computing Systems, Vienna, Austria, 2004Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Miroslaw Malek
    • 1
  1. 1.Humboldt-Universität zu BerlinBerlin

Personalised recommendations