Lessons learned from implementing BSP

  • Jonathan M. D. Hill
  • David B. Skillicorn
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 1225)


We focus on two criticisms of Bulk Synchronous Parallelism (BSP): that delaying communication until specific points in a program causes poor performance, and that frequent barrier synchronisations are too expensive for high-performance parallel computing. We show that these criticisms are misguided, not just about BSP but about parallel programming in general, because they are based on misconceptions about the origins of poor performance. The main implication for parallel programming is that higher levels of abstraction do not only make software construction easier—they also make high-performance implementation easier.


Shared Memory Delivery Time Runtime System Cache Coherence Barrier Synchronisation 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    M.W. Goudreau, J.M.D. Hill, K. Lang, W.F. McColl, S.D. Rao, D.C. Stefanescu, T. Suel, and T. Tsantilas. A proposal for a BSP Worldwide standard. BSP Worldwide,, April 1996.Google Scholar
  2. 2.
    J.M.D. Hill and D.B. Skillicorn. Practical barrier synchronisation. Technical Report TR-16-96, Oxford University Computing Laboratory, August 1996.Google Scholar
  3. 3.
    W.F. McColl. General purpose parallel computing. In A.M. Gibbons and P. Spirakis, editors, Lectures on Parallel Computation, Cambridge International Series on Parallel Computation, pages 337–391, 1993.Google Scholar
  4. 4.
    D.B. Skillicorn, J.M.D. Hill, and W.F. McColl. Questions and answers about BSP. Technical Report TR-15-96, Oxford University Computing Laboratory, August 1996.Google Scholar
  5. 5.
    L.G. Valiant. A bridging model for parallel computation. Communications of the ACM, 33(8): 103–111, August 1990.Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 1997

Authors and Affiliations

  • Jonathan M. D. Hill
    • 1
  • David B. Skillicorn
    • 2
  1. 1.Computing LaboratoryOxford UniversityUK
  2. 2.Department of Computing and Information ScienceQueen's UniversityKingstonCanada

Personalised recommendations