Formal Verification of Programs That Use MPI One-Sided Communication

  • Salman Pervez
  • Ganesh Gopalakrishnan
  • Robert M. Kirby
  • Rajeev Thakur
  • William Gropp
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4192)


We used formal-verification methods based on model checking to analyze the correctness properties of one existing and two new distributed-locking algorithms implemented by using MPI’s one-sided communication. Model checking exposed an overlooked correctness issue with the first algorithm, which had been developed by relying only on manual reasoning. Model checking helped confirm the basic correctness properties of the two new algorithms, while also identifying the remaining problems in them. Our experience is that MPI-based programming, especially the tricky and relatively poorly understood one-sided communication features, stand to gain immensely from model checking. Considering that many other areas of concurrent hardware and software design now routinely employ model checking, our experience confirms that the MPI community can benefit greatly from the use of formal verification.


Model Check Message Passing Interface Symbolic Execution Memory Window Exclusive Access 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Ball, T., Cook, B., Levin, V., Rajamani, S.K.: SLAM and static driver verifier: Technology transfer of formal methods inside microsoft. In: Boiten, E.A., Derrick, J., Smith, G.P. (eds.) IFM 2004. LNCS, vol. 2999, pp. 1–20. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  2. 2.
    Clarke, E.M., Grumberg, O., Peled, D.: Model Checking. MIT Press, Cambridge (1999)Google Scholar
  3. 3.
    Gropp, W., Lusk, E., Thakur, R.: Using MPI-2: Advanced Features of the Message-Passing Interface. MIT Press, Cambridge (1999)Google Scholar
  4. 4.
    Gropp, W., Thakur, R.: An evaluation of implementation options for MPI one-sided communication. In: Di Martino, B., Kranzlmüller, D., Dongarra, J. (eds.) EuroPVM/MPI 2005. LNCS, vol. 3666, pp. 415–424. Springer, Heidelberg (2005)CrossRefGoogle Scholar
  5. 5.
    Holzmann, G.J.: The Spin Model Checker: Primer and Reference Manual. Addison-Wesley, Reading (2003)Google Scholar
  6. 6.
    Kranzlmüller, D.: Event Graph Analysis for Debugging Massively Parallel Programs. PhD thesis, John Kepler University Linz, Austria (September 2000),
  7. 7.
  8. 8.
    Luecke, G.R., Spanoyannis, S., Kraeva, M.: The performance and scalability of SHMEM and MPI-2 one-sided routines on a SGI Origin 2000 and a Cray T3E-600. Concurrency and Computation: Practice and Experience 16(10), 1037–1060 (2004)CrossRefGoogle Scholar
  9. 9.
    Shumsky Matlin, O., Lusk, E., McCune, W.: SPINning parallel systems software. In: Bošnački, D., Leue, S. (eds.) SPIN 2002. LNCS, vol. 2318, pp. 213–220. Springer, Heidelberg (2002)CrossRefGoogle Scholar
  10. 10.
    Message Passing Interface Forum. MPI-2: Extensions to the Message-Passing Interface (July 1997),
  11. 11.
  12. 12.
    Pervez, S.: Byte-range locks using MPI one-sided communication. Technical report, University of Utah, School of Computing (2006),
  13. 13.
    Siegel, S.F., Avrunin, G.S.: Verification of MPI-based software for scientific computation. In: Graf, S., Mounier, L. (eds.) SPIN 2004. LNCS, vol. 2989, pp. 286–303. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  14. 14.
    Siegel, S.F., Mironova, A., Avrunin, G.S., Clarke, L.A.: Using model checking with symbolic execution to verify parallel numerical programs. In: Proceedings of the ACM SIGSOFT 2006 International Symposium on Software Testing and Analysis (July 2006)Google Scholar
  15. 15.
    Tanenbaum, A.S.: Modern Operating Systems. Prentice-Hall, Inc., Englewood Cliffs (2001)Google Scholar
  16. 16.
    Thakur, R., Gropp, W., Toonen, B.: Optimizing the synchronization operations in MPI one-sided communication. International Journal of High-Performance Computing Applications 19(2), 119–128 (2005)CrossRefGoogle Scholar
  17. 17.
    Thakur, R., Ross, R., Latham, R.: Implementing byte-range locks using MPI one-sided communication. In: Di Martino, B., Kranzlmüller, D., Dongarra, J. (eds.) EuroPVM/MPI 2005. LNCS, vol. 3666, pp. 119–128. Springer, Heidelberg (2005)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Salman Pervez
    • 1
  • Ganesh Gopalakrishnan
    • 1
  • Robert M. Kirby
    • 1
  • Rajeev Thakur
    • 2
  • William Gropp
    • 2
  1. 1.School of ComputingUniversity of UtahSalt Lake CityUSA
  2. 2.Mathematics and Computer Science DivisionArgonne National LaboratoryArgonneUSA

Personalised recommendations