Generalized Approach to Scalability Analysis of Parallel Applications

  • Alexander AntonovEmail author
  • Alexey Teplov
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10049)


This article describes an approach to scalability analysis of parallel applications, which is a major part of the algorithm description used in AlgoWiki, the Open Encyclopedia of Parallel Algorithmic Features. The proposed approach is based on the suggested definition of generalized scalability of a parallel application. This study uses joined and structured data on an application’s execution and supercomputing co-design technologies. Parallel application properties are studied by analyzing data collected from all available sources of its dynamic characteristics and information about the hardware and software platforms corresponding with the features of an algorithm and its implementation. This allows reasonable conclusion to be drawn regarding potential reasons of changes in the execution quality for any parallel applications and to compare the scalability of various programs.


Scalability Dynamic characteristics Efficiency Parallel computing Supercomputing co-design 


  1. 1.
    Voevodin, V., Antonov, A., Dongarra, J.: AlgoWiki: an open encyclopedia of parallel algorithmic features. Supercomputing Front. Innovations 2(1), 4–18 (2015)Google Scholar
  2. 2.
    Frolov, A.V., Antonov, A.S., Voevodin, VI.V., Teplov, A.M.: One problem solving different methods’ comparison according to the criteria of the Algowiki project. In: Proceedings of the 10th Annual International Scientific Conference on Parallel Computing Technologies, Arkhangelsk, Russia, pp. 347–360 (2016)Google Scholar
  3. 3.
    Gddeke, D., et al.: Exploring weak scalability for FEM calculations on a GPU-enhanced cluster. Parallel Comput. 33(10), 685–699 (2007)CrossRefGoogle Scholar
  4. 4.
    Bondi, A.B.: Characteristics of scalability and their impact on performance. In: Proceedings of the 2nd International Workshop on Software and Performance, pp. 195–203. ACM (2000)Google Scholar
  5. 5.
    Patil, R.V., George, B.: Tools and techniques to identify concurrency issues. MSDN Magazine (2008)Google Scholar
  6. 6.
    Levin, M.P.: Parallel Programming Using OpenMP. Binom, Moscow (2008)Google Scholar
  7. 7.
    Ivanov, D.E.: Scalable parallel genetic algorithm for generating the identifying sequences for modern multicore computing systems. Control Syst. Comput. (1), 25–32 (2011)Google Scholar
  8. 8.
    Gergel, V.P., Fursov, V.A.: Lectures on Parallel Computations, Samara (2009)Google Scholar
  9. 9.
    Alabdulkareem, M., Lakshmivarahan, S., Dhall, S.K.: Scalability analysis of large codes using factorial designs. J. Parallel Comput. 27(9), 1145–1171 (2001)CrossRefzbMATHGoogle Scholar
  10. 10.
    Barnes, B., et al.: A regression-based approach to scalability prediction. In: Proceedings of the 22nd International Conference on Supercomputing, pp. 368–377 (2008)Google Scholar
  11. 11.
    Chi, C.C., Alvarez-Mesa, M., Juurlink, B., Clare, G., Henry, F., Pateux, S., Schierl, T.: Parallel scalability and efficiency of HEVC parallelization approaches. IEEE Trans. Circ. Syst. Video Technol. 22(12), 1827–1838 (2012)CrossRefGoogle Scholar
  12. 12.
    Grama, A.Y., Gupta, A., Kumar, V.: Isoefficiency: measuring the scalability of parallel algorithms and architectures. IEEE Parallel Distrib. Technol. 1(3), 12–21 (1993)CrossRefGoogle Scholar
  13. 13.
    Reed, D., Roth, P.C., Aydt, R., Shields, K., Tavera, L.F., Noe, R.J., Schwartz, B.W.: Scalable performance analysis: the Pablo performance analysis environment. In: Proceedings of the IEEE on Scalable Parallel Libraries Conference, pp. 104–113 (1993)Google Scholar
  14. 14.
    Teplov, A.M.: Analysis of scalability of parallel applications on the basis of supercomputer co-design technologies. Ph.D. thesis, Moscow (2015)Google Scholar
  15. 15.
    Adinetz, A.V., Bryzgalov, P.A., Zhumatiy, S.A., Nikitenko, D.A., Stefanov, K.S.: Job Digest–approach to jobs dynamic properties investigation on supercomputer systems. Vestnik UGATU (Sci. J. Ufa State Aviat. Tech. Univ.) 17(2), 131–188 (2013)Google Scholar
  16. 16.
    Antonov, A.S., Teplov, A.M.: Analysis of the parallel programs scalability based on supercomputer co-design technologies. In: Computer Technologies in Sciences. Methods of Simulations on Supercomputers. Part 2 Proceedings, Tarusa, pp. 18–28 (2015)Google Scholar
  17. 17.
    Antonov, A., Voevodin, V., Voevodin, V., Teplov, A.: A study of the dynamic characteristics of software implementation as an essential part for a universal description of algorithm properties. In: 24th Euromicro International Conference on Parallel, Distributed, and Network-Based Processing Proceedings, pp. 359–363 (2016)Google Scholar
  18. 18.
    Nikitenko, D., Voevodin, V., Zhumatiy, S., Stefanov, K., Teplov, A., Shvets, P., Voevodin, V.: Supercomputer application integral characteristics analysis for the whole queued job collection of large-scale hpc systems. In: Proceedings of the International Scientific Conference on Parallel Computational Technologies (PCT 2016), Chelyabinsk, pp. 20–30 (2016)Google Scholar
  19. 19.
    Antonov, A.S., Teplov, A.M.: Use of system monitoring data to determine factors reducing application scalability. Izvestiya SFedU. Eng. Sci. 12(161), 90–101 (2014)Google Scholar
  20. 20.
    Teplov, A.M.: An approach to the comparison of parallel program scalability. Numer. Methods Program. 15(4), 697–711 (2014)Google Scholar
  21. 21.
    Adinets, A.V., Bryzgalov, P.A., Voevodin, V.V., Zhumatii, S.A., Nikitenko, D.A., Stefanov, K.S.: Job digest: an approach to dynamic analysis of job characteristics on supercomputers. Numer. Methods Program. 13, 160–166 (2012)Google Scholar
  22. 22.
    Sadovnichy, V., Tikhonravov, A., Voevodin, V., Opanasenko, V.: “Lomonosov”: Supercomputing at Moscow State University. Contemporary High Performance Computing: From Petascale toward Exascale. Chapman & Hall/CRC Computational Science, Boca Raton (2013)Google Scholar

Copyright information

© Springer International Publishing AG 2016

Authors and Affiliations

  1. 1.Moscow State UniversityMoscowRussia

Personalised recommendations