Advertisement

Collaborative Development and Use of Scientific Applications in Orlando Tools: Integration, Delivery, and Deployment

  • Alexander FeoktistovEmail author
  • Sergei GorskyEmail author
  • Ivan Sidorov
  • Igor Bychkov
  • Andrei TchernykhEmail author
  • Alexei Edelev
Conference paper
  • 7 Downloads
Part of the Communications in Computer and Information Science book series (CCIS, volume 1087)

Abstract

The paper addresses practical challenges related to the development and application of distributed software packages of the Orlando Tools framework to solve real problems. Such packages include a special class of scientific applications characterized by a wide class of problem solvers, modular structure of software, algorithmic knowledge implemented by modules, computations scalability, execution in heterogeneous resources, etc. It is adapted for various categories of users: developers, administrators, and end-users. Unlike other tools for developing scientific applications, Orlando Tools provides supports for the intensive evolution of algorithmic knowledge, adaptation of existed and designing new ones. It has the capability to extend the class of solved problems. We implement and automate the non-trivial technological sequence of the collaborative development and use of packages including the continuous integration, delivery, deployment, and execution of package modules in a heterogeneous distributed environment that integrates grid and cloud computing. This approach reduces the complexity of the collaborative development and use of packages, and increases software operation predictability through the preliminary detecting and eliminating errors with significant reduction of the correcting cost.

Keywords

Grid Cloud Applied software packages Continuous integration Delivery Deployment Collaborative computing 

Notes

Acknowledgment

The study is supported by the Russian Foundation of Basic Research, projects no. 19-07-00097-a and no. 18-07-01224-a. This work was also supported in part by Basic Research Program of SB RAS, projects no. IV.38.1.1 and no. III.17.5.1.

References

  1. 1.
    Barker, A., van Hemert, J.: Scientific workflow: a survey and research directions. In: Wyrzykowski, R., Dongarra, J., Karczewski, K., Wasniewski, J. (eds.) PPAM 2007. LNCS, vol. 4967, pp. 746–753. Springer, Heidelberg (2008).  https://doi.org/10.1007/978-3-540-68111-3_78CrossRefGoogle Scholar
  2. 2.
    Duvall, P.M., Matyas, S., Glover, A.: Continuous Integration: Improving Software Quality and Reducing Risk. Addison Wesley Professional, Boston (2007)Google Scholar
  3. 3.
    Deelman, E., et al.: The future of scientific workflows. Int. J. High Perform. Comput. Appl. 32(1), 159–175 (2018)CrossRefGoogle Scholar
  4. 4.
    Krol, M., Rene, S., Ascigil, O., Psaras, I.: ChainSoft: collaborative software development using smart contracts. In: 1st Workshop on Cryptocurrencies and Blockchains for Distributed Systems, pp. 1–6. ACM (2018)Google Scholar
  5. 5.
    Sochat, V.: Containershare: open source registry to build, test, deploy with CircleCI. J. Open Source Softw. 3(28), 1–3 (2018)CrossRefGoogle Scholar
  6. 6.
    Soni, M., Berg, A.M.: Jenkins 2.x Continuous Integration Cookbook. Packt Publishing, Birmingham (2017)Google Scholar
  7. 7.
    Machiraju, S., Gaurav, S.: Deployment via TeamCity and Octopus Deploy. In: Machiraju, S., Gaurav, S. (eds.) DevOps for Azure Applications, pp. 11–38. Apress, New York (2018)CrossRefGoogle Scholar
  8. 8.
    Beller, M., Gousios, G., Zaidman, A.: Oops, my tests broke the build: an explorative analysis of travis CIDD with GitHub. In: 14th International Conference on Mining Software Repositories, pp. 356–367. IEEE (2017)Google Scholar
  9. 9.
    Gruver, G.: Start and Scaling Devops in the Enterprise. BookBaby, Pennsauken (2016)Google Scholar
  10. 10.
    Shahin, M., Babar, M.A., Zhu, L.: Continuous integration, delivery and deployment: a systematic review on approaches, tools, challenges and practices. IEEE Access 5, 3909–3943 (2017)CrossRefGoogle Scholar
  11. 11.
    Wolff, E.: A Practical Guide to Continuous Delivery. Addison-Wesley, Boston (2017)Google Scholar
  12. 12.
    CruiseControl.NET. https://sourceforge.net/projects/ccnet. Accessed 7 May 2019
  13. 13.
    Apache Gump. https://gump.apache.org/. Accessed 7 May 2019
  14. 14.
    Conan C/C++ package manager. https://www.conan.io. Accessed 7 May 2019
  15. 15.
    BuildMaster. https://inedo.com/buildmaster. Accessed 7 May 2019
  16. 16.
    Heckel, T.: Meet Travis CI: Open Source Continuous Integration, InfoQ (2013). https://www.infoq.com/news/2013/02/travis-ci. Accessed 7 May 2019
  17. 17.
    Chacon, S., Straub, B.: Pro Git. Apress, New York (2014)CrossRefGoogle Scholar
  18. 18.
    Barrett, D., Silverman, R., Byrnes, R.: SSH: The Secure Shell (The Definitive Guide). O’Reilly, Sebastopol (2005)Google Scholar
  19. 19.
    Blum, R.: Linux Command Line and Shell Scripting Bible. Wiley, Hoboken (2017)Google Scholar
  20. 20.
    Colvin, H.: VirtualBox: An Ultimate Guide Book on Virtualization with VirtualBox. CreateSpace Independent Publishing Platform, Scotts Valley (2015)Google Scholar
  21. 21.
  22. 22.
    Kane, S., Matthias, K.: Docker: Up and Running: Shipping Reliable Containers in Production. O’Relly Media, Sebastopol (2018)Google Scholar
  23. 23.
    Smith, R.: Docker Orchestration. Packt Publishing, Birmingham (2017)Google Scholar
  24. 24.
    Luksa, M.: Kubernetes in Action. Manning Publications, Shelter Island (2018)CrossRefGoogle Scholar
  25. 25.
  26. 26.
    Feoktistov, A., Gorsky, S., Sidorov, I., Kostromin, R., Edelev, A., Massel, L.: Orlando tools: energy research application development through convergence of grid and cloud computing. In: Voevodin, V., Sobolev, S. (eds.) RuSCDays 2018. CCIS, vol. 965, pp. 289–300. Springer, Cham (2019).  https://doi.org/10.1007/978-3-030-05807-4_25CrossRefGoogle Scholar
  27. 27.
    Jonsson, H., Johansson, J., Johansson, H.: Identifying critical components in technical infrastructure networks. Proc. Inst. Mech. Eng. Part O J. Risk Reliab. 222(2), 235–243 (2008)CrossRefGoogle Scholar
  28. 28.
    Irkutsk Supercomputer center of SB RAS. http://hpc.icc.ru. Accessed 7 May 2019
  29. 29.
    Edelev, A.V., Sidorov, I.A., Feoktistov, A.G.: Heterogeneous distributed computing environment for vulnerability analysis of energy critical infrastructures. In: Massel, L., Makagonova, N., Kopaygorodsky, A., Massel, A. (eds.) 5th International workshop on Critical infrastructures: Contingency management, Intelligent, Agent-based, Cloud computing and Cyber security. Advances in Intelligent Systems Research, vol. 158, pp. 37–42 (2018)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2020

Authors and Affiliations

  1. 1.Matrosov Institute for System Dynamics and Control Theory of SB RASIrkutskRussia
  2. 2.CICESE Research CenterEnsenadaMexico
  3. 3.Ivannikov Institute for System Programming of RASMoscowRussia
  4. 4.South Ural State UniversityChelyabinskRussia
  5. 5.Melentiev Energy Systems Institute of SB RASIrkutskRussia

Personalised recommendations