Abstract
In the LEXIS project, a tsunami and earthquake large scale pilot is being deployed on top of an innovative HPC/Cloud orchestration layer, combining real-time deadlines, high performance simulations and cloud processing. To handle this, we have relied on a suitable model of computation oriented towards performance and real-time requirements, and used it to model, map and integrate the pilot workflow over the LEXIS orchestration and data exchanges technologies. This paper describes how the model of computation expresses real-time constraints over workflows, how such a model can be used to compute the necessary resources for a target latency and quality of service, and how the LEXIS orchestration layer is extended to offer the necessary features to implement this workflow.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
References
Atrey, A., Moens, H., Seghbroeck, G., Volckaert, B., Turck, F.: An overview of the oasis tosca standard: Topology and orchestration specification for cloud applications. Technical Report, IBCN-iMinds, Department of Information Technology (2015)
Ben-Nun, T., de Fine Licht, J., Ziogas, A.N., Schneider, T., Hoefler, T.: Stateful dataflow multigraphs: a data-centric model for performance portability on heterogeneous architectures. In: Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis, SC 2019. Association for Computing Machinery, New York (2019). https://doi.org/10.1145/3295500.3356173
Cima, V., Böhm, S., Martinovič, J., Dvorský, J., Janurová, K., Aa, T.V., Ashby, T.J., Chupakhin, V.: Hyperloom: a platform for defining and executing scientific pipelines in distributed environments. In: Proceedings of the 9th Workshop and 7th Workshop on Parallel Programming and RunTime Management Techniques for Manycore Architectures and Design Tools and Architectures for Multicore Embedded Computing Platforms, PARMA-DITAM 2018, pp. 1–6. ACM, New York (2018). https://doi.org/10.1145/3183767.3183768
Cudennec, L., Dubrulle, P., Galea, F., Goubier, T., Sirdey, R.: Generating code and memory buffers to reorganize data on many-core architectures. In: Abramson, D., Lees, M., Krzhizhanovskaya, V.V., Dongarra, J.J., Sloot, P.M.A. (eds.) Proceedings of the International Conference on Computational Science, ICCS 2014, Cairns, Queensland, Australia, 10–12 June 2014, Procedia Computer Science, vol. 29, pp. 1123–1133. Elsevier (2014). https://doi.org/10.1016/j.procs.2014.05.101
Dubrulle, P., Gaston, C., Kosmatov, N., Lapitre, A.: Dynamic reconfigurations in frequency constrained data flow. In: Ahrendt, W., Tapia Tarifa, S.L. (eds.) Integrated Formal Methods, pp. 175–193. Springer, Cham (2019)
Dubrulle, P., Gaston, C., Kosmatov, N., Lapitre, A., Louise, S.: A data flow model with frequency arithmetic. In: Hähnle, R., van der Aalst, W. (eds.) Fundamental Approaches to Software Engineering, pp. 369–385. Springer International Publishing, Cham (2019)
Gordon, M.I., Thies, W., Amarasinghe, S.: Exploiting coarse-grained task, data, and pipeline parallelism in stream programs. In: International Conference on Architectural Support for Programming Languages and Operating Systems, San Jose, CA (2006). http://groups.csail.mit.edu/commit/papers/./06/gordon-asplos06.pdf
Goubier, T., Ajmar, A., D’Amico, C., Dubrulle, P., Grita, S., Louise, S., Martinovič, J., Martinovič, T., Rakowsky, N., Savio, P., Schorlemmer, D., Scionti, A., Terzo, O.: Earthquake and tsunami workflow leveraging the modern hpc/cloud environment in the lexis project. In: Barolli, L., Nishino, H., Enokido, T., Takizawa, M. (eds.) Advances in Networked-based Information Systems, pp. 223–234. Springer, Cham (2019)
Lee, E.A.: Cyber physical systems: Design challenges. In: 2008 11th IEEE International Symposium on Object and Component-Oriented Real-Time Distributed Computing (ISORC), pp. 363–369 (2008)
Lee, E.A., Messerschmitt, D.G.: Static scheduling of synchronous data flow programs for digital signal processing. IEEE Trans. Comput. C–36(1), 24–35 (1987)
Louise, S., Dubrulle, P., Goubier, T.: A model of computation for real-time applications on embedded manycores. In: 2014 IEEE 8th International Symposium on Embedded Multicore/Manycore SoCs, pp. 333–340 (2014)
Rakowsky, N., Harig, S., Androsov, A., Goubier, T., Neuwirth, H.: Towards near-realtime computation of tsunami inundation as part of the LEXIS project. In: EGU General Assembly Conference Abstracts, EGU General Assembly Conference Abstracts (2020)
Scionti, A., Ciccia, S., D’Amico, C., Terzo, O.: Hpc, cloud and big-data convergent architectures: the lexis approach (2019)
Svaton, V., Martinovic, J., Krenek, J., Esch, T., Tomancak, P.: HPC-as-a-service via HEAppE platform. In: Conference on Complex, Intelligent, and Software Intensive Systems, pp. 290–293. Springer, Heidelberg (2019)
Acknowledgements
This work was supported by the LEXIS project funded by the EU’s Horizon 2020 research and innovation programme (2014–2020) under grant agreement no. 825532.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Goubier, T. et al. (2021). Real-Time Model of Computation over HPC/Cloud Orchestration - The LEXIS Approach. In: Barolli, L., Poniszewska-Maranda, A., Enokido, T. (eds) Complex, Intelligent and Software Intensive Systems. CISIS 2020. Advances in Intelligent Systems and Computing, vol 1194. Springer, Cham. https://doi.org/10.1007/978-3-030-50454-0_24
Download citation
DOI: https://doi.org/10.1007/978-3-030-50454-0_24
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-50453-3
Online ISBN: 978-3-030-50454-0
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)