Visualization, Simulation and Validation for Cyber-Virtual Systems

  • Jan Olaf Blech
  • Maria Spichkova
  • Ian Peake
  • Heinz Schmidt
Conference paper
Part of the Communications in Computer and Information Science book series (CCIS, volume 551)


We present our framework for visualization, simulation and validation of cyber-physical systems in industrial automation during development, operation and maintenance. System models may represent an existing physical part – for example an existing robot installation – and a software simulated part – for example a possible future extension of the physical industrial automation setup. We call such systems cyber-virtual systems. Here, we present our VxLab infrastructure for visualization using combined large screens and its applications in industrial automation. The methodology for simulation and validation motivated in this paper is based on this infrastructure. We are targeting scenarios, where industrial sites which may be in remote locations are modeled, simulated and visualized. Modeling, simulation and the visualization can be done from different locations anywhere in the world. Here, we are also concentrating on software modeling challenges related to cyber-virtual systems and simulation, testing, validation and verification techniques applied to them. Software models of industrial sites require behavioral models of both human and machine oriented aspects such as workflows and the components of the industrial sites such as models for tools, robots, workpieces and other machinery as well as communication and sensor facilities. Furthermore, facilitating collaboration between sites and stakeholders, experts and operators is an important application of our work. This paper is an extension of our previously published work [1].


Cyber-physical systems Virtual interoperability testing Simulation System modeling Formal specification Visualization 



We would like to thank staff from RMIT ITS, PropertyServices, eResearch and the VxLab/VITELab team, in particular Lasith Fernando, Ravi Sreenivasamurthy, Garry Keltie, and Nicolas Vergnaud.


  1. 1.
    Blech, J.O., Spichkova, M., Peake, I.D., Schmidt, H.W.: Cyber-virtual systems - simulation, validation and visualization. In: Filipe, J., Maciaszek, L.A. (eds.) ENASE 2014 - Proceedings of the 9th International Conference on Evaluation of Novel Approaches to Software Engineering, Lisbon, Portugal, 28–30 April 2014, pp. 218–225. SciTePress (2014)Google Scholar
  2. 2.
    Schlager, M.: Hardware-in-the-loop simulation (2008)Google Scholar
  3. 3.
    Isermann, R., Schaffnit, J., Sinsel, S.: Hardware-in-the-loop simulation for the design and testing of engine-control systems. Control Eng. Pract. 7, 643–653 (1999)CrossRefGoogle Scholar
  4. 4.
    Basu, A., Bozga, M., Sifakis, J.: Modeling heterogeneous real-time components in BIP. In: 4th IEEE International Conference on Software Engineering and Formal Methods (SEFM), pp. 3–12. IEEE (2006)Google Scholar
  5. 5.
    Donath, U., Haufe, J., Blochwitz, T., Neidhold, T.: A new approach for modeling and verification of discrete control components within a modelica environment (2008)Google Scholar
  6. 6.
    Fritzson, P.: Principles of Object-Oriented Modeling and Simulation with Modelica 2.1. Wiley-IEEE Computer Society Press, New York (2004) Google Scholar
  7. 7.
    Anderson, A., Fritzson, P.: Models for distributed real-time simulation in a vehicle co-simulator setup. In: Nilsson, H. (ed.) Proceedings of the 5th International Workshop on Equation-Based Object-Oriented Modeling Languages and Tools. Linkoping University Electronic Press (2013)Google Scholar
  8. 8.
    Tundis, A., Rogovchenko-Buffoni, L., Fritzson, P., Garro, A.: Modeling system requirements in modelica: definition and comparison of candidate approaches. In: Nilsson, H. (ed.) Proceedings of the 5th International Workshop on Equation-Based Object-Oriented Modeling Languages and Tools. Linkoping University Electronic Press (2013)Google Scholar
  9. 9.
    Fritzson, P.: Introduction to Modeling and Simulation of Technical and Physical Systems with Modelica. Wiley-IEEE Computer Society Press, New York (2011)CrossRefGoogle Scholar
  10. 10.
    Deshpande, A., Göllü, A., Varaiya, P.: SHIFT: a formalism and a programming language for dynamic networks of hybrid automata. In: Antsaklis, P.J., Kohn, W., Nerode, A., Sastry, S.S. (eds.) HS 1996. LNCS, vol. 1273, pp. 113–133. Springer, Heidelberg (1997) CrossRefGoogle Scholar
  11. 11.
    Kratz, F., Sokolsky, O., Pappas, G.J., Lee, I.: R-Charon, a modeling language for reconfigurable hybrid systems. In: Hespanha, J.P., Tiwari, A. (eds.) HSCC 2006. LNCS, vol. 3927, pp. 392–406. Springer, Heidelberg (2006) CrossRefGoogle Scholar
  12. 12.
    Behrmann, G., David, A., Larsen, K.G.: A tutorial on Uppaal. In: Bernardo, M., Corradini, F. (eds.) SFM-RT 2004. LNCS, vol. 3185, pp. 200–236. Springer, Heidelberg (2004) CrossRefGoogle Scholar
  13. 13.
    Beek, D.A.V., Man, K.L., Reniers, M.A., Rooda, J.E., Schiffelers, R.R.H.: Syntax and consistent equation semantics of hybrid Chi. J. Logic Algebraic Program. 68, 129–210 (2006)MathSciNetCrossRefzbMATHGoogle Scholar
  14. 14.
    Berners-Lee, T., Hendler, J., Lassila, O., et al.: The semantic web. Sci. Am. 284, 28–37 (2001)CrossRefGoogle Scholar
  15. 15.
    Staab, S., Studer, R., Schnurr, H.P., Sure, Y.: Knowledge processes and ontologies. IEEE Intell. Syst. 16, 26–34 (2001)CrossRefGoogle Scholar
  16. 16.
    Frehse, G., Le Guernic, C., Donzé, A., Cotton, S., Ray, R., Lebeltel, O., Ripado, R., Girard, A., Dang, T., Maler, O.: SpaceEx: scalable verification of hybrid systems. In: Gopalakrishnan, G., Qadeer, S. (eds.) CAV 2011. LNCS, vol. 6806, pp. 379–395. Springer, Heidelberg (2011) CrossRefGoogle Scholar
  17. 17.
    Cardelli, L., Gardner, P.: Processes in space. In: Ferreira, F., Löwe, B., Mayordomo, E., Mendes Gomes, L. (eds.) CiE 2010. LNCS, vol. 6158, pp. 78–87. Springer, Heidelberg (2010) CrossRefGoogle Scholar
  18. 18.
    Hirschkoff, D., Lozes, É., Sangiorgi, D.: Minimality results for the spatial logics. In: Pandya, P.K., Radhakrishnan, J. (eds.) FSTTCS 2003. LNCS, vol. 2914, pp. 252–264. Springer, Heidelberg (2003) CrossRefGoogle Scholar
  19. 19.
    Dal Zilio, S., Lugiez, D., Meyssonnier, C.: A logic you can count on. ACM SIGPLAN Not. 39, 135–146 (2004)CrossRefzbMATHGoogle Scholar
  20. 20.
    Bennett, B., Cohn, A.G., Wolter, F., Zakharyaschev, M.: Multi-dimensional modal logic as a framework for spatio-temporal reasoning. Appl. Intell. 17, 239–251 (2002)CrossRefzbMATHGoogle Scholar
  21. 21.
    Vogel-Heuser, B., Feldmann, S., Werner, T., Diedrich, C.: Modeling network architecture and time behavior of distributed control systems in industrial plant. In: 37th Annual Conference of the IEEE Industrial Electronics Society, IECON (2011)Google Scholar
  22. 22.
    Hadlich, T., Diedrich, C., Eckert, K., Frank, T., Fay, A., Vogel-Heuser, B.: Common communication model for distributed automation systems. In: 9th IEEE International Conference on Industrial Informatics, IEEE INDIN (2011)Google Scholar
  23. 23.
    Berger, A.: Embedded Systems Design: An Introduction to Processes, Tools, and Techniques. CMP Books, San Francisco (2002)Google Scholar
  24. 24.
    Sapienza, G., Crnkovic, I., Seceleanu, T.: Towards a methodology for hardware and software design separation in embedded systems. In: Proceedings of the Seventh International Conference on Software Engineering Advances (ICSEA), pp. 557–562. IARIA (2012)Google Scholar
  25. 25.
    Spichkova, M., Campetelli, A.: Towards system development methodologies: from software to cyber-physical domain. In: First International Workshop on Formal Techniques for Safety-Critical Systems (FTSCS 2012) (2012)Google Scholar
  26. 26.
    Dominka, S., Schiller, F., Kain, S.: Hybrid commissioning from hardware-in-the-loop simulation to real production plants. In: Proceedings of the 18th IASTED International Conference on Modeling and Simulation (MS 2007), pp. 544–549 (2007)Google Scholar
  27. 27.
    Hazra, A., Ghosh, P., Vadlamudi, S.G., Chakrabarti, P.P., Dasgupta, P.: Formal methods for early analysis of functional reliability in component-based embedded applications. Embed. Syst. Lett. 5, 8–11 (2013)CrossRefGoogle Scholar
  28. 28.
    Broy, M., Jonsson, B., Katoen, J.-P., Leucker, M., Pretschner, A. (eds.): Model-Based Testing of Reactive Systems. LNCS, vol. 3472. Springer, Heidelberg (2005) zbMATHGoogle Scholar
  29. 29.
    Pretschner, A., Philipps, J.: Methodological issues in model-based testing. In: Model-Based Testing of Reactive Systems, pp. 181–291 (2005)Google Scholar
  30. 30.
    Spichkova, M., Schmidt, H., Peake, I.: From abstract modelling to remote cyber-physical integration/interoperability testing. In: Improving Systems and Software Engineering Conference (2013)Google Scholar
  31. 31.
    Blech, J.O., Schmidt, H., Peake, I., Kande, M., Ramaswamy, S., Sudarsan, S.D., Narayanan, V.: Collaborative engineering through integration of architectural, social and spatial models. In: Emerging Technologies and Factory Automation (ETFA). IEEE Computer (2014)Google Scholar
  32. 32.
    Peake, I., Blech, J.O., Fernando, L.: Towards reconstructing architectural models of software tools by runtime analysis. In: 3rd International Workshop on Experiences and Empirical Studies in Software Modelling (2013)Google Scholar
  33. 33.
    Spichkova, M.: Design of formal languages and interfaces: “formal” does not mean “unreadable”. In Blashki, K., Isaias, P. (eds.) Emerging Research and Trends in Interactivity and the Human-Computer Interface. IGI Global (2013)Google Scholar
  34. 34.
    Spichkova, M.: Human Factors of Formal Methods. In: Proceedings of IADIS Interfaces and Human Computer Interaction, IHCI 2012 (2012)Google Scholar
  35. 35.
    Spichkova, M., Zhu, X., Mou, D.: Do we really need to write documentation for a system? In: International Conference on Model-Driven Engineering and Software Development (MODELSWARD 2013) (2013)Google Scholar
  36. 36.
    Spichkova, M.: Specification and seamless verification of embedded real-time systems: FOCUS on Isabelle. Ph.D. thesis, Technische Universität München (2007)Google Scholar
  37. 37.
    Spichkova, M.: Stream processing components: Isabelle/HOL formalisation and case studies. Archive of Formal Proofs (2013)Google Scholar
  38. 38.
    Blech, J.O., Falcone, Y., Rueß, H., Schätz, B.: Behavioral specification based runtime monitors for OSGi services. In: Margaria, T., Steffen, B. (eds.) ISoLA 2012, Part I. LNCS, vol. 7609, pp. 405–419. Springer, Heidelberg (2012) Google Scholar
  39. 39.
    de Alfaro, L., Henzinger, T.A.: Interface automata. SIGSOFT Softw. Eng. Notes 26, 109–120 (2001)CrossRefGoogle Scholar
  40. 40.
    Blech, J.O., Schätz, B.: Towards a formal foundation of behavioral types for uml state-machines. ACM SIGSOFT Softw. Eng. Notes 37, 1–8 (2012)CrossRefGoogle Scholar
  41. 41.
    Blech, J.O.: Towards a framework for behavioral specifications of OSGI components. In: 11th International Workshop on Formal Engineering approaches to Software Components and Architectures (FESCA), pp. 79–93 (2013)Google Scholar
  42. 42.
    Blech, J.O., Schmidt, H.: Towards modeling and checking the spatial and interaction behavior of widely distributed systems. In: Improving Systems and Software Engineering Conference (2013)Google Scholar
  43. 43.
    de Moura, L., Bjørner, N.S.: Z3: an efficient SMT solver. In: Ramakrishnan, C.R., Rehof, J. (eds.) TACAS 2008. LNCS, vol. 4963, pp. 337–340. Springer, Heidelberg (2008) CrossRefGoogle Scholar
  44. 44.
    Spichkova, M., Blech, J.O., Herrmann, P., Schmidt, H.W.: Modeling spatial aspects of safety-critical systems with focus-st. In: Boulanger, F., Famelis, M., Ratiu, D. (eds.) Proceedings of the 11th Workshop on Model-Driven Engineering, Verification and Validation co-located with 17th International Conference on Model Driven Engineering Languages and Systems, MoDeVVa@MODELS 2014, Valencia, Spain, September 30, 2014. Volume 1235 of CEUR Workshop Proceedings, pp. 49–58. (2014)

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  • Jan Olaf Blech
    • 1
  • Maria Spichkova
    • 1
  • Ian Peake
    • 1
  • Heinz Schmidt
    • 1
  1. 1.RMIT UniversityMelbourneAustralia

Personalised recommendations