How to Perform Verification and Validation of Critical Infrastructure Modeling Tools

  • Alfonso Farina
  • Antonio Graziano
  • Stefano Panzieri
  • Federica Pascucci
  • Roberto Setola
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6983)


Simulation tools appear the only solution suitable for with the complexity of the actual critical infrastructure scenarios. Indeed, due to interdependency phenomena and the fast innovation of the technologies, our capability to predict the global behavior of such system of systems on the basis of past history and experiences is dramatically reduced, especially in the presence of anomalous or crisis situations. This drives many groups to develop simulation platforms also able to support decisions during crisis. However, a crucial and not adequately investigated aspect in this framework is the qualification of the predictable capabilities of these tools. This paper would start a discussion on how to validate different approaches, and how to asses their predictable capabilities, providing some insights on this strategic and very challenging task.


Simulation Critical-Infrastructures Credibility Accuracy 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Brunner, E., Suter, M.: International CIIP Handbook 2008/2009, CRN Handbooks series, Center for Security Studies (CSS), ETH Zurich (2008)Google Scholar
  2. 2.
    Bologna, S., Setola, R.: The Need to Improve Local Self-Awareness in CIP/CIIP. In: Proc. of First IEEE International Workshop on Critical Infrastructure Protection (IWCIP 2005), Darmstadt, Germany, pp. 84–89 (2005)Google Scholar
  3. 3.
    De Porcellinis, S., Panzieri, S., Setola, R., Ulivi, G.: Simulation of Heterogeneous and Interdependent Critical Infrastructures. Int. J. Critical Infrastructures (IJCIS) 4(1/2), 110–128 (2008)CrossRefGoogle Scholar
  4. 4.
    EU Project IRRIIS: Integrated Risk Reduction of Information-based Infrastructure Systems,
  5. 5.
    Critical Infrastructure Resiliency Simulation (CIPR/Sim),
  6. 6.
    National Infrastructure Simulation and Analysis Center (NISAC),
  7. 7.
    Pederson, P., Dudenhoeffer, D., Hartley, S., Permann, M.: Critical Infrastructure Interdependency Modelling: A Survey of U.S. and International Research, Idaho National Lab (2006)Google Scholar
  8. 8.
    EU project DIESIS (Design of an Interoperable European federated Simulation network for critical InfraStructures), Deliverable, D2.3 Report on available infrastructure simulators,
  9. 9.
    Setola, R.: How to Measure the Degree of Interdependencies among Critical Infrastructures. Int. J. of System of Systems Engineering (IJSSE) 2(1), 38–59 (2010)CrossRefGoogle Scholar
  10. 10.
    Topcu, O.: Review of Verification and Validation Methods in Simulation, Defence R&D Canada (2003)Google Scholar
  11. 11.
    Oberkampf, W.L., Trucano, T.G., Hirsch, C.: Verification, Validation and Predictive Capability in Computational Engineering and Physics. In: Proc. of Workshop Foundations for Verification and Validation in the 21st Century, October 22-23. Johns Hopkins University, Laurel (2002)Google Scholar
  12. 12.
    ANSI/IEEE, Standard Glossary for Software Engineering Terminology (1983)Google Scholar
  13. 13.
    DoD Instruction (DoDI), 5000.61 DoD Modeling and Simulation (M&S) Verification, Validation, Accreditation (VV&A) (1996)Google Scholar
  14. 14.
    Pace, D.K.: Modeling and Simulation Verification and Validation Challenges. Johns Hopkins APL Technical Digest 25(2), 163–172 (2004)MathSciNetGoogle Scholar
  15. 15.
    EU Project, Vital Infrastructure Threats and Assurance (VITA),
  16. 16.
    Emshoff, J.R., Sisson, R.L.: Design and Use of Computer Simulation Models. MacMillan, New York (1970)Google Scholar
  17. 17.
    Hermann, C.F.: Validation Problems in Games and Simulations with Special Reference to Models of International Politics. Behavioral Science 12(3), 216–231 (1967)MathSciNetCrossRefGoogle Scholar
  18. 18.
    Turing, A.M.: Computing Machinery and Intelligence. In: Feigenbaum, E.A., Feldman, J. (eds.) Computers and Thought, pp. 11–15. McGraw-Hill, New York (1963)Google Scholar
  19. 19.
    Caldarelli, G., Vespignani, A.: Large Scale Structure and Dynamics of Complex Networks. World Scientific Publisher (2007)Google Scholar
  20. 20.
    Haimes, Y.Y.: Risk Modeling, Assessment, and Management. Wiley (2009)Google Scholar
  21. 21.
    Bigelow, J.H., Davis, P.K.: Implications for Model Validation of Multiresolution, Multiperspective Modeling. RAND (2003)Google Scholar
  22. 22.
    Balci, O.: Verification, validation and testing. In: Banks, J. (ed.) The Handbook of Simulation. John Wiley & Sons, New York (1997)Google Scholar
  23. 23.
    IEEE, 1516.4 Recommended Practice for Verification, Validation, and Accreditation of a Federationan Overlay to the High Level Architecture Federation Development and Execution Process (2007)Google Scholar
  24. 24.
    Panzieri, S., Oliva, G., Setola, R.: Modelling and Simulation of Critical Infrastructures. In: Flammini, F. (ed.) Critical Infrastructure Security: Assessment, Prevention, Detection, Response. WIT Press (2011)Google Scholar
  25. 25.
    Satumitara, G., Duenas-Osorio, L.: Synthesis of Modelling and Simulation Methods on Critical Infrastructure Interdependencies Research. In: Gopalakrishnan, K., Peeta, S. (eds.) Sustainable and Resilient Critical Infrastructure Systems. Springer, Berlin (2010)Google Scholar
  26. 26.
    Sargent, R.G.: Verification and Validation of Simulation Models. In: Proc. of Winter Simulation Conf., pp. 121–130 (1998)Google Scholar
  27. 27.
    Hone, G.N.: Application Domain Modeling to support the Verification and Validation of Synthetic Environments. In: Simulation Interoperability Workshop (1998)Google Scholar
  28. 28.
    Harmon, S.Y., Youngblood, S.M.: A Proposed Model for Simulation Validation Process Maturity. Journal of Defense Modeling and Simulation (JDMS) 2(4), 179–190 (2005)CrossRefGoogle Scholar
  29. 29.
    Birta, L.G., Zmizrak, F.N.: A Knowledge-Based Approach for the Validation of Simulation Models: The Foundation. ACM Transactions on Modeling and Computer Simulation 6(1), 76–98 (1996)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Alfonso Farina
    • 1
  • Antonio Graziano
    • 1
  • Stefano Panzieri
    • 2
  • Federica Pascucci
    • 2
  • Roberto Setola
    • 3
  1. 1.Selex ES - A Finmeccanica CompanyRomaItaly
  2. 2.University Roma TreRomaItaly
  3. 3.University Campus Bio-MedicoRomaItaly

Personalised recommendations