Statistical Model Checking for Safety Critical Hybrid Systems: An Empirical Evaluation
As more computing systems are utilized in various areas of our society, the reliability of computing systems becomes a significant issue. However, as the complexity of computing systems increases, conventional verification and validation techniques such as testing and model checking have limitations to assess reliability of complex safety critical systems. Such systems often control highly complex continuous dynamics to interact with physical environments. To assure the reliability of safety critical hybrid systems, statistical model checking (SMC) techniques have been proposed. SMC techniques approximately compute probabilities for a target system to satisfy given requirements based on randomly sampled execution traces. In this paper, we empirically evaluated four state-ofthe- art SMC techniques on a fault-tolerant fuel control system in the automobile domain. Through the experiments, we could demonstrate that SMC is practically useful to assure the reliability of a safety critical hybrid system and we compared pros and cons of the four different SMC techniques.
KeywordsModel Check Sample Path Linear Temporal Logic Precision Parameter Sequential Probability Ratio Test
Unable to display preview. Download preview PDF.
- 3.Halstead, M.H.: Elements of Software Science. Elsevier Science Ltd. (1977)Google Scholar
- 5.IEEE Computer Society. IEEE Std 1633: IEEE Recommend Practice on Software Reliability (2008)Google Scholar
- 6.International Electrotechnical Commission (IEC). IEC 61508: Functional safety of electrical/electronic/programmable electronic (E/E/PE) safety related systems (2005)Google Scholar
- 7.International Organization for Standardization (ISO). ISO 26262: Road vehicles – functional safety (2011), http://www.iso.org/iso/catalogue_detail?csnumber=43464
- 9.Kim, Y., Choi, O., Kim, M., Baik, J., Kim, T.: Validating software reliability through statistical model checking: Safer, cheaper, and faster. IEEE Software (under review)Google Scholar
- 10.Kim, Y., Kim, M., Kim, T.: Hybrid statistical model checking technique for reliable safety critical systems. In: IEEE International Symposium on Software Reliability Engineering, ISSRE (2012)Google Scholar
- 13.Radio Technical Commission for Aeronautics (RTCA). Do-178c: Software considerations in airborne systems and equipment certification (2012)Google Scholar
- 16.Yi, S., Heo, J., Cho, Y., Hong, J.: Adaptive mobile checkpointing facility for wireless sensor networks. In: Gavrilova, M.L., Gervasi, O., Kumar, V., Tan, C.J.K., Taniar, D., Laganá, A., Mun, Y., Choo, H. (eds.) ICCSA 2006. LNCS, vol. 3981, pp. 701–709. Springer, Heidelberg (2006)CrossRefGoogle Scholar
- 17.Younes, H.L.S.: Verification and Planning for Stochastic Processes with Asynchronous Events. PhD thesis, CMU (January 2005)Google Scholar
- 19.Younes, H.L.S., Musliner, D.J.: Probabilistic plan verification through acceptance sampling. In: AIPS Workshop on Planning via Model Checking (2002)Google Scholar
- 21.Zuliani, P., Platzer, A., Clarke, E.M.: Bayesian statistical model checking with application to stateflow/simulink verification. In: Hybrid Systems: Computation and Control, HSCC (2010)Google Scholar