A Survey on Testing for Cyber Physical System

  • Sara Abbaspour AsadollahEmail author
  • Rafia Inam
  • Hans Hansson
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9447)


Cyber Physical Systems (CPS) bridge the cyber-world of computing and communications with the physical world and require development of secure and reliable software. It asserts a big challenge not only on testing and verifying the correctness of all physical and cyber components of such big systems, but also on integration of these components. This paper develops a categorization of multiple levels of testing required to test CPS and makes a comparison of these levels with the levels of software testing based on the V-model. It presents a detailed state-of-the-art survey on the testing approaches performed on the CPS. Further, it provides challenges in CPS testing.


Testing Cyber physical systems Survey 



This research is supported by Swedish Foundation for Strategic Research (SSF) via the SYNOPSIS Project.


  1. 1.
    Abbaspour A.S., Hansson, H., Sundmark, D., Eldh, S.: Towards classification of concurrency bugs based on observable properties. In: Workshop on Complex faUlts and Failures in LargE Software Systems (COUFLESS) (2015)Google Scholar
  2. 2.
    Alisherov, F., Sattarova, F.: Methodology for penetration testing. Int. J. Grid Distrib. Comput. 2(2), 43–50 (2009). CiteseerGoogle Scholar
  3. 3.
    Badban, B., Fränzle, M., Peleska, J., Teige, T.: Test automation for hybrid systems. In: Workshop on Software Quality Assurance, pp. 14–21, ACM (2006)Google Scholar
  4. 4.
    Bertolino, A.: Software testing research: achievements, challenges, dreams. In: Future of Software Engineering, pp. 85–103 (2007)Google Scholar
  5. 5.
    Bozkurt, M., Harman, M., Hassoun, Y.: Testing web services: a survey. Department of Computer Science, King’s College London, Technical report TR-10-01 (2010)Google Scholar
  6. 6.
    Cardell-Oliver, R.: Conformance tests for real-time systems with timed automata specifications. Form. Asp. Comput. 12(5), 350–371 (2000)zbMATHCrossRefGoogle Scholar
  7. 7.
    Goodloe, A.E., Pike, L.: Monitoring distributed real-time systems: a survey and future directions. Technical report, NASA Langley Research Center (2010)Google Scholar
  8. 8.
    Gupta, S.K.S., Mukherjee, T., Varsamopoulos, G., Banerjee, A.: Research directions in energy-sustainable cyberphysical systems. Sustain. Comput. Inf. Syst. 1(1), 57–74 (2011)Google Scholar
  9. 9.
    He, J., Geng, Y., Wan, Y., Li, S., Pahlavan, K.: A cyber physical test-bed for virtualization of RF access environment for body sensor network. IEEE Sens. J. 13(10), 3826–3836 (2013)CrossRefGoogle Scholar
  10. 10.
    Huang, H.M., Tidwell, T., Gill, C., Lu, C., Gao, X., Dyke, S.: Cyber-physical systems for real-time hybrid structural testing: a case study. In: 1st International Conference on Cyber-Physical Systems, pp. 69–78, ACM (2010)Google Scholar
  11. 11.
    Incki, K., Ar, I., Sözer, H.: A survey of software testing in the cloud. In: Software Security and Reliability Companion (SERE-C), pp. 18–23 (2012)Google Scholar
  12. 12.
    Kane, A., Fuhrman, T., Koopman, P.: Monitor based oracles for cyber-physical system testing. In: Dependable Systems and Networks (2014)Google Scholar
  13. 13.
    Krichen, M., Tripakis, S.: Conformance testing for real-time systems. Form. Methods Syst. Des. 34(3), 238–304 (2009)zbMATHCrossRefGoogle Scholar
  14. 14.
    Lee, J., Kang, S., Lee, D.: A survey on software product line testing. In: Proceedings of the 16th International Software Product Line Conference, vol. 1, pp. 31–40. SPLC 2012, ACM, New York, NY, USA (2012)Google Scholar
  15. 15.
    Lee, M.H., Yoo, C.J., Jang, O.B.: Embedded system software testing based on SOA for mobile service. J. Adv. Sci. Technol. 1(1), 55–64 (2008)Google Scholar
  16. 16.
    Li, Y.F., Das, P.K., Dowe, D.L.: Two decades of web application testing–a survey of recent advances. Inf. Syst. 43, 20–54 (2014)CrossRefGoogle Scholar
  17. 17.
    Lim, J.H., Song, S.H., Son, J.R., Kuc, T.Y., Park, H.S., Kim, H.S.: An automated test method for robot platform and its components. Int. J. Softw. Eng. Its Appl. 4(3), 9–18 (2010)Google Scholar
  18. 18.
    Mandrioli, D., Morasca, S., Morzenti, A.: Generating test cases for real-time systems from logic specifications. Trans. Comput. Syst. 13(4), 365–398 (1995)CrossRefGoogle Scholar
  19. 19.
    Mathur, S., Malik, S.: Advancements in the V-Model. Int. J. Comput. Appl. 1(12), 29–34 (2010)Google Scholar
  20. 20.
    Rajkumar, R.R., Lee, I., Sha, L., Stankovic, J.: Cyber-physical systems: the next computing revolution. In: 47th Design Automation Conference, pp. 731–736 (2010)Google Scholar
  21. 21.
    Sha, L., Gopalakrishnan, S., Liu, X., Wang, Q.: Cyber-physical systems: a new frontier. In: IEEE International Conference on Sensor Networks, Ubiquitous and Trustworthy Computing 2008, SUTC 2008, pp. 1–9 (2008)Google Scholar
  22. 22.
    Silva, L.C., Perkusich, M., Bublitz, F.M., Almeida, H.O., Perkusich, A.: A model-based architecture for testing medical cyber-physical systems. In: 29th Annual ACM Symposium on Applied Computing, pp. 25–30, New York, NY, USA (2014)Google Scholar
  23. 23.
    Srivastava, P.R., Kim, T-h: Application of genetic algorithm in software testing. J. Softw. Eng. Its Appl. 3(4), 87–96 (2009)Google Scholar
  24. 24.
    Tevanlinna, A., Taina, J., Kauppinen, R.: Product family testing: a survey. SIGSOFT Softw. Eng. Notes 29(2), 12–12 (2004)CrossRefGoogle Scholar
  25. 25.
    Tidwell, T., Gao, X., Huang, H.M., Lu, C., Dyke, S., Gill, C.: Towards configurable real-time hybrid structural testing: a cyber-physical system approach. In: ISORC, pp. 37–44 (2009)Google Scholar
  26. 26.
    Woehrle, M., Lampka, K., Thiele, L.: Conformance testing for cyber-physical systems. ACM Trans. Embed. Comput. Syst. 11(4), 84 (2012)CrossRefGoogle Scholar
  27. 27.
    Zhang, L., He, J., Yu, W.: Test case generation from formal models of cyber physical system. J. Hybrid Inf. Technol. 6(3), 15 (2013)Google Scholar

Copyright information

© IFIP International Federation for Information Processing 2015

Authors and Affiliations

  • Sara Abbaspour Asadollah
    • 1
    Email author
  • Rafia Inam
    • 2
  • Hans Hansson
    • 1
  1. 1.Mälardalen UniversityVästeråsSweden
  2. 2.Ericsson ABKistaSweden

Personalised recommendations