A Concept for Testing Robustness and Safety of the Context-Aware Behaviour of Autonomous Systems

  • Zoltán Micskei
  • Zoltán Szatmári
  • János Oláh
  • István Majzik
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7327)


Autonomous systems are used nowadays in more and more sectors from vehicles to domestic robots. They can make decisions on their own or interact with humans, thus their robustness and safety are properties of crucial importance. Due to the adaptive and context-aware nature of these systems, the testing of such properties is especially challenging. In this paper, we propose a model-based testing approach to capture the context and requirements of such systems, to automatically generate test data representing complex situations, and to evaluate test traces and compute test coverage metrics.


testing autonomous systems context modelling test coverage 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Connelly, J., Hong, W., Mahoney, R., Sparrow, D.: Challenges in Autonomous System Development. In: Proc. of Performance Metrics for Intelligent Systems (PerMIS 2006) Workshop (2006)Google Scholar
  2. 2.
    Waeselynck, H., et al.: Mobile Systems from a Validation Perspective: a Case Study. In: Proc. of 6th International Symposium on Parallel and Distributed Computing (ISPDC). IEEE Press (2007), doi:10.1109/ISPDC.2007.37Google Scholar
  3. 3.
    Michelson, R.C.: Test and Evaluation for Fully Autonomous Micro Air Vehicles. ITEA Journal 29(4), 367–374 (2008)Google Scholar
  4. 4.
    Scrapper, C., Balakirsky, S., Messina, E.: MOAST and USAR-Sim: A Combined Framework for the Development and Testing of Autonomous Systems. In: Proc. of SPIE 6230, 62301T (2006), doi:10.1117/12.663898Google Scholar
  5. 5.
    Kelly, A., et al.: Toward Reliable Off Road Autonomous Vehicles Operating in Challenging Environments. The International Journal of Robotics Research 25(5-6), 449–483 (2006), doi:10.1177/0278364906065543CrossRefGoogle Scholar
  6. 6.
    Weiss, L.G.: Autonomous Robots in the Fog of War. IEEE Spectrum 48(8), 30–57 (2011), doi:10.1109/MSPEC.2011.5960163CrossRefGoogle Scholar
  7. 7.
    Baldauf, M., Dustdar, S., Rosenberg, F.: A Survey on Context-aware Systems. Int. J. Ad Hoc Ubiquitous Comput. 2(4), 263–277 (2007), doi:10.1504/IJAHUC.2007.014070CrossRefGoogle Scholar
  8. 8.
    Tenorth, M., Beetz, M.: KnowRob – Knowledge Processing for Autonomous Personal Robots. In: IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 4261–4266. IEEE Press, New York (2009), doi:10.1109/IROS.2009.5354602Google Scholar
  9. 9.
    Szatmári, Z., Oláh, J., Majzik, I.: Ontology-Based Test Data Generation Using Metaheuristics. In: Proc. 8th Int. Conf. on Informatics in Control, Automation, and Robotics (ICINCO), Noordwijkerhout, The Netherlands (2011)Google Scholar
  10. 10.
    Nguyen, C.D., Perini, A., Tonella, P., Miles, S., Harman, M., Luck, M.: Evolutionary Testing of Autonomous Software Agents. In: Proc. AAMAS (1), pp. 521–528 (2009)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Zoltán Micskei
    • 1
  • Zoltán Szatmári
    • 1
  • János Oláh
    • 1
  • István Majzik
    • 1
  1. 1.Budapest University of Technology and EconomicsBudapestHungary

Personalised recommendations