Abstract
Simulations are commonly used to validate the design of autonomous systems. However, as these systems are increasingly deployed into safety-critical environments with aleatoric uncertainties, and with the increase in components that employ machine learning algorithms with epistemic uncertainties, validation methods which consider uncertainties are lacking. We present an approach that evaluates signal propagation in logical system architectures, in particular environment perception-chains, focusing on effects of uncertainty to determine functional limitations. The perception based autonomous driving systems are represented by connected elements to constitute a certain functionality. The elements are based on (meta-)models to describe technical components and their behavior. The surrounding environment, in which the system is deployed, is modeled by parameters that are derived from a quasi-static scene. All parameter variations completely define input-states for the designed perception architecture. The input-states are treated as random variables inside the model of components to simulate aleatoric/epistemic uncertainty. The dissimilarity between the model-input and -output serves as measure for total uncertainty present in the system. The uncertainties are propagated through consecutive components and calculated by the same manner. The final result consists of input-states which model uncertainty effects for the specified functionality and therefore highlight shortcomings of the designed architecture.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Alexander, R., Herbert, N., Kelly, T.: Structuring safety cases for autonomous systems (2008)
Bach, J., Otten, S., Sax, E.: A taxonomy and systematic approach for automotive system architectures–from functional chains to functional networks. In: International Conference on Vehicle Technology and Intelligent Transport Systems, vol. 2, pp. 90–101. SCITEPRESS (2017)
Bagschik, G., Reschka, A., Stolte, T., Maurer, M.: Identification of potential hazardous events for an unmanned protective vehicle. In: 2016 IEEE Intelligent Vehicles Symposium (IV), pp. 691–697. IEEE (2016)
Beckers, K., Côté, I., Frese, T., Hatebur, D., Heisel, M.: A structured validation and verification method for automotive systems considering the OEM/supplier interface. In: Koornneef, F., van Gulijk, C. (eds.) SAFECOMP 2015. LNCS, vol. 9337, pp. 90–108. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-24255-2_8
Belhedi, A., Bartoli, A., Bourgeois, S., Hamrouni, K., Sayd, P., Gay-Bellile, V.: Noise modelling and uncertainty propagation for TOF sensors. In: Fusiello, A., Murino, V., Cucchiara, R. (eds.) ECCV 2012. LNCS, vol. 7585, pp. 476–485. Springer, Heidelberg (2012). https://doi.org/10.1007/978-3-642-33885-4_48
Chen, W., Kloul, L.: Stochastic modelling of autonomous vehicles driving scenarios using PEPA. In: Papadopoulos, Y., Aslansefat, K., Katsaros, P., Bozzano, M. (eds.) IMBSA 2019. LNCS, vol. 11842, pp. 317–331. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-32872-6_21
Goble, W., Cheddie, H.: Safety Instrumented Systems Verification: Practical Probabilistic Calculations. ISA-The Instrumentation, Systems, and Automation Society, USA (2005)
Grönninger, H., Hartmann, J., Krahn, H., Kriebel, S., Rothhart, L., Rumpe, B.: View-centric modeling of automotive logical architectures. Technical report, TU Braunschweig (2014)
Henne, M., Schwaiger, A., Roscher, K., Weiss, G.: Benchmarking uncertainty estimation methods for deep learning with safety-related metrics. In: SafeAI@ AAAI, pp. 83–90 (2020)
Henne, M., Schwaiger, A., Weiss, G.: Managing uncertainty of AI-based perception for autonomous systems. In: AISafety@ IJCAI Proceedings, pp. 57–60 (2019)
Hillenbrand, M.: Funktionale Sicherheit Nach ISO 26262 in Der Konzeptphase Der Entwicklung von Elektrik/Elektronik Architekturen von Fahrzeugen. Ph.D. thesis, KIT Scientific Publishing 4 (2012)
International Organization for Standardization: Road vehicles—functional safety (ISO 26262). ISO (2011)
International Organization for Standardization: Safety of the intended functionality - SOTIF (ISO/PAS 21448). ISO (2019)
International Organization for Standardization: Road vehicles—data communication between sensors and data fusion unit for automated driving functions—logical interface. ISO (2020)
Kabir, S., Aslansefat, K., Sorokos, I., Papadopoulos, Y., Gheraibia, Y.: A conceptual framework to incorporate complex basic events in HiP-HOPS. In: Papadopoulos, Y., Aslansefat, K., Katsaros, P., Bozzano, M. (eds.) IMBSA 2019. LNCS, vol. 11842, pp. 109–124. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-32872-6_8
Kendall, A., Cipolla, R.: Modelling uncertainty in deep learning for camera relocalization. In: 2016 IEEE International Conference on Robotics and Automation (ICRA), pp. 4762–4769. IEEE (2016)
Khastgir, S., Sivencrona, H., Dhadyalla, G., Billing, P., Birrell, S., Jennings, P.: Introducing ASIL inspired dynamic tactical safety decision framework for automated vehicles. In: 2017 IEEE 20th International Conference on Intelligent Transportation Systems (ITSC), pp. 1–6. IEEE (2017)
Kocić, J., Jovičić, N., Drndarević, V.: Sensors and sensor fusion in autonomous vehicles. In: 2018 26th Telecommunications Forum (TELFOR), pp. 420–425. IEEE (2018)
Kuka, C.: Processing the uncertainty: quality-aware data stream processing for dynamic context models. In: 2012 IEEE International Conference on Pervasive Computing and Communications Workshops, pp. 560–561. IEEE (2012)
Luo, R., Lin, M.H., Scherp, R.: Dynamic multi-sensor data fusion system for intelligent robots. Technical report 4/4. IEEE (1988)
Magnusson, S., Frantzich, H., Harada, K.: Fire safety design based on calculations: uncertainty analysis and safety verification. Technical report 27/4. Elsevier (1996)
MathWorks: Sensor fusion and tracking for autonomous systems. The MathWorks, Inc. (2019)
Mikołajczyk, A., Grochowski, M.: Data augmentation for improving deep learning in image classification problem. In: 2018 International Interdisciplinary PhD Workshop (IIPhDW), pp. 117–122. IEEE (2018)
Pollard, E., Morignot, P., Nashashibi, F.: An ontology-based model to determine the automation level of an automated vehicle for co-driving. In: Proceedings of the 16th International Conference on Information Fusion, pp. 596–603. IEEE (2013)
Rakotonirainy, A.: Design of context-aware systems for vehicle using complex systems paradigms. In: Proceedings Workshop on Safety and Context in Conjunction with CONTEXT 2005, pp. 43–51. QUTePrints, Paris (2005)
Roy, C.J., Oberkampf, W.L.: A comprehensive framework for verification, validation, and uncertainty quantification in scientific computing. Technical report 200/25-28. Elsevier (2011)
Russo, J., Sproesser, T., Drouhin, F., Basset, M.: Risk level assessment for rear-end collision with Bayesian network. Technical report 50/1. Elsevier (2017)
Sanfeliu, A., Hagita, N., Saffiotti, A.: Network robot systems. Technical report 56/10. Elsevier (2008)
Scheidt, C., Caers, J.: Representing spatial uncertainty using distances and kernels. Technical report 41/4. Springer (2009)
Struck, C.: Uncertainty propagation and sensitivity analysis techniques in building performance simulation to support conceptual building and system design. Ph.D. thesis, University of Technology Eindhoven, Department of the Built Environment (2012)
Tzafestas, S.G.: Advances in Intelligent Autonomous Systems. Springer, Dordrecht (2012). https://doi.org/10.1007/978-94-011-4790-3
Waszecki, P., Lukasiewycz, M., Masrur, A., Chakraborty, S.: How to engineer tool-chains for automotive E/E architectures? Technical report 10/4. ACM, New York (2013)
Wood, M., et al.: Safety first for automated driving (2019)
Yarin, G.: Uncertainty in deep learning. Ph.D. thesis, University of Cambridge (2016)
Acknowledgments
This work was funded by the Bavarian Ministry for Economic Affairs, Regional Development and Energy as part of a project to support the thematic development of the Institute for Cognitive Systems.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Kurzidem, I., Saad, A., Schleiss, P. (2020). A Systematic Approach to Analyzing Perception Architectures in Autonomous Vehicles. In: Zeller, M., Höfig, K. (eds) Model-Based Safety and Assessment. IMBSA 2020. Lecture Notes in Computer Science(), vol 12297. Springer, Cham. https://doi.org/10.1007/978-3-030-58920-2_10
Download citation
DOI: https://doi.org/10.1007/978-3-030-58920-2_10
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-58919-6
Online ISBN: 978-3-030-58920-2
eBook Packages: Computer ScienceComputer Science (R0)