Skip to main content

A Systematic Approach to Analyzing Perception Architectures in Autonomous Vehicles

  • Conference paper
  • First Online:
Model-Based Safety and Assessment (IMBSA 2020)

Part of the book series: Lecture Notes in Computer Science ((LNPSE,volume 12297))

Included in the following conference series:

Abstract

Simulations are commonly used to validate the design of autonomous systems. However, as these systems are increasingly deployed into safety-critical environments with aleatoric uncertainties, and with the increase in components that employ machine learning algorithms with epistemic uncertainties, validation methods which consider uncertainties are lacking. We present an approach that evaluates signal propagation in logical system architectures, in particular environment perception-chains, focusing on effects of uncertainty to determine functional limitations. The perception based autonomous driving systems are represented by connected elements to constitute a certain functionality. The elements are based on (meta-)models to describe technical components and their behavior. The surrounding environment, in which the system is deployed, is modeled by parameters that are derived from a quasi-static scene. All parameter variations completely define input-states for the designed perception architecture. The input-states are treated as random variables inside the model of components to simulate aleatoric/epistemic uncertainty. The dissimilarity between the model-input and -output serves as measure for total uncertainty present in the system. The uncertainties are propagated through consecutive components and calculated by the same manner. The final result consists of input-states which model uncertainty effects for the specified functionality and therefore highlight shortcomings of the designed architecture.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 54.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 69.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Alexander, R., Herbert, N., Kelly, T.: Structuring safety cases for autonomous systems (2008)

    Google Scholar 

  2. Bach, J., Otten, S., Sax, E.: A taxonomy and systematic approach for automotive system architectures–from functional chains to functional networks. In: International Conference on Vehicle Technology and Intelligent Transport Systems, vol. 2, pp. 90–101. SCITEPRESS (2017)

    Google Scholar 

  3. Bagschik, G., Reschka, A., Stolte, T., Maurer, M.: Identification of potential hazardous events for an unmanned protective vehicle. In: 2016 IEEE Intelligent Vehicles Symposium (IV), pp. 691–697. IEEE (2016)

    Google Scholar 

  4. Beckers, K., Côté, I., Frese, T., Hatebur, D., Heisel, M.: A structured validation and verification method for automotive systems considering the OEM/supplier interface. In: Koornneef, F., van Gulijk, C. (eds.) SAFECOMP 2015. LNCS, vol. 9337, pp. 90–108. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-24255-2_8

    Chapter  Google Scholar 

  5. Belhedi, A., Bartoli, A., Bourgeois, S., Hamrouni, K., Sayd, P., Gay-Bellile, V.: Noise modelling and uncertainty propagation for TOF sensors. In: Fusiello, A., Murino, V., Cucchiara, R. (eds.) ECCV 2012. LNCS, vol. 7585, pp. 476–485. Springer, Heidelberg (2012). https://doi.org/10.1007/978-3-642-33885-4_48

    Chapter  Google Scholar 

  6. Chen, W., Kloul, L.: Stochastic modelling of autonomous vehicles driving scenarios using PEPA. In: Papadopoulos, Y., Aslansefat, K., Katsaros, P., Bozzano, M. (eds.) IMBSA 2019. LNCS, vol. 11842, pp. 317–331. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-32872-6_21

    Chapter  Google Scholar 

  7. Goble, W., Cheddie, H.: Safety Instrumented Systems Verification: Practical Probabilistic Calculations. ISA-The Instrumentation, Systems, and Automation Society, USA (2005)

    Google Scholar 

  8. Grönninger, H., Hartmann, J., Krahn, H., Kriebel, S., Rothhart, L., Rumpe, B.: View-centric modeling of automotive logical architectures. Technical report, TU Braunschweig (2014)

    Google Scholar 

  9. Henne, M., Schwaiger, A., Roscher, K., Weiss, G.: Benchmarking uncertainty estimation methods for deep learning with safety-related metrics. In: SafeAI@ AAAI, pp. 83–90 (2020)

    Google Scholar 

  10. Henne, M., Schwaiger, A., Weiss, G.: Managing uncertainty of AI-based perception for autonomous systems. In: AISafety@ IJCAI Proceedings, pp. 57–60 (2019)

    Google Scholar 

  11. Hillenbrand, M.: Funktionale Sicherheit Nach ISO 26262 in Der Konzeptphase Der Entwicklung von Elektrik/Elektronik Architekturen von Fahrzeugen. Ph.D. thesis, KIT Scientific Publishing 4 (2012)

    Google Scholar 

  12. International Organization for Standardization: Road vehicles—functional safety (ISO 26262). ISO (2011)

    Google Scholar 

  13. International Organization for Standardization: Safety of the intended functionality - SOTIF (ISO/PAS 21448). ISO (2019)

    Google Scholar 

  14. International Organization for Standardization: Road vehicles—data communication between sensors and data fusion unit for automated driving functions—logical interface. ISO (2020)

    Google Scholar 

  15. Kabir, S., Aslansefat, K., Sorokos, I., Papadopoulos, Y., Gheraibia, Y.: A conceptual framework to incorporate complex basic events in HiP-HOPS. In: Papadopoulos, Y., Aslansefat, K., Katsaros, P., Bozzano, M. (eds.) IMBSA 2019. LNCS, vol. 11842, pp. 109–124. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-32872-6_8

    Chapter  Google Scholar 

  16. Kendall, A., Cipolla, R.: Modelling uncertainty in deep learning for camera relocalization. In: 2016 IEEE International Conference on Robotics and Automation (ICRA), pp. 4762–4769. IEEE (2016)

    Google Scholar 

  17. Khastgir, S., Sivencrona, H., Dhadyalla, G., Billing, P., Birrell, S., Jennings, P.: Introducing ASIL inspired dynamic tactical safety decision framework for automated vehicles. In: 2017 IEEE 20th International Conference on Intelligent Transportation Systems (ITSC), pp. 1–6. IEEE (2017)

    Google Scholar 

  18. Kocić, J., Jovičić, N., Drndarević, V.: Sensors and sensor fusion in autonomous vehicles. In: 2018 26th Telecommunications Forum (TELFOR), pp. 420–425. IEEE (2018)

    Google Scholar 

  19. Kuka, C.: Processing the uncertainty: quality-aware data stream processing for dynamic context models. In: 2012 IEEE International Conference on Pervasive Computing and Communications Workshops, pp. 560–561. IEEE (2012)

    Google Scholar 

  20. Luo, R., Lin, M.H., Scherp, R.: Dynamic multi-sensor data fusion system for intelligent robots. Technical report 4/4. IEEE (1988)

    Google Scholar 

  21. Magnusson, S., Frantzich, H., Harada, K.: Fire safety design based on calculations: uncertainty analysis and safety verification. Technical report 27/4. Elsevier (1996)

    Google Scholar 

  22. MathWorks: Sensor fusion and tracking for autonomous systems. The MathWorks, Inc. (2019)

    Google Scholar 

  23. Mikołajczyk, A., Grochowski, M.: Data augmentation for improving deep learning in image classification problem. In: 2018 International Interdisciplinary PhD Workshop (IIPhDW), pp. 117–122. IEEE (2018)

    Google Scholar 

  24. Pollard, E., Morignot, P., Nashashibi, F.: An ontology-based model to determine the automation level of an automated vehicle for co-driving. In: Proceedings of the 16th International Conference on Information Fusion, pp. 596–603. IEEE (2013)

    Google Scholar 

  25. Rakotonirainy, A.: Design of context-aware systems for vehicle using complex systems paradigms. In: Proceedings Workshop on Safety and Context in Conjunction with CONTEXT 2005, pp. 43–51. QUTePrints, Paris (2005)

    Google Scholar 

  26. Roy, C.J., Oberkampf, W.L.: A comprehensive framework for verification, validation, and uncertainty quantification in scientific computing. Technical report 200/25-28. Elsevier (2011)

    Google Scholar 

  27. Russo, J., Sproesser, T., Drouhin, F., Basset, M.: Risk level assessment for rear-end collision with Bayesian network. Technical report 50/1. Elsevier (2017)

    Google Scholar 

  28. Sanfeliu, A., Hagita, N., Saffiotti, A.: Network robot systems. Technical report 56/10. Elsevier (2008)

    Google Scholar 

  29. Scheidt, C., Caers, J.: Representing spatial uncertainty using distances and kernels. Technical report 41/4. Springer (2009)

    Google Scholar 

  30. Struck, C.: Uncertainty propagation and sensitivity analysis techniques in building performance simulation to support conceptual building and system design. Ph.D. thesis, University of Technology Eindhoven, Department of the Built Environment (2012)

    Google Scholar 

  31. Tzafestas, S.G.: Advances in Intelligent Autonomous Systems. Springer, Dordrecht (2012). https://doi.org/10.1007/978-94-011-4790-3

    Book  Google Scholar 

  32. Waszecki, P., Lukasiewycz, M., Masrur, A., Chakraborty, S.: How to engineer tool-chains for automotive E/E architectures? Technical report 10/4. ACM, New York (2013)

    Google Scholar 

  33. Wood, M., et al.: Safety first for automated driving (2019)

    Google Scholar 

  34. Yarin, G.: Uncertainty in deep learning. Ph.D. thesis, University of Cambridge (2016)

    Google Scholar 

Download references

Acknowledgments

This work was funded by the Bavarian Ministry for Economic Affairs, Regional Development and Energy as part of a project to support the thematic development of the Institute for Cognitive Systems.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Iwo Kurzidem .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Kurzidem, I., Saad, A., Schleiss, P. (2020). A Systematic Approach to Analyzing Perception Architectures in Autonomous Vehicles. In: Zeller, M., Höfig, K. (eds) Model-Based Safety and Assessment. IMBSA 2020. Lecture Notes in Computer Science(), vol 12297. Springer, Cham. https://doi.org/10.1007/978-3-030-58920-2_10

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-58920-2_10

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-58919-6

  • Online ISBN: 978-3-030-58920-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics