Skip to main content

Setting AI in Context: A Case Study on Defining the Context and Operational Design Domain for Automated Driving

  • Conference paper
  • First Online:
Requirements Engineering: Foundation for Software Quality (REFSQ 2022)

Abstract

[Context and motivation] For automated driving systems, the operational context needs to be known in order to state guarantees on performance and safety. The operational design domain (ODD) is an abstraction of the operational context, and its definition is an integral part of the system development process. [Question/problem] There are still major uncertainties in how to clearly define and document the operational context in a diverse and distributed development environment such as the automotive industry. This case study investigates the challenges with context definitions for the development of perception functions that use machine learning for automated driving. [Principal ideas/results] Based on qualitative analysis of data from semi-structured interviews, the case study shows that there is a lack of standardisation for context definitions across the industry, ambiguities in the processes that lead to deriving the ODD, missing documentation of assumptions about the operational context, and a lack of involvement of function developers in the context definition. [Contribution] The results outline challenges experienced by an automotive supplier company when defining the operational context for systems using machine learning. Furthermore, the study collected ideas for potential solutions from the perspective of practitioners.

This project has received funding from the European Union’s Horizon 2020 research and innovation program under grant agreement No 957197.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 44.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 59.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    a Tier 1 supplier develops and sells products and solutions directly to an OEM.

  2. 2.

    Note that due to privacy concern, we intentionally chose not to reveal the respective company.

References

  1. Brown, P.J.: The stick-e document: a framework for creating context-aware applications. Electronic Publishing-Chichester, Technical report, June 1996

    Google Scholar 

  2. Chen, H., Finin, T., Joshi, A.: An ontology for context-aware pervasive computing environments. Knowl. Eng. Rev. 18(3), 197–207 (2003)

    Article  Google Scholar 

  3. Cockburn, A.: Writing effective use cases. Addison-Wesley Longman, Technical report (2000)

    Google Scholar 

  4. Colwell, I., Phan, B., Saleem, S., Salay, R., Czarnecki, K.: An automated vehicle safety concept based on runtime restriction of the operational design domain. In: Intelligent Vehicles Symposium, Proceedings, pp. 1910–1917 (2018)

    Google Scholar 

  5. Creswell, J.W.: Research Design: Qualitative, Quantitative, and Mixed Methods Approaches, 4th edn. Sage Publications, Thousand Oaks (2014)

    Google Scholar 

  6. Creswell, J.W., Poth, C.N.: Qualitative Inquiry and Research Design Choosing Among Five Approaches. Sage Publishing, Thousand Oaks (2017)

    Google Scholar 

  7. Czarnecki, K.: Operational Design Domain for Automated Driving Systems - Taxonomy of Basic Terms (2018)

    Google Scholar 

  8. Damak, Y., Leroy, Y., Trehard, G., Jankovic, M.: Operational context-based design method of autonomous vehicles logical architectures. In: 15th International Conference of System of Systems Engineering (SoSE), pp. 439–444. IEEE (2020)

    Google Scholar 

  9. Gyllenhammar, M., et al.: Towards an operational design domain that supports the safety argumentation of an automated driving system. In: 10th European Congress on Embedded Real Time Systems, pp. 1–10 (2020)

    Google Scholar 

  10. Henricksen, K., Indulska, J.: A software engineering framework for context-aware pervasive computing. In: Proceedings of the Second Annual Conference on Pervasive Computing and Communications, pp. 77–86. IEEE (2004)

    Google Scholar 

  11. International Organization for Standardization: ISO/TR 4804:2020 Road vehicles - Safety and cybersecurity for automated driving systems - Design, verification and validation. International Organization for Standardization, Geneva (2020). www.iso.org

  12. Irvine, P., Zhang, X., Khastgir, S., Schwalb, E., Jennings, P.: A two-level abstraction odd definition language: Part i. In: 2021 IEEE International Conference on Systems, Man, and Cybernetics (SMC), pp. 2614–2621. IEEE (2021)

    Google Scholar 

  13. Jackson, M.: The world and the machine. In: 17th International Conference on Software Engineering (ICSE), pp. 283–283. IEEE (1995)

    Google Scholar 

  14. Dey, A.K.: Understanding and using context. Pers. Ubiquit. Comput. 5, 4–7 (2001)

    Article  Google Scholar 

  15. Knauss, A.: Acon: A learning-based approach to deal with uncertainty in contextual requirements at runtime. Inf. Softw. Technol. 70, 85–99 (2016)

    Article  Google Scholar 

  16. Knauss, A., Damian, D., Schneider, K.: Eliciting contextual requirements at design time: a case study. In: 4th International Workshop on Empirical Requirements Engineering (EmpiRE), pp. 56–63. IEEE (2014)

    Google Scholar 

  17. Koopman, P., Fratrik, F.: How many operational design domains, objects, and events? In: Proceedings of AAAI Workshop on Artificial Intelligence Safety, Honolulu, USA (2019)

    Google Scholar 

  18. Nemoto, Y., Uei, K., Sato, K., Shimomura, Y.: A context-based requirements analysis method for PSS design. Procedia CIRP 30, 42–47 (2015)

    Article  Google Scholar 

  19. NHTSA: Automated Driving Systems: a vision for safety (2017)

    Google Scholar 

  20. Palinkas, L.A., Horwitz, S.M., Green, C.A., Wisdom, J.P., Duan, N., Hoagwood, K.: Purposeful sampling for qualitative data collection and analysis in mixed method implementation research. Admin. Policy Mental Health Mental Health Serv. Res. 42(5), 533–544 (2013). https://doi.org/10.1007/s10488-013-0528-y

    Article  Google Scholar 

  21. Pfeffer, R., Basedow, G.N., Thiesen, N.R., Spadinger, M., Albers, A., Sax, E.: Automated driving - challenges for the automotive industry in product development with focus on process models and organizational structure. In: 2019 International Systems Conference (SysCon), pp. 1–6. IEEE (2019)

    Google Scholar 

  22. Ramirez, A.J., Jensen, A.C., Cheng, B.H.C.: A taxonomy of uncertainty for dynamically adaptive systems. In: 7th International Symposium on Software Engineering for Adaptive and Self-Managing Systems (SEAMS). pp. 99–108. IEEE (2012)

    Google Scholar 

  23. Reschka, A., Böhmer, J.R., Nothdurft, T., Hecker, P., Lichte, B., Maurer, M.: A surveillance and safety system based on performance criteria and functional degradation for an autonomous vehicle. In: Conference on Intelligent Transportation Systems, Proceedings (ITSC), pp. 237–242 (2012)

    Google Scholar 

  24. SAE: J3016B Taxonomy and Definitions for Terms Related to Driving Automation Systems for On-Road Motor Vehicles. Technical report, SAE International (2018). https://www.sae.org/standards/content/j3016_201806/

  25. Saldaña, J.: The Coding Manual For Qualitative Researchers. Sage Publishing, Thousand Oaks (2013)

    Google Scholar 

  26. Schwalb, E., Irvine, P., Zhang, X., Khastgir, S., Jennings, P.: A two-level abstraction odd definition language: Part ii. In: 2021 IEEE International Conference on Systems, Man, and Cybernetics (SMC), pp. 1669–1676. IEEE (2021)

    Google Scholar 

  27. Shalev-Shwartz, S., Shammah, S., Shashua, A.: On a Formal Model of Safe and Scalable Self-driving Cars, pp. 1–37 (2017)

    Google Scholar 

  28. Soultana, A., Benabbou, F., Sael, N.: Context-awareness in the smart car. In: Proceedings of the 4th International Conference on Smart City Applications (SCA), pp. 1–8. ACM Press, New York, New York, USA (2019)

    Google Scholar 

  29. Thorn, E., Kimmel, S., Chaka, M.: A Framework for Automated Driving System Testable Cases and Scenarios (2018). https://www.nhtsa.gov/sites/nhtsa.dot.gov/files/documents/13882-automateddrivingsystems_092618_v1a_tag.pdf

  30. University of Oxford: Oxford Learner’s Dictionary, Entry: Context (2021). https://www.oxfordlearnersdictionaries.com/definition/english/context

  31. Vogelsang, A., Borg, M.: Requirements engineering for machine learning: perspectives from data scientists. In: IEEE 27th International Requirements Engineering Conference (RE), pp. 245–251. IEEE (2019)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Hans-Martin Heyn .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Heyn, HM., Subbiah, P., Linder, J., Knauss, E., Eriksson, O. (2022). Setting AI in Context: A Case Study on Defining the Context and Operational Design Domain for Automated Driving. In: Gervasi, V., Vogelsang, A. (eds) Requirements Engineering: Foundation for Software Quality. REFSQ 2022. Lecture Notes in Computer Science, vol 13216. Springer, Cham. https://doi.org/10.1007/978-3-030-98464-9_16

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-98464-9_16

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-98463-2

  • Online ISBN: 978-3-030-98464-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics