Abstract
[Context and motivation] For automated driving systems, the operational context needs to be known in order to state guarantees on performance and safety. The operational design domain (ODD) is an abstraction of the operational context, and its definition is an integral part of the system development process. [Question/problem] There are still major uncertainties in how to clearly define and document the operational context in a diverse and distributed development environment such as the automotive industry. This case study investigates the challenges with context definitions for the development of perception functions that use machine learning for automated driving. [Principal ideas/results] Based on qualitative analysis of data from semi-structured interviews, the case study shows that there is a lack of standardisation for context definitions across the industry, ambiguities in the processes that lead to deriving the ODD, missing documentation of assumptions about the operational context, and a lack of involvement of function developers in the context definition. [Contribution] The results outline challenges experienced by an automotive supplier company when defining the operational context for systems using machine learning. Furthermore, the study collected ideas for potential solutions from the perspective of practitioners.
This project has received funding from the European Union’s Horizon 2020 research and innovation program under grant agreement No 957197.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
a Tier 1 supplier develops and sells products and solutions directly to an OEM.
- 2.
Note that due to privacy concern, we intentionally chose not to reveal the respective company.
References
Brown, P.J.: The stick-e document: a framework for creating context-aware applications. Electronic Publishing-Chichester, Technical report, June 1996
Chen, H., Finin, T., Joshi, A.: An ontology for context-aware pervasive computing environments. Knowl. Eng. Rev. 18(3), 197–207 (2003)
Cockburn, A.: Writing effective use cases. Addison-Wesley Longman, Technical report (2000)
Colwell, I., Phan, B., Saleem, S., Salay, R., Czarnecki, K.: An automated vehicle safety concept based on runtime restriction of the operational design domain. In: Intelligent Vehicles Symposium, Proceedings, pp. 1910–1917 (2018)
Creswell, J.W.: Research Design: Qualitative, Quantitative, and Mixed Methods Approaches, 4th edn. Sage Publications, Thousand Oaks (2014)
Creswell, J.W., Poth, C.N.: Qualitative Inquiry and Research Design Choosing Among Five Approaches. Sage Publishing, Thousand Oaks (2017)
Czarnecki, K.: Operational Design Domain for Automated Driving Systems - Taxonomy of Basic Terms (2018)
Damak, Y., Leroy, Y., Trehard, G., Jankovic, M.: Operational context-based design method of autonomous vehicles logical architectures. In: 15th International Conference of System of Systems Engineering (SoSE), pp. 439–444. IEEE (2020)
Gyllenhammar, M., et al.: Towards an operational design domain that supports the safety argumentation of an automated driving system. In: 10th European Congress on Embedded Real Time Systems, pp. 1–10 (2020)
Henricksen, K., Indulska, J.: A software engineering framework for context-aware pervasive computing. In: Proceedings of the Second Annual Conference on Pervasive Computing and Communications, pp. 77–86. IEEE (2004)
International Organization for Standardization: ISO/TR 4804:2020 Road vehicles - Safety and cybersecurity for automated driving systems - Design, verification and validation. International Organization for Standardization, Geneva (2020). www.iso.org
Irvine, P., Zhang, X., Khastgir, S., Schwalb, E., Jennings, P.: A two-level abstraction odd definition language: Part i. In: 2021 IEEE International Conference on Systems, Man, and Cybernetics (SMC), pp. 2614–2621. IEEE (2021)
Jackson, M.: The world and the machine. In: 17th International Conference on Software Engineering (ICSE), pp. 283–283. IEEE (1995)
Dey, A.K.: Understanding and using context. Pers. Ubiquit. Comput. 5, 4–7 (2001)
Knauss, A.: Acon: A learning-based approach to deal with uncertainty in contextual requirements at runtime. Inf. Softw. Technol. 70, 85–99 (2016)
Knauss, A., Damian, D., Schneider, K.: Eliciting contextual requirements at design time: a case study. In: 4th International Workshop on Empirical Requirements Engineering (EmpiRE), pp. 56–63. IEEE (2014)
Koopman, P., Fratrik, F.: How many operational design domains, objects, and events? In: Proceedings of AAAI Workshop on Artificial Intelligence Safety, Honolulu, USA (2019)
Nemoto, Y., Uei, K., Sato, K., Shimomura, Y.: A context-based requirements analysis method for PSS design. Procedia CIRP 30, 42–47 (2015)
NHTSA: Automated Driving Systems: a vision for safety (2017)
Palinkas, L.A., Horwitz, S.M., Green, C.A., Wisdom, J.P., Duan, N., Hoagwood, K.: Purposeful sampling for qualitative data collection and analysis in mixed method implementation research. Admin. Policy Mental Health Mental Health Serv. Res. 42(5), 533–544 (2013). https://doi.org/10.1007/s10488-013-0528-y
Pfeffer, R., Basedow, G.N., Thiesen, N.R., Spadinger, M., Albers, A., Sax, E.: Automated driving - challenges for the automotive industry in product development with focus on process models and organizational structure. In: 2019 International Systems Conference (SysCon), pp. 1–6. IEEE (2019)
Ramirez, A.J., Jensen, A.C., Cheng, B.H.C.: A taxonomy of uncertainty for dynamically adaptive systems. In: 7th International Symposium on Software Engineering for Adaptive and Self-Managing Systems (SEAMS). pp. 99–108. IEEE (2012)
Reschka, A., Böhmer, J.R., Nothdurft, T., Hecker, P., Lichte, B., Maurer, M.: A surveillance and safety system based on performance criteria and functional degradation for an autonomous vehicle. In: Conference on Intelligent Transportation Systems, Proceedings (ITSC), pp. 237–242 (2012)
SAE: J3016B Taxonomy and Definitions for Terms Related to Driving Automation Systems for On-Road Motor Vehicles. Technical report, SAE International (2018). https://www.sae.org/standards/content/j3016_201806/
Saldaña, J.: The Coding Manual For Qualitative Researchers. Sage Publishing, Thousand Oaks (2013)
Schwalb, E., Irvine, P., Zhang, X., Khastgir, S., Jennings, P.: A two-level abstraction odd definition language: Part ii. In: 2021 IEEE International Conference on Systems, Man, and Cybernetics (SMC), pp. 1669–1676. IEEE (2021)
Shalev-Shwartz, S., Shammah, S., Shashua, A.: On a Formal Model of Safe and Scalable Self-driving Cars, pp. 1–37 (2017)
Soultana, A., Benabbou, F., Sael, N.: Context-awareness in the smart car. In: Proceedings of the 4th International Conference on Smart City Applications (SCA), pp. 1–8. ACM Press, New York, New York, USA (2019)
Thorn, E., Kimmel, S., Chaka, M.: A Framework for Automated Driving System Testable Cases and Scenarios (2018). https://www.nhtsa.gov/sites/nhtsa.dot.gov/files/documents/13882-automateddrivingsystems_092618_v1a_tag.pdf
University of Oxford: Oxford Learner’s Dictionary, Entry: Context (2021). https://www.oxfordlearnersdictionaries.com/definition/english/context
Vogelsang, A., Borg, M.: Requirements engineering for machine learning: perspectives from data scientists. In: IEEE 27th International Requirements Engineering Conference (RE), pp. 245–251. IEEE (2019)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 Springer Nature Switzerland AG
About this paper
Cite this paper
Heyn, HM., Subbiah, P., Linder, J., Knauss, E., Eriksson, O. (2022). Setting AI in Context: A Case Study on Defining the Context and Operational Design Domain for Automated Driving. In: Gervasi, V., Vogelsang, A. (eds) Requirements Engineering: Foundation for Software Quality. REFSQ 2022. Lecture Notes in Computer Science, vol 13216. Springer, Cham. https://doi.org/10.1007/978-3-030-98464-9_16
Download citation
DOI: https://doi.org/10.1007/978-3-030-98464-9_16
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-98463-2
Online ISBN: 978-3-030-98464-9
eBook Packages: Computer ScienceComputer Science (R0)