Advertisement

An Effective Verification Strategy for Testing Distributed Automotive Embedded Software Functions: A Case Study

  • Annapurna ChunduriEmail author
  • Robert Feldt
  • Mikael Adenmark
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10027)

Abstract

Integration testing of automotive embedded software functions that are distributed across several Electronic Control Unit (ECU) system software modules is a complex and challenging task in today’s automotive industry. They neither have infinite resources, nor have the time to carry out exhaustive testing of these functions. On the other hand, the traditional approach of implementing an ad-hoc selection of test scenarios based on the testers’ experience typically leads to both test gaps and test redundancies. Here, we address this challenge by proposing a verification strategy that enhances the process in order to identify and mitigate such gaps and redundancies in automotive system software testing. This helps increase test coverage by taking more data-driven decisions for integration testing of the functions. The strategy was developed in a case study at a Swedish automotive company that involved multiple data collection steps. After static validation of the proposed strategy it was evaluated on one distributed automotive software function, the Fuel Level Display, and found to be both feasible and effective.

Keywords

Verification strategy Distributed automotive embedded software Test coverage Test process improvement Case study 

References

  1. 1.
    Adenmark, M.: Scania Test Levels, Scania Internal Document (REST08012) (2008)Google Scholar
  2. 2.
    Arnold, D., Corriveau, J.P., Shi, W.: Modeling and validating requirements using executable contracts and scenarios. In: Proceedings of the 8th ACIS International Conference on Software Engineering Research, Management and Applications (SERA), pp. 311–320. IEEE (2010)Google Scholar
  3. 3.
    Barhate, S.S.: Effective test strategy for testing automotive software. In: International Conference on Industrial Instrumentation and Control (ICIC), pp. 645–649. IEEE (2015)Google Scholar
  4. 4.
    Barmi, Z.A., Ebrahimi, A.H., Feldt, R.: Alignment of requirements specification and testing: a systematic mapping study. In: Proceedings of the 4th IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW), pp. 476–485 (2011)Google Scholar
  5. 5.
    Von der Beeck, M., Margaria, T., Steffen, B.: A formal requirements engineering method for specification, synthesis, and verification. In: Proceedings of the 8th Conference on Software Engineering Environments, pp. 131–144. IEEE (1997)Google Scholar
  6. 6.
    Bringmann, E., Kramer, A.: Model-based testing of automotive systems. In: 1st IEEE International Conference on Software Testing, Verification, and Validation, pp. 485–493 (2008)Google Scholar
  7. 7.
    Conrad, M., Fey, I., Sadeghipour, S.: Systematic model-based testing of embedded automotive software. Electronic Notes Theor. Comput. Sci. 111, 13–26 (2005)CrossRefGoogle Scholar
  8. 8.
    Dhadyalla, G., Kumari, N., Snell, T.: Combinatorial testing for an automotive hybrid electric vehicle control system: a case study. In: IEEE 7th International Conference on Software Testing, Verification and Validation Workshops (ICSTW), pp. 51–57. IEEE (2014)Google Scholar
  9. 9.
    Ferrari, A., dell’Orletta, F., Spagnolo, G.O., Gnesi, S.: Measuring and improving the completeness of natural language requirements. In: Salinesi, C., Weerd, I. (eds.) REFSQ 2014. LNCS, vol. 8396, pp. 23–38. Springer, Heidelberg (2014). doi: 10.1007/978-3-319-05843-6_3 CrossRefGoogle Scholar
  10. 10.
    Grimm, K.: Software technology in an automotive company: major challenges. In: Proceedings of the 25th International Conference on Software Engineering, pp. 498–503. IEEE Computer Society (2003)Google Scholar
  11. 11.
    Kasoju, A., Petersen, K., Mäntylä, M.V.: Analyzing an automotive testing process with evidence-based software engineering. Inf. Softw. Technol. 55(7), 1237–1259 (2013)CrossRefGoogle Scholar
  12. 12.
    Broy, M.: Challenges in automotive software engineering. In: Proceedings of the 28th International Conference on Software Engineering, pp. 33–42. ACM (2006)Google Scholar
  13. 13.
    Marinescu, R., Saadatmand, M., Bucaioni, A., Seceleanu, C., Pettersson, P.: A model-based testing framework for automotive embedded systems. In: Proceedings of the 40th EUROMICRO Conference on Software Engineering and Advanced Applications (SEAA), pp. 38–47. IEEE (2014)Google Scholar
  14. 14.
    Marshall, M.N.: Sampling for qualitative research. Family Pract. 13(6), 522–526 (1996)CrossRefGoogle Scholar
  15. 15.
    Nebut, C., Fleurey, F., Le Traon, Y., Jezequel, J.M.: Automatic test generation: a use case driven approach. IEEE Trans. Softw. Eng. 32(3), 140–155 (2006)CrossRefGoogle Scholar
  16. 16.
    Perez, A.M., Kaiser, S.: Integrating test levels for embedded systems. In: Proceedings of the Testing: Academic and Industrial Conference - Practice and Research Techniques (TAIC PART), pp. 184–193. IEEE, September 2009Google Scholar
  17. 17.
    Praprotnik, O., Gartner, M., Zauner, M., Horauer, M.: A test suite for system tests of distributed automotive electronics. In: 2nd International Conference on Advances in Circuits, Electronics and Micro-electronics (CENICS), pp. 67–70. IEEE (2009)Google Scholar
  18. 18.
    Radeka, K.: The toyota product development system: integrating people, process and technology by James M. Morgan and Jeffrey K. Liker. J. Prod. Innov. Manage 24(3), 276–278 (2007)CrossRefGoogle Scholar
  19. 19.
    Rowley, J., Slack, F.: Conducting a literature review. Manage. Res. News 27(6), 31–39 (2004)CrossRefGoogle Scholar
  20. 20.
    Runeson, P., Höst, M.: Guidelines for conducting and reporting case study research in software engineering. Empir. Softw. Eng. 14(2), 131–164 (2008)CrossRefGoogle Scholar
  21. 21.
    Saglietti, F.: Testing for dependable embedded software. In: 36th EUROMICRO Conference on Software Engineering and Advanced Applications (SEAA), pp. 409–416. IEEE (2010)Google Scholar
  22. 22.
    Shah, U.S., Jinwala, D.C.: Resolving ambiguities in natural language software requirements: a comprehensive survey. ACM SIGSOFT Softw. Eng. Notes 40(5), 1–7 (2015)CrossRefGoogle Scholar
  23. 23.
    Shokry, H., Hinchey, M.: Model-based verification of embedded software. IEEE Comput. 42(4), 53–59 (2009)CrossRefGoogle Scholar
  24. 24.
    Siegl, S., Hielscher, K.S., German, R., Berger, C.: Formal specification and systematic model-driven testing of embedded automotive systems. In: Proceedings of the Europe Conference & Exhibition on Design, Automation & Test (DATE), pp. 1–6. IEEE (2011)Google Scholar
  25. 25.
    Somé, S.S.: Supporting use case based requirements engineering. Inf. Softw. Technol. 48(1), 43–58 (2006)CrossRefGoogle Scholar
  26. 26.
    Strauss, A., Corbin, J.: Basics of Qualitative Research: Grounded Theory Procedures and Techniques. Sage Publications, Beverly Hills (1990)Google Scholar
  27. 27.
    Sundmark, D., Petersen, K., Larsson, S.: An exploratory case study of testing in an automotive electrical system release process. In: 6th IEEE International Symposium on Industrial Embedded Systems (SIES), pp. 166–175. IEEE (2011)Google Scholar
  28. 28.
    Tsai, W.T., Bai, X., Paul, R., Yu, L.: Scenario-based functional regression testing. In: Proceedings of the 25th Annual International Computer Software and Applications Conference (COMPSAC), pp. 496–501. IEEE (2001)Google Scholar
  29. 29.
    Weber, M., Weisbrod, J.: Requirements engineering in automotive development - Experiences and challenges. In: Proceedings of the IEEE Joint International Conference on Requirements Engineering, pp. 331–340 (2002)Google Scholar
  30. 30.
    Wilson, C.E.: Triangulation: the explicit use of multiple methods, measures, and approaches for determining core issues in product development. Interactions 13(6), 46–47 (2006)CrossRefGoogle Scholar
  31. 31.
    Yin, R.K.: Case Study Research: Design and Methods. Sage Publications (2013)Google Scholar

Copyright information

© Springer International Publishing AG 2016

Authors and Affiliations

  • Annapurna Chunduri
    • 1
    Email author
  • Robert Feldt
    • 1
  • Mikael Adenmark
    • 2
  1. 1.Department of Software EngineeringBlekinge Tekniska HögskolaKarlskronaSweden
  2. 2.Department of Systems and Integration TestScania ABSödertäljeSweden

Personalised recommendations