Abstract
Global automakers are required to apply Automotive SPICE (A-SPICE) to evaluate the development capabilities and qualities of suppliers in addition to the automotive functional safety standard (ISO 26262) for preventing accidents caused by errors in the electronic components. However, rapidly changing software requirements and environments make it difficult to follow A-SPICE and ISO 26262, leading to late detection of software defects in the system qualification test, which is the final verification stage of the V-model. Correcting these defects incurs additional time and cost. This study proposes an enhanced qualification test strategy and technique, which ensures zero defects at an early stage, thereby saving time and cost. The proposed strategy and technique are performed by advanced exploratory and optimization tests that utilize a risk-based test strategy to solve problems. The risk-based test strategy is established at the beginning to identify highly potential problems and is derived from the 1st stage advanced exploratory and 2nd stage optimization tests based on ISO 29119. The test is performed during a CDC system qualification test using an “advanced HILS,” which supports UDS and XCP protocols. The proposed test techniques can solve problems during an early phase and achieve zero defects in a CDC system qualification test.
Similar content being viewed by others
Abbreviations
- Vv:
-
valid value
- Vi:
-
invalid value
- Bx:
-
boundary max value
- Bn:
-
boundary min value
- TCs:
-
sum of check test case
- CTt:
-
testcase by classification tree method
- EPt:
-
testcase by exploratory testing
- PWt:
-
pairwise testing
- BAt:
-
boundary value analyzer
- STs:
-
mixing the state transition and scenario
- FSc:
-
failsafe category
- CPs:
-
sum of check parameter variables
- {}:
-
applied according to detection conditions
- []:
-
number of test cases
References
Afzal, W., Ghazi, A. N., Itkonen, J., Torkar, R., Andrews, A. And Bhatti, K. (2015). An experiment on the effectiveness and efficiency of exploratory testing. Empirical Software Engineering 20, 3, 844–878.
Barhate, S. S. (2015). Effective test strategy for testing automotive software. Int. Conf. Industrial Instrumentation and Control (ICIC), Pune, India.
Burkacky, O., Deichmann, J. and Stein, J. P. (2019). Automotive software and electronics 2030: mapping the sector’s future landscape. McKinsey & Company.
Chen, T. Y., Poon, P. L. and Tse, T. H. (2000). An integrated classification-tree methodology for test case generation. J. Software Engineering and Knowledge Engineering 10, 6, 647–679.
Choi, W. I., Park, D. D. and Hong, S. S. (2016). Improved automotive E/E software development process based on ISO 26262 via Agile methods. KSAE 2016 Annual Conf., Jeju, Korea.
Dzambic, M., Kreuzberger, C., Veledar, O. and Macher, G. (2021). A rapid prototyping system, intelligent watchdog and gateway tool for automotive applications. IEEE 18th Int. Conf. Software Architecture Companion (ICSA-C), Stuttgart, Germany.
Jahanbin, S. and Zamani, B. (2018). Test model generation using equivalence partitioning. 8th Int. Conf. Computer and Knowledge Engineering (ICCKE), Mashhad, Iran.
Jeong, S. Y., Yoo, C. J. and Noh, H. M. (2016). State transition based test model and test case generation technique for embedded system, an empirical approach. Int. J. Software Engineering and Its Applications 10, 11, 233–254.
Khan, M. E. (2011). Different approaches to black box testing technique for finding errors. Int. J. Software Engineering & Applications 2, 4, 31–40.
Kim, T. D. (2015). Measurement of S/W development processes and maturity using agile methodologies. J. Institute of Internet, Broadcasting and Communication, 6, 147–154.
Lee, K. H., Lee, C. Y. and Jeong, H. S. (2010). A study on the field test characteristics of semi-active suspension system with continuous damping control damper. Trans. Korea Fluid Power Systems Society 7, 4, 32–38.
Monteiro, C. B., Dias, L. A. V. and da Cunha, A. M. (2014). A case study on pairwise testing application. 11th Int. Conf. Information Technology: New Generations (ITNG), Las Vegas, Nevada, USA.
Qin, X., Jianli, D., Feng, G., Qiuxia, H. and He, Y. (2018). Test scenario design for intelligent driving system ensuring coverage and effectiveness. Int. J. Automotive Technology 19, 4, 751–758.
Ramachandran, M. (2003). Testing software components using boundary value analysis. Proc. 29th Euromicro Conf., Belek-Antalya, Turkey.
Ryser, J. and Glinz, M. (1999). A scenario-based approach to validating and testing software systems using statecharts. 12th Int. Conf. Software and Systems Engineering and their Applications (ICSSEA), Paris, France.
Sălcianu, M. and Fosalau, C. (2012). A new CAN diagnostic fault simulator based on UDS protocol. Int. Conf. Exposition on Electrical and Power Engineering (EPE), Isai, Romania.
Selegean, V. (2016). https://www.todaysoftmag.com/article/2150/quality-assurance-in-automotive-embedded-projects
Vashishtha, V., Singla, T. and Singh, S. (2014). Software testing. Int. J. Research 1, 8, 1258–1264.
Vasylyna, N. (2011). https://blog.qatestlab.com/2011/02/23/exploratory-testing-advantages-and-disadvantages/
Völker, M. and Stadie, W. (2017). Effects of ISO 26262 on commercial vehicle and steering system. ATZ Worldwide, 119, 60–65.
Zhu, X., Zhou, B., Hou, L., Chen, J. and Chen, L. (2008). An experience-based approach for test execution effort estimation. 9th Int. Conf. Young Computer Scientists (ICYCS), Hunan, China.
Acknowledgement
This research was supported by ZF Sachs Korea.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Kim, D., Kim, J. & Lee, M.C. Improvement of HILS Using Advanced Exploratory and Optimization Techniques for System Qualification Test. Int.J Automot. Technol. 24, 901–911 (2023). https://doi.org/10.1007/s12239-023-0074-x
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12239-023-0074-x