Skip to main content
Log in

Improvement of HILS Using Advanced Exploratory and Optimization Techniques for System Qualification Test

  • Published:
International Journal of Automotive Technology Aims and scope Submit manuscript

Abstract

Global automakers are required to apply Automotive SPICE (A-SPICE) to evaluate the development capabilities and qualities of suppliers in addition to the automotive functional safety standard (ISO 26262) for preventing accidents caused by errors in the electronic components. However, rapidly changing software requirements and environments make it difficult to follow A-SPICE and ISO 26262, leading to late detection of software defects in the system qualification test, which is the final verification stage of the V-model. Correcting these defects incurs additional time and cost. This study proposes an enhanced qualification test strategy and technique, which ensures zero defects at an early stage, thereby saving time and cost. The proposed strategy and technique are performed by advanced exploratory and optimization tests that utilize a risk-based test strategy to solve problems. The risk-based test strategy is established at the beginning to identify highly potential problems and is derived from the 1st stage advanced exploratory and 2nd stage optimization tests based on ISO 29119. The test is performed during a CDC system qualification test using an “advanced HILS,” which supports UDS and XCP protocols. The proposed test techniques can solve problems during an early phase and achieve zero defects in a CDC system qualification test.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

Abbreviations

Vv:

valid value

Vi:

invalid value

Bx:

boundary max value

Bn:

boundary min value

TCs:

sum of check test case

CTt:

testcase by classification tree method

EPt:

testcase by exploratory testing

PWt:

pairwise testing

BAt:

boundary value analyzer

STs:

mixing the state transition and scenario

FSc:

failsafe category

CPs:

sum of check parameter variables

{}:

applied according to detection conditions

[]:

number of test cases

References

  • Afzal, W., Ghazi, A. N., Itkonen, J., Torkar, R., Andrews, A. And Bhatti, K. (2015). An experiment on the effectiveness and efficiency of exploratory testing. Empirical Software Engineering 20, 3, 844–878.

    Article  Google Scholar 

  • Barhate, S. S. (2015). Effective test strategy for testing automotive software. Int. Conf. Industrial Instrumentation and Control (ICIC), Pune, India.

  • Burkacky, O., Deichmann, J. and Stein, J. P. (2019). Automotive software and electronics 2030: mapping the sector’s future landscape. McKinsey & Company.

  • Chen, T. Y., Poon, P. L. and Tse, T. H. (2000). An integrated classification-tree methodology for test case generation. J. Software Engineering and Knowledge Engineering 10, 6, 647–679.

    Article  Google Scholar 

  • Choi, W. I., Park, D. D. and Hong, S. S. (2016). Improved automotive E/E software development process based on ISO 26262 via Agile methods. KSAE 2016 Annual Conf., Jeju, Korea.

  • Dzambic, M., Kreuzberger, C., Veledar, O. and Macher, G. (2021). A rapid prototyping system, intelligent watchdog and gateway tool for automotive applications. IEEE 18th Int. Conf. Software Architecture Companion (ICSA-C), Stuttgart, Germany.

  • Jahanbin, S. and Zamani, B. (2018). Test model generation using equivalence partitioning. 8th Int. Conf. Computer and Knowledge Engineering (ICCKE), Mashhad, Iran.

  • Jeong, S. Y., Yoo, C. J. and Noh, H. M. (2016). State transition based test model and test case generation technique for embedded system, an empirical approach. Int. J. Software Engineering and Its Applications 10, 11, 233–254.

    Article  Google Scholar 

  • Khan, M. E. (2011). Different approaches to black box testing technique for finding errors. Int. J. Software Engineering & Applications 2, 4, 31–40.

    Article  Google Scholar 

  • Kim, T. D. (2015). Measurement of S/W development processes and maturity using agile methodologies. J. Institute of Internet, Broadcasting and Communication, 6, 147–154.

    Article  Google Scholar 

  • Lee, K. H., Lee, C. Y. and Jeong, H. S. (2010). A study on the field test characteristics of semi-active suspension system with continuous damping control damper. Trans. Korea Fluid Power Systems Society 7, 4, 32–38.

    Google Scholar 

  • Monteiro, C. B., Dias, L. A. V. and da Cunha, A. M. (2014). A case study on pairwise testing application. 11th Int. Conf. Information Technology: New Generations (ITNG), Las Vegas, Nevada, USA.

  • Qin, X., Jianli, D., Feng, G., Qiuxia, H. and He, Y. (2018). Test scenario design for intelligent driving system ensuring coverage and effectiveness. Int. J. Automotive Technology 19, 4, 751–758.

    Article  Google Scholar 

  • Ramachandran, M. (2003). Testing software components using boundary value analysis. Proc. 29th Euromicro Conf., Belek-Antalya, Turkey.

  • Ryser, J. and Glinz, M. (1999). A scenario-based approach to validating and testing software systems using statecharts. 12th Int. Conf. Software and Systems Engineering and their Applications (ICSSEA), Paris, France.

  • Sălcianu, M. and Fosalau, C. (2012). A new CAN diagnostic fault simulator based on UDS protocol. Int. Conf. Exposition on Electrical and Power Engineering (EPE), Isai, Romania.

  • Selegean, V. (2016). https://www.todaysoftmag.com/article/2150/quality-assurance-in-automotive-embedded-projects

  • Vashishtha, V., Singla, T. and Singh, S. (2014). Software testing. Int. J. Research 1, 8, 1258–1264.

    Google Scholar 

  • Vasylyna, N. (2011). https://blog.qatestlab.com/2011/02/23/exploratory-testing-advantages-and-disadvantages/

  • Völker, M. and Stadie, W. (2017). Effects of ISO 26262 on commercial vehicle and steering system. ATZ Worldwide, 119, 60–65.

    Article  Google Scholar 

  • Zhu, X., Zhou, B., Hou, L., Chen, J. and Chen, L. (2008). An experience-based approach for test execution effort estimation. 9th Int. Conf. Young Computer Scientists (ICYCS), Hunan, China.

Download references

Acknowledgement

This research was supported by ZF Sachs Korea.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Min Cheol Lee.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kim, D., Kim, J. & Lee, M.C. Improvement of HILS Using Advanced Exploratory and Optimization Techniques for System Qualification Test. Int.J Automot. Technol. 24, 901–911 (2023). https://doi.org/10.1007/s12239-023-0074-x

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12239-023-0074-x

Key Words

Navigation