International Journal of Automotive Technology

, Volume 19, Issue 4, pp 751–758 | Cite as

Test Scenario Design for Intelligent Driving System Ensuring Coverage and Effectiveness

  • Qin Xia
  • Jianli Duan
  • Feng Gao
  • Qiuxia Hu
  • Yingdong He


Intelligent vehicle greatly benefits traffic safety, efficiency and driving comfortable. With the development of intelligent driving technology and its application, it is becoming increasingly important to do effective and comprehensive tests before putting on the market. Comprehensively considering the cost of test, an automatic generation method of test scenarios is proposed to ensure both coverage and effectiveness. Based on the analyzed key infuence factors of an intelligent driving system, the analytic hierarchy process (AHP) is used to determine their importance and accordingly an complex index is defined, based on which an improved test case generation algorithm based on the pairwise independent combinatorial testing tool (PICT) is proposed to ensuring both combinational coverage and complexity of test cases. Finally, the test scenario is generated by clustering these discrete test cases considering similarity and complexity. The high complex test cases are preferred to be combined together and conducted preferentially to increase the test efficiency. The effectiveness of this method is validated by applying it on a lane departure warning system (LDW).

Key Words

Intelligent vehicles ADAS Test scenario design Analytic hierarchy process Combinational test 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. Amine, A., Elberrichi, Z. and Simonet, M. (2010). Evaluation of text clustering methods using WordNet. Int. Arab J. Information Technology 7, 4, 349–356Google Scholar
  2. Auckland, R. A., Manning, W. J., Carsten, O. M. J. and Jamson, A. H. (2008). Advanced driver assistance systems: Objective and subjective performance evaluation. Vehicle System Dynamics: Int. J. Vehicle Mechanics and Mobility 46 Supplement 1, 883–897CrossRefGoogle Scholar
  3. Aust, M. (2012). Evaluation Process for Active Safety Functions: Addressing Key Challenges in Functional, Formative Evaluation of Advanced Driver Assistance Systems. Ph. D. Dissertation. Chalmers University of Technology. Gothenburg, Sweden.Google Scholar
  4. Cohen, D., Dalal, S. R., Fredman, M. L. and Patton, G. C. (1997). The AETG system: An approach to testing based on combinatorial design. IEEE Trans. Software Engineering 23, 7, 437–444CrossRefGoogle Scholar
  5. Gao, F., Gui, H. Y., Zhang, Q. and He, J. G. (2012). Development of lane detection system based on FPGA. Proc. FISITA World Automotive Cong., Beijing, China, 1–9Google Scholar
  6. Gao, S., Du, B., Jiang, Y., Lv, J. and Ma, S. (2015). An efficient algorithm for pairwise test case generation in presence of constraints. Proc. IEEE Int. Conf. Systems & Informatics, Taka matsu, Japan, 406–410Google Scholar
  7. Hickman, J. S. and Hanowski, R. J. (2012). An assessment of commercial motor vehicle driver distraction using naturalistic driving data. Traffic Injury Prevention Journal 13, 6, 612–619CrossRefGoogle Scholar
  8. ISO 17361 (2005). Intelligent Transport Systems-lane Departure Warning Systems-performance Requirements and Test Procedures.Google Scholar
  9. Jeong, O. (2013). A practical extension of pairwise testing. Proc. IEEE Int. Symp. Software Reliability Engineering Workshops, Dallas, 116–122Google Scholar
  10. Karl, I., Berg, G., Ruger, F. and Farberr, B. (2013). Driving behavior and simulator sickness while driving the vehicle in the loop: Validation of longitudinal driving behavior. IEEE Intelligent Transportation Systems Magazine 5, 1, 42–57CrossRefGoogle Scholar
  11. Kuhn, R., Lei, Y. and Kacker, R. N. (2008). Practical combinatorial testing: Beyond pairwise article in IT professional. IT Professional 10, 3, 19–23CrossRefGoogle Scholar
  12. Kuhn, R. and Reilly, M. J. (2002). An investigation of the applicability of design of experiments to software testing. IEEE Proc. Annual Software Engineering Workshop, Greenbelt, Maryland, USA.Google Scholar
  13. Kurt, A., Özbilgin, G., Redmill, K. A., Sherony, R. and Özgüner, Ü. (2015). Test scenarios, equipment and testing process for LDW/LDP performance evaluation. SAE Paper No. 2015–01-1404Google Scholar
  14. Lemmen, P., Fagerlind, H., Unselt, T., Rodarius, C. and Infantes, E. (2012). Assessment of integrated vehicle safety systems for improved vehicle safety. Procedia-Social and Behavioral Sciences 48, 7, 1632–1641CrossRefGoogle Scholar
  15. Ona, R. D. and Ona, J. D. (2015). Analysis of transit quality of service through segmentation and classification tree technieques. Transportmetrica A Transport Science 11, 5, 1–28Google Scholar
  16. Ploeg, J., Hendriks, F. M. and Schouten, N. J. (2008). Towards nondestructive testing of pre-crash systems in a HIL setup. Proc. IEEE Intelligent Vehicles Symp., Eindhoven, Netherlands.Google Scholar
  17. Saaty, T. L. (2003). The Analytic Hierarchy Process. McGraw-Hill. New York, USA.zbMATHGoogle Scholar
  18. Tatar, M. (2015). Enhancing ADAS test and validation with automated search for critical situations. Proc. Driving Simulation Conf. & Exhibition, Tübingen, 82–87Google Scholar
  19. Victor, T., Bärgman, J. and Hjälmdahl, M. (2010). Sweden-Michigan Naturalistic Field Operational Test: Phase 1 UMTRI Transportation Research Institute.Google Scholar
  20. Zhang, Q., Chen, D. X., Li, Y. S. and Li, K. Q. (2014). Research on performance test method of lane departure warning system with PreScan. Proc. SAE-China Cong., Beijing, China, 445–453Google Scholar
  21. Zhao, D., Huang, X., Peng, H., Lam, H. and Leblanc, D. J. (2018). Accelerated evaluation of automated vehicles in car-following maneuvers. IEEE Trans. Intelligent Transportation Systems 19, 3, 733–744CrossRefGoogle Scholar
  22. Zhao, D., Lam, H., Peng, H., Bao, S. and Leblanc, D. J. (2017). Accelerated evaluation of automated vehicles safety in lane change scenarios based on importance sampling techniques. IEEE Trans. Intelligent Transportation Systems 18, 3, 595–607CrossRefGoogle Scholar
  23. Zoubi, M. B. and Rawi, M. A. (2008). An efficient approach for computing silhouette coefficients. J. Computer Science 4, 3, 252–255.CrossRefGoogle Scholar

Copyright information

© The Korean Society of Automotive Engineers and Springer-Verlag GmbH Germany, part of Springer Nature 2018

Authors and Affiliations

  • Qin Xia
    • 1
  • Jianli Duan
    • 1
  • Feng Gao
    • 1
  • Qiuxia Hu
    • 1
  • Yingdong He
    • 2
  1. 1.School of Automotive EngineeringChongqing UniversityChongqingChina
  2. 2.Mechanical EngineeringUniversity of MichiganMIUSA

Personalised recommendations