Abstract
Tests for autonomous vehicles (AVs) and vehicle components are conducted in various ways in a laboratory, a virtual world, and a proving ground. However, since the aforementioned evaluation has limitations for reproducing scenarios of specific edge cases and unintended situations, Field Operational Test (FOT) for autonomous vehicles on the actual road is still necessary. Due to the higher automation levels of autonomous vehicles should be able to drive in more diverse environments without the intervention of the driver, FOT is particularly essential. In this study, we built D-Live, an autonomous vehicle FOT platform in Daegu metropolitan city, to evaluate self-driving in urban environments. We also developed an analysis system to evaluate the performance of autonomous vehicles and automotive sensors. The D-Live platform can evaluate autonomous vehicles by reflecting real-time driving environment changes, weather, and road conditions. In addition, the D-Live platform can quantitatively evaluate the FOT result by processing the data collected from autonomous vehicles and roadside sensors. The processed data is analyzed using the predefined Operational Design Domain (ODD), Object and Event Detection and Response (OEDR), and use cases. This paper introduces the D-Live platform to evaluate autonomous vehicles in urban areas and FOT evaluation methods.
Similar content being viewed by others
Change history
30 March 2024
The Acknowledgement section of this article has been corrected
21 March 2024
A Correction to this paper has been published: https://doi.org/10.1007/s12541-024-01004-9
Abbreviations
- ADPI:
-
Autonomous driving performance index
References
SAE International. (2018). Taxonomy and definitions for terms related to driving automation systems for on-road motor vehicles. SAE International, 4970(724), 1–5.
Li, X., Arul Doss, A., Aksun Guvenc, B., & Guvenc, L. (2020). Pre-deployment testing of low speed, urban road autonomous driving in a simulated environment. SAE International Journal of Advances and Current Practices in Mobility, 2(6), 3301–3311.
Schratter, M., Hartmann, M., & Watzenig, D. (2019). Pedestrian collision avoidance system for autonomous vehicles. SAE International Journal of Connected and Automated Vehicles, 2(4), 279–293.
Euro NCAP. (2022). “European new car assessment programme (Euro NCAP): Rescue, extrication & safety test & assessment protocol,” Ver. 2.2, https://cdn.euroncap.com/media/75582/euro-ncap-res-test-and-assessment-protocol-v22.pdf
Wang, Z., Sun, H., Zhang, H., Xie, H., & Chen, Z. (2020). A novel assessment and administration method of autonomous vehicle. SAE International Journal of Advances and Current Practices in Mobility, 2(6), 3312–3319.
Benmimoun, M., Pütz, A., Zlocki, A., & Eckstein, L. (2013). EuroFOT: Field operational test and impact assessment of advanced driver assistance systems: Final results. In Proceedings of the FISITA 2012 world automotive congress, Vol. 9, pp. 537–547.
DriveC2X, Retrieved 22 May 2023 from https://wiki.fot-net.eu/index.php/DRIVE_C2X
Pegasus Project. Retrieved 22 May 2023 from https://www.pegasusprojekt.de/en/home
FESTA Handbook, version 8. (2021). https://www.connectedautomateddriving.eu/wp-content/uploads/2021/09/FESTA-Handbook-Version-8.pdf
Gay, K., & Kniss, V. (2015). Safety pilot model deployment: lessons learned and recommendations for future connected vehicle activities (No. FHWA-JPO-16-363). United States. Department of Transportation. Intelligent Transportation Systems Joint Program Office.
M-City. Retrieved 22 May 2023 from https://mcity.umich.edu/
Woven City. Retrieved 22 May 2023 from https://www.woven-city.global/
Kang, H., & Kwon, S. (2016). An Investigation on FOT trends and a suggestion of FOT methodology for autonomous vehicle. In Proceedings of the KSAE annual conference (Spring), Vol. 20.
Kang, H., Kim, B., & Kwon, S. (2016). A Study on Methodology for Field Operational Tests of Automated Vehicles applying FESTA Methodology. In Proceedings of the KSAE annual conference (Fall), pp. 826
Park, M., Lee, J., Choi, I., & Jeong, J. (2022). Performance of AEB vehicles in rear-end and cut-in collisions. International Journal of Precision Engineering and Manufacturing, 23, 911–920.
Shin, S. S., Kang, H. J., & Kwon, S. J. (2022). A study on data analysis for improving driving safety in field operational test (FOT) of autonomous vehicles. Machines, 10(9), 784.
Acknowledgements
This work was supported by the Technology Innovation Program (#20024908, Development of Integrated Management System for Seamless Automated Driving Control for Personalized Driver) funded by the Ministry of Trade, Industry & Energy (MOTIE, Korea).
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
This paper was presented at PRESM2023.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Lee, DW., Kim, TL. & Kwon, SJ. A Study on the Driving Performance Analysis for Autonomous Vehicles Through the Real-Road Field Operational Test Platform. Int. J. Precis. Eng. Manuf. (2024). https://doi.org/10.1007/s12541-024-00978-w
Received:
Revised:
Accepted:
Published:
DOI: https://doi.org/10.1007/s12541-024-00978-w