Virtual reality for automotive radars

Car manufacturers spend quite a lot on the development of driver assistance systems and subsequently on autonomous driving functionality. To ensure the safety and reliability of these functions meet industrial standards it is necessary to verify and validate their functionality. While tests on the road are still the ultimate evidence of correct operation they are associated with huge efforts and risks. Therefore, they have to be complemented by other means like simulations and tests on specialised testbeds. For the latter the car’s sensors have to be stimulated in a way that they perceive a desired – but only virtual – environment. An important type of sensor in cars is the radar due to its various advantages. This article describes the development of a stimulator generating virtual radar targets in order to enable the testing of autonomous driving functions.


Introduction
Multiple different advanced driver assistance systems (ADAS) are implemented in modern vehicles. These systems need sensors in order to perceive the vehicles environment including other traffic like cars, cyclists or pedestrians and static objects (i.e.: the road itself, obstacles, etc.). Currently, the most used sensors for these applications are ultrasonic sensors, cameras, lidars and radars [1]. As enabler for autonomous driving functions (ADF), ADAS systems will become even more important. But before autonomous driving can become broadly accepted, the ADAS functions have to be verified and validated. The traditional way to accomplish this goal is testing the functionality by driving either on proving grounds or on public roads. Safety experts assume that distances between 1 and 10 million km [2], [3], [4] are necessary to guarantee a risk less than or equal to human drivers. One drawback of this approach is, that it is difficult or impossible to exactly reproduce situations which endanger other road users. But especially these extreme situations are of interest and need to be repeated until the ADFs operate in a satisfactory manner. To reduce the danger and the cost of these tests, other supporting verification and validation (V&V) methods have to be or have already been introduced. One possibility is the software simulation of parts or the whole system. Another one are hardware-in-the-loop (HiL) tests of components. But in the end the whole vehicle with all its systems has to be tested. In order to reduce the beforehand mentioned testing kilometres on roads even further vehicle-in-the-loop (ViL) tests on specialised testbeds are envisaged. Since the ADF systems interact with the environment by their sensors it is necessary that these sensors "see" the intended scenario consisting of other cars, pedestrians and obstacles. Such a test environment is already arranged using a large hall with remotely controlled vehicles and dummies [5], [6], [7]. But while this addresses the issues danger and repeatability it is still a huge effort both in time -the scenarios have to prepared -and expenses. Therefore, further efforts are undertaken to provide the sensors with "virtual reality goggles" meaning that the environment exists only virtually in software but physical stimuli are given to the sensors in order to let the sensors think that this scenario is real. Such an approach allows V&V tests to be performed on testbeds and is the idea behind the DrivingCube ™ by AVL List GmbH (see Fig. 1) [9].
In this paper we introduce the concepts to stimulate one kind of sensor, namely the automotive radar. A short overview of automotive radar and its stimulation are given in Sect. 2.1 and 2.2, respectively. A radar target stimulator (RTS) has been developed at the Institute of Microwave and Photonics Engineering of Graz University of Technology in corporation with AVL List GmbH. The software necessary for generating the input parameters for the RTS was derived by the Institute of Automation and Control (also Graz University of Technology). The design considerations and the components of this RTS are presented in Sect. 3 in detail. Section 5 provides a short outlook on the future of automotive radar sensors and the impact of these trends on target stimulation. Thereafter, we present a summary on this paper in Sect. 6.

Principles of automotive radar
Radar has a unique position among the automotive sensors responsible for the perception of the environment. Compared to e.g. ultrasonic sensors it works both in the near-& far-range. Due to its flexibility the radar sensor is used in connection with multiple ADFs (like automatic cruise control, emergency breaking or blind spot detection) [10]. Based on the active and coherent mode of operation of the radar (i.e.: the sensor creates its own target illumination), it is also able measuring the relative velocity of other objects. Furthermore, radar sensors work reliably also under adverse weather conditions like fog and rain where optical systems (e.g. cameras or lidars) have difficulties [11].
Automotive radar sensors have achieved maturity since they have been used for quite some years, especially in high-end cars. Moreover, the underlying technology has been around in many other radar applications before. Since its introduction, the automotive radar has undergone a significant evolution. The operating frequency has changed from 24 GHz to 77 GHz. This shift to higher centre frequencies was, on the one hand, initiated by legislative regulations. On the other hand, higher centre frequencies allow higher bandwidths of the transmit signal. Frequencies even above 100 GHz are envisaged for the future [12]. Furthermore, the waveform of the radar's transmit signal changed. While in the beginning the classical pulsed system was used, today the frequency modulated continuous wave (FMCW) principle with fast chirp sequences is primarily utilised. Similar to other radars there were also significant evolutions in the antenna design. At the beginning the antennas were mainly steered mechanically in the azimuth direction. The current and future generations of automotive radars are based on arrays of patch antennas allowing electronic beam steering or digital beam forming not only in azimuth but also in elevation.

Basics of radar target stimulation
To stimulate radars in general and automotive radar in particular, the transmitted signal of the radar has to be changed in a way that represents one or more target objects and sent back to their radar receiver. The radar will then "see" those virtual -not existing in reality -targets in the same way as it would detect real objects ("deceptive jamming", [13], [14], [15]). There are 4 target parameters which are important for the detection process in the radar: • distance between the radar ("ego-vehicle") and the target: target range R, • direction to the target given by the azimuth and elevation angles, • relative speed between the ego-vehicle and the target, but only the radial velocity component v (range-rate) is relevant, • radar cross section (RCS) of the target which defines the amount of energy reflected back to the radar.
Range, velocity and RCS will influence the echo signal directly and the RTS has to modify the signal accordingly: • delay the echo by the amount τ • shift the frequency by the Doppler frequency f D , where f 0 is the radar centre frequency and c 0 is the velocity of light • attenuate or amplify the signal by a gain G depending on the RCS σ and the distance Some implementations of a RTS directly inject the necessary echo signal at the RF port of the radar sensor. In this way, they forgo the free-space wave propagation and the radar's antenna altogether. Such an approach is unfavourable at a ViL testbed due to two reasons. On the one side, the direct connection of the RF port requires modification at the vehicle and the sensor itself. Such interventions should be kept to an absolute minimum on a testbed. On the other side, the impact of parasitic reflections caused by the bumper or other part of the vehicle's body are neglected. Hence, the behaviour of the sensor will differ from the one recognised in road tests. Therefore, the stimulation has to be accomplished using the original interface of the radar -the antenna.
In order to stimulate different target angles, the RTS needs a way to change the direction from which the radar receives the echo signal. This can be accomplished by either moving one or more transmit antennas of the RTS. Another possibility is applying multiple parallel transmit channels where each channel is responsible for one direction. An alternatively approach, the rotation of the radar sensor itself, is not feasible for ViL tests as it requires a massive intervention on the vehicle. Additionally, this solution supports only a single independently moving target.

Requirements
A ViL-test equipment for ADAS functions has different requirements for a RTS than a test system for verifying the radar sensor itself. The latter has to prove that the sensor is working correctly and validates its performance or electrical parameters. In general this can be accomplished with a single target. Only for testing the radar's resolution -in range, angle and velocity -a second target is necessary. In the radar's so-called target mode -no tracking algorithms are used to generate the output -it is not even necessary to change the target's distance even if the target shows a Doppler-shift. The radar's range and velocity accuracy can be tested independently.
In contrast, a RTS-system for ADAS V&V has to generate the radar echos of complex and realistic traffic scenarios which are often generated by environment simulation systems (e.g. [16]). Those virtual targets have to move independently. To ensure that the radar's tracking algorithm works as desired the stimulated velocity must be equal to the change rate in distance. Otherwise, the radar processor will ignore the target due to its physically impossible attributes.
As mentioned in Sect. 2.2 radar target stimulation on a ViL testbed applies Over-the-air (OTA) injection of the echo signals via the radar's antennas. Unfortunately, OTA stimulation will introduce another problem: reflections from the surrounding environment which is called clutter. Unlike in reality, where the static environment has a Doppler-shift in regard to the moving radar, on the testbed both, the radar and the environment, are static resulting in zero Doppler-shift. It is difficult for the radar-processor to cope with such non-standard circumstances. For a proper stimulation on a testbed any clutter must be eliminated as much as possible.
Since a ViL testbed should be usable for different vehicles and, therefore, also different radar sensors the design of the RTS shall not impose any constraints on the radar, its design and its waveform. At best, the RTS should successfully stimulate the sensor without any a-priori knowledge about the radar.
Additionally, the intended application for the RTS described in this article imposes another requirement which is difficult to achieve: the focus of the RTS should be on the stimulation of targets at short distances (down to about 2 metres). Nevertheless, it has also to cover the radar's instrumented range which is typically about 250 m. Furthermore, todays automotive radar have a bandwidth up to 1 GHz resulting in a range resolution of 15 cm. The resolution of the RTS has to be better than that.
The implications of these requirements on the design of our RTS are described in Sect. 3.2.

Concept and general design
In the framework of this article only the hardware of the RTS is described. The parameters necessary to stimulate the targets are prepared by the RASIG software which are provided as digital data [17].
The concept and design of our RTS was strongly influenced by the requirements given in Sect. 3.1. Especially, the low minimum distance of 2 m (corresponding to a time delay of 13 ns) together with the fact that we have to support a wide range of radar sensors (no a-priori knowledge about the radar's waveform) forces an analogue implementation. Without a recording and playback mechanism -which is not possible if the radar transmit signals changesuch low latencies cannot be achieved in the digital domain.
Unfortunately, the complexity of analogue based RTS increases more or less linearly with the maximum target range and the number of targets to be stimulated. The above given maximum range and delay line resolution would result in nearly 1700 delay sections which is clearly not feasible. To lower the complexity, a hybrid solution consisting of both an analogue and a digital system is used to cover the whole range of an automotive radar (2-250 m). The hand-over distance between the two subsystems is set to 30 m. This is the shortest delay realisable by state-of-the-art digital processing modules consisting of an analogue-digital-converter (ADC), a digital-analogue-converter (ADC) and a field programmable gate array (FPGA) in between (see Sect. 3.7).
Although 30 m can be achieved with acceptable effort, we decided on a concept for the analogue RTS which offers a good scalability, both in the distance and the number of targets. In this way, the RTS can be optimised for the intended test cases. This scalable concept is shown in Fig. 2.
To accommodate the different radar frequencies we decided on processing the radar signal at an intermediate frequency (IF). In this case the RTS can be adapted for different radar centre frequencies by changing the frontend only. Furthermore, the full implementation of the RTS at 77 GHz is of much higher complexity compared to frequencies below 10 GHz. In the end, an IF of 2 GHz was chosen due to the availability of suitable components which support a bandwidth of 1 GHz (most state-of-the-art long-range-radars use a signal bandwidth of up to 1 GHz). Furthermore, the selected IF frequency works well with the ADC and the DAC of the digital RTS module.
The components of the analogue RTS responsible for modifying the signal parameters (as described in Sect. 2.2) are presented in the following sections.

Delay line module
Variable delays are normally implemented by binary switched delay lines because this method scales good in the range dimension (doubling the range needs only one additional delay segment). But it scales badly in regard to the number of targets. Since such a delay line cannot generate delays for multiple independent targets each target would need its own delay line. An alternative approach is the so-called tapped delay-line. It consists of delay segments of identical length corresponding to the minimum desired delay. The number of these segments increases linearly with the maximum range but each possible delay can be achieved simultaneously by using couplers between the segments. This concept is presented in Fig. 3 and was chosen for our RTS. In order to reduce the number of necessary delay segments we chose a length of 60 cm for those (corresponding to 30 cm range resolution). Since the range accuracy was required to be better than this value an additional adjustment of the delay was implemented in the target emulation modules (TEM) as described in Sect. 3.5. This allocation reduced the number of switches and couplers significantly (e.g. the break even point regarding the number  Fig. 4. For the first demonstrator the delays themselves were implemented by coaxial cables. In future designs this realisation will be changed to achieve better integration on printed circuit boards (PCB). For example, defective-ground-structure transmission lines could be used.

Switch matrix & modules
The switch modules form the interconnection between the delay modules (Sect. 3.3) and the TEMs (Sect. 3.5) as shown in Fig. 2. A target is moved by switching the input of its TEM from one tap of the delay line to the next. Since hot-switching from one delay to another will cause undesired phase jumps of the stimulator's output -which does not happen in the real world -measures were taken to prohibit this: instead of a single connection to the TEM there are two, one can be connected to even-numbered delays the other one to odd-numbered ones (see Fig. 5). Using a blend-over mechanism in the TEM cold-switching between those two inputs is ensured.
The chosen design of the switch matrix does not only allow oneto-one routing of a delay line tap to a TEM but also feeding the same delay to multiple TEMs (one-to-many) and even different delays to the same TEM (many-to-one) enabling the generation of targets with a range extension covering multiple delay segments.

Target emulation module
The TEM is the component of the analogue RTS which adjusts the received radar signal in order to generate a virtual target with the desired velocity and RCS properties. Generally, one TEM can only provide a single target. Therefore, the numbers of targets which can be stimulated depends on the number of TEMs in the system. The block diagram of a TEM is provided in Fig. 6.
As mentioned in Sect. 3.3 the TEM improves the range resolution of the stimulator by a factor of 4 by providing additional delay segments. The length of those sub-delays are a quarter of the original delay segments. Variable attenuators allow a blend over from one delay to another. This blend over allows to switch a delay segment on or off while the signal of this channel is not active. This principle is depicted in Fig. 7.
Since the target range is not changed at the radar frequency but by switching the delay at the much lower IF the phase change produced by this is also much lower than that of a target moving in reality (Doppler shift, see Eq. (2)). It is one of the tasks of the TEM to generate the correct Doppler frequency shift which enables the radar to detect the correct target velocity. This is accomplished by a vectormultiplier which is fed with the I/Q-components of the Doppler sig-  Furthermore, the TEM has to correctly set the amplitude. As shown in Eq. (3) this depends both on the target distance and its RCS. Especially the dynamic range due to distance variations can be quite large. E.g. the same object positioned at 3 or 300 m has a difference in the echo power of 80 dB. To accomplish this task the TEM applies a cascade of several programmable attenuators. Figure 8 shows a photo of a TEM.

Antenna switch module
For angular target movement the echo signal must be switched between different transmit antennas. The chosen antenna determines the perceived target's azimuth.
A switch matrix with a similar concept as the delay switch matrix (Sect. 3.4) is used for routing the signal from a TEM to an antenna frontend. It has to support a one-to-many signal routing for lateral extended targets and many-to-one connections for multiple targets in the same direction.

Digital RTS implementation
As indicted in Sect. 3.2 a digital RTS is necessary to make the stimulation of long-range targets feasible. To set the hand-over range as low as possible we selected the cutting edge hardware platform AV104 from ApisSys [18] (Fig. 9). This module combines an ADC and a DAC with extremely low latencies with a high capacity FPGA. The resulting overall minimum latency of 180 ns -one of the lowest latencies available for civil application -correlates to a target distance of 27 m.
The digital RTS is capable to process signals with a bandwidth of up to 1 GHz (more or less the same as the analogue RTS).
The firmware is based on a classical Digital Radio Frequency Memory (DRFM) structure. Massive parallel processing in the FPGA is necessary to ensure the required throughput. The frequency shift for each target is performed by a complex mixer fed by a numerically controlled oscillator. Afterwards, the delay is implemented independently for each target by a block RAM controlled by a programmable shift register. The resolution of the delay is about 5 cm. Thereafter, the signal's power level is set by a multiplier. The FPGA should be able to stimulate up to 30 targets. In the last step the signals of all targets are combined and sent to the DAC which has to provide the necessary dynamic range.
The module is equipped with a single DAC which restricts the digital RTS to a single azimuth angle. In order to stimulate multiple directions either multiple boards or a new board with multiple DACs are necessary whose outputs are connected to the antenna switch matrix in the same way as the TEMs.

Function tests
The correct operation of the RTS has been validated both in the laboratory and on a complete roller test bench (see Fig. 10). The stimulator was able to create targets which were successfully detected and tracked by the radar sensor (see Fig. 11). Using both the analogue and digital modules the RTS was able to cover the whole required range.
Those tests have also been used to minimise and partly eliminate the stationary clutter from the testbed's surroundings. We were able to successfully suppress the clutter by the use of a few radar absorbing plates without impeding the artificial air flow to the vehicle too much.

Outlook
There are already a few indications how automotive radars will evolve in the future. As indicated in Sect. 2.1 the next generations of radar sensor will move to even higher frequencies. This can be easily covered with our RTS by changing the RF-frontend. More of a problem will be introduced, if the bandwidth of the radar signal is significantly increased as well.
Another trend in the development of upcoming radars is to combine radar sensor functionality with additional features, like communication. It would be no problem to add such functionality to the radar by using an appropriate modulation scheme like orthogonal frequency division multiplex (OFDM). This allows, on the one hand, to transmit a data-payload on top of the radar signal and to provide, on the other hand, a technique to implement interference mitigation mechanisms. Interference and its mitigation is already becoming an important issue with automotive radar because of the huge number of sensors already deployed and the much higher number envisaged to hit the roads in the near future. All these radars will of course influence each other leading to a decrease in the sensor performance. This puts a high pressure on the radars' developers to implement mitigation procedures. RTSs will have to implement interference sources in order to test these mitigations.
In the area of the antenna an increase of spatial resolution by applying multiple-in-multiple-out (MIMO) radars concept are investigated [19]. Those will allow to increase the angular resolution without increasing the complexity of the antenna hardware by the same factor. The massive signal processing necessary in MIMO radars to detect the targets must also be implemented in stimulation systems in order to generate those targets. The multiple channels between all antenna elements -both on the radar's transmit and receive side -have to be taken into account for a proper target stimulation.
Another issue is the processing of the so-called Micro-Doppler [19]. Micro-Doppler is the variation of the target's Doppler-frequency shift due to independent movement of components of the target, like the rotation of the tyres of a car or the motion of arm and legs of a pedestrian [20]. Those effects can be taken into account by updating the generation of the I/Q-components of the Doppler signal (compare Sect. 3.5).
All these trends will, of course, have a huge impact on a RTSsystem and may even require massive revision in the underlying structure. For the designer of a RTS it is therefore important to observe the developments in automotive radar very closely to be able to respond quickly to changes.

Conclusion
In this article we showed what is necessary to test ADAS functions on a ViL-testbed. After a general introduction of the involved concepts we focused on the automotive radar sensor and its stimulation. In a first step we derived the requirements and restrictions for the design of a RTS based on general properties of the sensors itself and their stimulation on a ViL testbed. Using this input we introduced the general structure of the hybrid analogue-digital RTS system. Thereafter, all corresponding components were presented, putting the emphasis on their seamless integration. In this context the design and implementation of this components were highlighted. Furthermore, it was shown how the requirements influenced the design and how the RTS based on this design is able to fulfil those requirements.
To validate the performance of the designed RTS measurements in the laboratory as well as on a roller test bench were performed. Despite of the industrial environment of the testbed we were able to properly stimulate the radar sensor including its object tracker.
Finally, we provided a short outlook on how automotive radar may evolve in the future. This summary indicated new challenges which Andreas Gruber studied information and computer engineering at Graz University of Technology, Austria, with focus on telecommunication. Since January 2011 he has been employed at the Institute of Microwave and Photonic Engineering at Graz University of Technology, working as a system and hardware development engineer in the field of radar technology. He is member of IEEE and the Association of Old Crows.
Michael Vorderderfler studied information and computer engineering (telematics) at Graz University of Technology, Austria, and received his master's degree (Dipl.-Ing.) in 2016. During his studies, he focused on telecommunication and system-onchip design. In the course of his master's thesis he deepened his skills in microwave engineering and small antennas and gathered 2 years of practical experience in this field at semiconductor industry within his internship at Infineon Austria. Since 2016 he has been working as a scientific assistant at the Institute of Microwave and Photonic Engineering at Graz University of Technology. He started his Ph.D. study in summer 2016 with the focus on microwave circuit design, especially alternative frequency translation techniques at millimetre wave frequencies.
Dominik Amschl finished the Higher Technical School for electrical engineering and started his professional career at the Institute of Microwave and Photonic Engineering at Graz University of Technology, Austria, in December 2010. He is the responsible engineer for microwave measurement tasks -especially on-wafer and antenna measurements. Furthermore, he participated in various projects as design and development engineer. Besides that, he started to study electrical engineering at Graz University of Technology.
Wolfgang Bösch joined the Graz University of Technology, Austria, in March 2010 to establish a new Institute for Microwave and Photonic Engineering. Prior he was the CTO of the Advanced Digital Institute in the UK, a not for profit organisation to promote research activities. Earlier he served as the Director of Business and Technology Integration for RFMD UK, and for almost ten years he was with Filtronic plc as CTO of Filtronic Integrated Products and the Director of the Global Technology Group. Before joining Filtronic, he held positions at the European Space Agency (ESA) working on amplifier linearization techniques, MPR-Teltech in Canada working on MMIC technology projects and the Corporate R&D group of M/A-COM in Boston, USA, where he worked on advanced topologies for high efficiency power amplifiers. For four years he was with DaimlerChrysler Aerospace (now Airbus) in Germany working on T/R modules for airborne radar.