Reference-free digital shadowgraphy using a moving BOS background

Abstract

A method of measuring density second derivative (shadowgraph) as a variant of background oriented schlieren (BOS) is presented. Pairs of images of a moving background with a small time difference are analysed using moving-window cross-correlation, giving the second derivative of density in the axis of background travel. The advantage over standard BOS is that no reference image is required. In contrast to the existing “reference-free BOS” method, no double-image is produced, making the data interpretation simpler. The sum-of-correlation (ensemble correlation) method can be used on an image series, where the flow is constant over the series time, to significantly reduce the size of the cross-correlation window. The reduction in the window size and sharpening of the resulting image is similar to that achieved by optical flow, but this method is easily automatable, without knowledge of the flow, and can be used with any existing BOS analysis software.

Graphic abstract

Introduction

Background oriented schlieren (BOS) is a common density gradient imaging technique, with a large number of variants, summarised in Raffel (2015). A camera is focused on a background with a low self-correlating pattern (“random dot pattern”), which is visualised once without flow and once with flow. A moving-window cross-correlation algorithm, identical to that used for particle image velocimetry (PIV) is used to compare the two images, and the movement of the background is related to the refractive index by:

$$\begin{aligned} \varDelta y=f\left( \frac{z_D}{z_D+z_A-f}\right) \frac{1}{n_0}\int _0^l\frac{\partial n}{\partial y}\mathrm{d}z, \end{aligned}$$

(1)

and an equivalent equation gives the movement in the x axis. The background movement $\varDelta y$ is a function of the z dimensions as detailed in Fig. 1, the camera focal length f and the index of refraction of the undisturbed background $n_0$ and of the object n, which are related to the density via the Gladstone-Dale equation. The refractive index is integrated over the line of sight, and the background movement is a function of the first derivative of the density, with the x and y components separable in the image plane. The second derivative can be acquired by differentiating the data a second time during post-processing, see Settles (2018), and this method is often used for vortex visualisation by BOS to improve the image contrast, see Bauknecht et al. (2016).

Fig. 1

BOS Arrangement and lengths, modified from Raffel (2015)

In contrast to classical schlieren techniques, the BOS technique has several drawbacks, as detailed by Settles and Hargather (2017):

• 1. The evaluation window size limits the minimum size of object which can be visualised by a given setup, imposing a spatial filter on the data.

• 2. The requirement for a reference image with undisturbed flow can be difficult to realize for some test cases.

• 3. The requirement to focus on the background leads to an irreducible unsharpness of the imaged object, imposing an additional spatial filter on the data.

For point 1 the size of the evaluation window needed is a function of the signal to noise level of the images, but also generally several background dots will be required to get a good cross-correlation peak. One approach to reducing this requirement for static flows is to use optical flow algorithms for the analysis of a series of BOS images, as detailed by Hill and Haering (2017) for an aircraft flying in front of the sun, and by Smith et al. (2017) for BOS from a follower aircraft. As noted in those papers, a problem with optical flow algorithms as currently implemented is a lack of robustness compared with window cross-correlation.

For point 2 it has been noted that a reference image can be difficult to realize for outdoor measurements, when the natural light changes between the reference and measurement images leads to problems with the cross-correlation, see Bauknecht et al. (2014). Additionally, when shooting from a follower aircraft, no simple reference image is available, since the background is moving, see Bauknecht et al. (2016). The solution used in these cases is a “Reference free BOS”, in which two images are taken with a separation which is long compared to the movement, so that the disturbances of the second image have moved onto undisturbed background in the first image and vice-versa, creating a double-image.

Reference-free digital shadowgraphy

Reference-free digital shadowgraphy (RFDS) uses essentially the same setup as Fig. 1, with the exception that the background is moved. A pair of images is taken with a small time difference, so that the flow is steady on the time frame of the image pair, in the same logic as is used for PIV. As seen in Fig. 2, if the position of an object on the background moves from position $x_1$ to $x_2$ then between the two images it will be seen through a different part the density object. Subtracting the two images will then give the second derivative at the position midway between the two measurement positions. The movement of the background should be a small fraction of the object size between images 1 and 2, so that for a background movement in the x-axis Eq. 1 becomes:

$$\begin{aligned} \varDelta x=f\left( \frac{z_D}{z_D+z_A-f}\right) \frac{1}{n_0}\int _0^l\left[ \frac{\partial n_2}{\partial x_2}-\frac{\partial n_1}{\partial x_1} \right] \mathrm{d}z, \end{aligned}$$

(2)

or when $x_2-x_1\rightarrow 0$:

$$\begin{aligned} \text{ RFDS } \text{ Signal }=\frac{\varDelta x}{x_2-x_1}-1\propto \int _0^l\left[ \frac{\partial ^2 \rho }{\partial x^2}\right] \mathrm{d}z. \end{aligned}$$

(3)

This is similar to the relationship for standard shadowgraphy, but the second derivative is only found in the axis of the background movement, rather than as an addition of both axes. Normalisation by the background movement velocity is necessary to prevent a dependence of the signal sign on the background movement direction, and 1 is subtracted to have the signal around zero as is normal for shadowgraph images.

Figure 2 shows a qualitative illustration of the expected BOS signal ($\propto \partial \rho /\partial x$) as the red line, produced over an object with varying density ($\rho$) in the negative direction (as expected from a vortex or heated jet), as shown by the black line. If the data from two locations in the BOS measurement are subtracted, an RFDS signal is produced ($\propto \partial ^2 \rho /\partial x^2$) as the green line. The strength of the background velocity signal increases with increasing background movement between images. The spatial resolution (or spatial filter) is limited by the greatest of three lengths: The unsharpness at the measurement plane, the background movement between two images and the cross-correlation window size. Ideally all three should be chosen to be around the same size.

Fig. 2

Reference-free digital shadowgraphy idea

Additionally if a series of images is taken during the time that the flow can be considered steady, either by using fast acquisition, or a steady flow, then the ensemble correlation of Meinhart et al. (2000) can be used to reduce the window size to the range $4 \times 4-8\times 8$ pixels.

A similar subtraction method is visible in Settles and Hargather (2017), Fig. 3b, however the moving background method used here is new. Multiple images have been used previously for schlieren velocimetry by Mittelstaedt et al. (2010), but here the ensemble correlation was not used. The AIRBOS method of Smith et al. (2017) used optical flow algorithms to get similar results.

Setup

A Zeiss Milvus 2/100M ZF.2 lens with a focal length doubler was used and an f-stop of F# = 22 was used. This led to a resolution of 9.4 px/mm in the image, and an unsharpness measured at the object plane of 1.25 mm (12 px) in both x and y axes. A jet of heated air at 140 $^\circ$C ejected from a 10 mm/14 mm ID/OD nozzle was used as the density object, meaning that there were 100–200 pixels over the density object, depending on the distance from the nozzle, and the unsharpness was around 5–10% of the density object size. In this test case the background was moved using the bed movement of a mill, as seen in Fig. 3, but a rotating disk background could also be envisaged. The linear movement rate was 20 mm/s, or 8 px between images, less than the image unsharpness. The values for the setup are summarised in Table 1.

Fig. 3

Reference-free digital shadowgraphy setup

Table 1 Experiment setup

The data was analysed using DaVis 10.1 from LaVision (2019). A multipass algorithm was used with square cross-correlation windows starting at $64 \times 64$ and reducing in size to the final value. No additional smoothing or data improvement was used.

Results

Figure 4 shows the results of the image analysis. The background movement in the x-direction for BOS images (equivalent to a vertical knife-edge schlieren) is shown for an instantaneous image in Fig. 4a and for an average of 20 images in Fig. 4b. The window size was $16\times 16$ px, which was slightly larger than the image unsharpness. A single reference-free digital shadowgraph image is in Fig. 4c, from a pair of images 1/24 s apart. The fine structure of the turbulent jet is visible at the top of the image, and is comparable with the topology in Fig. 4a, although the image is taken at a different time point. In Fig. 4d an average of 20 RFDS images is shown, and is comparable with the BOS result in Fig. 4b. The final result in Fig. 4e is for the ensemble correlation, and here the evaluation window was reduced to $6\times 6$ with 75% overlap, which is definitely smaller than both the image unsharpness and the background movement. For this final image, the limit on the spatial resolution is given by the image unsharpness.

Fig. 4

BOS and RFDS image examples: a single image standard BOS using $16 \times 16$ px window and 75% overlap b standard BOS averaged over 20 images c single image RFDS using 16x16 px window and 75% overlap d RFDS averaged over 20 images e RFDS ensemble average over 20 images using $6\times 6$ px window and 75% overlap

For the averaged data in Fig. 4, the data was extracted along the lines in the laminar jet region near to the jet exit. In this area the result is very similar between the averaged and the single-image data since the flow is relatively constant. The results of the cuts are in Fig. 5, and it can be seen that the expected result from Fig. 2 is generally reproduced, although the shape of the jet is clearly different to the nominal Gaussian form. It can be seen that for this particular flow that the window size of 16 px adequately resolves the flow features, and the finer resolution of the ensemble correlation slightly changes the peak heights, but the result is otherwise qualitatively unchanged.

Fig. 5

Lines extracted from Fig. 4

Conclusions

A new method of measuring density second derivative (shadowgraph) as a variant of background oriented schlieren (BOS) was presented and shown to be practically measurable. the main results are:

• 1. No reference image is required for cases of linear background movement and appropriately-matching camera frame rate. Analysis of an image-pair acquired similarly to PIV is sufficient.

• 2. The analysis using moving cross-correlation windows is robust in existing software.

• 3. A reduction in spatial resolution can be avoided by keeping the background movement less than the optical unsharpness.

• 4. Ensemble correlation can be used on image series for flows which are steady within the series time to significantly increase the measurement resolution.

Reference-free digital shadowgraphy (RFDS) is a potentially useful measurement method for some situations where traditional BOS is difficult to realise.