Abstract
The universal outlier detection scheme (Westerweel and Scarano in Exp Fluids 39:1096–1100, 2005) and the distanceweighted universal outlier detection scheme for unstructured data (Duncan et al. in Meas Sci Technol 21:057002, 2010) are the most common PIV data validation routines. However, such techniques rely on a spatial comparison of each vector with those in a fixedsize neighbourhood and their performance subsequently suffers in the presence of clusters of outliers. This paper proposes an advancement to render outlier detection more robust while reducing the probability of mistakenly invalidating correct vectors. Velocity fields undergo a preliminary evaluation in terms of local coherency, which parametrises the extent of the neighbourhood with which each vector will be compared subsequently. Such adaptivity is shown to reduce the number of undetected outliers, even when implemented in the afore validation schemes. In addition, the authors present an alternative residual definition considering vector magnitude and angle adopting a modified Gaussianweighted distancebased averaging median. This procedure is able to adapt the degree of acceptable background fluctuations in velocity to the local displacement magnitude. The traditional, extended and recommended validation methods are numerically assessed on the basis of flow fields from an isolated vortex, a turbulent channel flow and a DNS simulation of forced isotropic turbulence. The resulting validation method is adaptive, requires no userdefined parameters and is demonstrated to yield the best performances in terms of outlier under and overdetection. Finally, the novel validation routine is applied to the PIV analysis of experimental studies focused on the near wake behind a porous disc and on a supersonic jet, illustrating the potential gains in spatial resolution and accuracy.
Introduction
Particle image velocimetry (PIV) is a mature measurement technique whereby flowinduced displacement of tracer particles between sequential image recordings is deduced by means of statistical operators. The most common of these operators is crosscorrelation (Keane and Adrian 1992). Although versatile, the robustness and accuracy of correlation are strongly influenced by image quality, notably image noise and particle image density, and underlying flow features such as velocity gradients (Westerweel 2008) and flow curvature (Scarano 2004). An insufficient number of particle images to constitute a traceable pattern or too strong a distortion of the particle image pattern between snapshots can lead to erroneous velocity estimates. Incorrect vectors in turn severely penalise the iterative image analysis process and the computation of derivative quantities (Etabari and Vlachos 2005), while further deteriorating measurement uncertainty. Vector outlier detection has consequently received considerable attention within the PIV community resulting in a variety of detection schemes.
Song et al. (1999), for example, identify spurious vectors on the basis of continuity in the aforementioned pattern deformation adopting Delaunay tessellation. However, a simpler and more commonly applied approach to discern an erroneous displacement vector in the postprocessing stage is through its mismatched appearance with respect to neighbouring vectors. This can be either along the temporal and/or spatial dimension. In the former, even for nontimeresolved PIV data, proper orthogonal decomposition (POD) has been implemented as a filter (Wang et al. 2015; Raiola et al. 2015) or one resorts to more statistical approaches (Griffin et al. 2010). Intermediate outlier detection in iterative image processing sequences can, however, only rely on spatial information. Artificial neural networks have been proposed to evaluate the interconnection between individual vectors in the instantaneous velocity field (Liang et al. 2003). A more straightforward prediction of the model vector is based on the local median of a 3 × 3 neighbourhood, followed by imposing a fixed, uniform threshold on the residual between the scrutinised vector and estimator (Westerweel 1994). To relax the limitation of a spatially invariant threshold, Raffel et al. (1992) implemented an adaptive threshold utilising a local velocity variability based on the moving average of the vectors. Westerweel and Scarano (2005) constructed a reliable and robust threshold adopting a normalised median threshold (hereafter referred to as NMT); the difference between a correct vector and its estimator, which is based on the neighbourhood median, must fall within two times the median of the discrepancy between the neighbouring vectors and the prediction. Though widely applied, Duncan et al. (2010) highlight this approach to be unsuitable for unstructured data such as in particle tracking velocimetry (PTV) or adaptive PIV routines (Theunissen et al. 2007) and should include a weighting inversely proportional to the distance between vectors. This technique will be referred to as DWNMT.
Both NMT and DWNMT approaches have been categorically demonstrated to identify isolated outliers even if local median tests may suffer from under and overdetection (Lecuona et al. 2002). The former refers to failing to detect an outlier. Especially in the presence of clusters of erroneous vectors, the augmented fluctuation level causes the normalised threshold to be on a par with correct vectors. These faulty vectors are subsequently wrongly considered correct. Clustering of outliers is a quite common problem in PIV due to low seeding areas or strong light reflections on surfaces for instance, and the inherent problematic for validation is worth the attention. Overdetection refers to the case of classifying correct vectors as erroneous, which is prone in the presence of strong velocity gradients. To minimise this sensitivity, Nogueira et al. (1997) iteratively discriminated outliers on the basis of a validation criterion utilising predictions from interpolations considering the eight nearest vectors assessed to be coherent. Coherency was quantified as the ratio between the mean residual and the mean magnitude. This solution was shown to minimise the overall influence of outliers in data validation in the form of a reduced ratio between root mean value of the error and displacement, but at the cost of complexity. Moreover, as stated by the authors the method would fail in the presence of outlier clusters and continued the need of defining an appropriate validation threshold. The latter has been addressed by Shinneeb et al. (2004) through the implementation of a spatially varying threshold. Prior to evaluating the residual between the measured vector and the prediction, potential outliers are identified using a median filter and replaced with a distancebased Gaussianweighted average. After adding a userdefined constant, the filtered discrepancy serves as a heuristic for the local median test. This approach yielded promising results in terms of reducing over and underdetection despite the continuing need of refinement of the introduced constant. To further mitigate overdetection, Young et al. (2004) distinguish between spurious vectors and variations due to local velocity gradients by incorporating a local thinplate spline model to which vectors are compared. By adjusting the degree of smoothness in the spline model and the vector removal criterion, overdetection could be diminished in the presence of significant velocity gradients.
In this paper, the authors present a novel adaptive vector validation algorithm capable of (1) detecting clusters of outliers, (2) reducing the degree of overdetection, (3) overcoming the restrictions of existing methodologies by negating user input and (4) safeguarding computational simplicity. Although the process still applies the concept of median normalised thresholds, three ideas are introduced which elaborate on the findings of the studies mentioned afore. First, the number of neighbours for comparison is adjusted based on local flow coherency. The latter is quantified by means of secondorder regression. The authors argue that clusters of outliers are characterised by a higher variance (randomness) and the size of the vector basis for comparison must be extended accordingly. This step renders the validation algorithm fully adaptive. Second, an averageweighted median is introduced to reduce overdetections by relaxing the importance of distant data sites. Third, erroneous vectors are defined as local anomalies in vector direction and magnitude, whereas traditionally validation is based on the Cartesian velocity components. The authors would like to stress that the current work does not investigate the appropriate method of outlier replacement. The interested reader can find further information in relevant references such as Nogueira et al. (1997), Garcia (2011), Raben et al. (2012) and Sciacchitano et al. (2012).
After illustrating the problematic surrounding outlier identification, the suggested methodology is explained in Sect. 3. Section 4 concerns the assessment on the basis of benchmark velocity fields contaminated with synthetic spurious vectors. Appreciable amelioration in under and overdetection is demonstrated. Incorporation of the adaptive neighbourhood is also shown to be a very efficient concept to decrease the number of underdetections when applied to the traditional techniques. The improved validation process is finally incorporated in a recursive multigrid image analysis routine and applied to the experimental wake of a porous disc and supersonic jet in Sect. 5.
Problem statement: coherency
Human vision is considered the best tool in the identification of outliers, and its strength lies in the cognitive ability to distinguish coherent structures (Reiz and Pongor 2011). Each vector is unconsciously juxtaposed with its closest neighbours, and this basis for comparison is extended until a recognisable pattern emerges providing sufficient reliability to discriminate outliers. This process is illustrated in Fig. 1. The small collection of vectors in Fig. 1a could be deemed invalid if only the local neighbourhood were to be considered. However, extending the neighbourhood it becomes clear the vectors form part of either a coherent structure (Fig. 1b) or outlier cluster (Fig. 1c). While classic spatial outlier detection methodologies consult a restricted vicinity of typically eight (3 × 31) to 24 (5 × 51) vectors, the example highlights the need to adaptively expand the locality as to emulate human vision. Simultaneously, a group of actual outliers should not influence the validation process in such a manner as to invalidate correct outliers (overdetection).
Prior to validating a vector, an appropriate neighbourhood extent must therefore be selected. The methods of Nogueira et al. (1997) and Shinneeb et al. (2004) both incorporate an initial consistency heuristic to specify the basis for vector comparison in the following process stage. However, neither method accounts for the adverse effect of velocity gradients in coherent structures. As depicted in Fig. 1, both methods conjecture several correct elements of the vector collection as incoherent. A majority of vectors may consequently be invalidated already in the preparatory stage and excluded or replaced successively. Either approach inherently neglects underlying flow physics and essentially filters measured data, thereby influencing the overall accuracy of the results. Instead, in the current work the authors argue that each vector should be considered valid from the outset and coherency should only dictate the extent of the proximity to take into account. Reminiscent of the typical decay in spatial velocity correlations a weighting inversely proportional with spacing must then be applied to reflect the influence of each comparative vector. Differentiation between vectors must thus take place at a later stage with care to minimise the effect of outliers. Such an approach will greatly reduce the percentage of overdetection, irrespective of the degree of vector accumulation.
Concerning the validation criteria, these are most commonly based on velocity component magnitudes. These magnitudes are attributed an acceptable fluctuation level during validation (Westerweel and Scarano 2005), which is assimilated with the typical RMS level ε of 0.1 pixels in displacement data. A simple graphical representation in Fig. 2a indicates that this can lead to validation of vectors which are sufficiently different. More importantly, this disparity increases as the vector magnitude decreases (Fig. 2b) necessitating a variable background fluctuation level proportional to the vector magnitude. On the other hand, imposing such adaptive fluctuation levels ε _{ α } in the angular direction while allowing tangential fluctuations of ε shows a promising reduction in potential vector disparity (Fig. 2c–d). Such validation criteria are in line with the observation of Reiz and Pongor (2011) that human vision mainly identifies anomalies in patterns based on deviations in angle and magnitude.
Methodology
This paper addresses the problematic of over and underdetection when validating PIV and PTV data. To account for spatially varying vector densities and flow properties, an adaptive validation process with a threetiered structure is proposed (Fig. 3). The problem of underdetected outliers due to their aggregation in clusters is settled through a comparison of vectors with a variable number of neighbours based on flow coherence. Overdetection is dealt with by different improvements; an average Gaussianweighted distancebased median estimation and a revised calculation of vector discrepancy. The starting point of the latter is the local median concept (Westerweel and Scarano 2005) because of its demonstrated robustness. In the current work, the authors alter the residual calculation on the basis of vector orientation and magnitude and implement an adaptive estimation of the acceptable level of reminiscent noiseinduced velocity fluctuations. The proposed methodology thus consolidates an adaptive weighted angle and magnitude threshold and will be referred to with the abbreviation AWAMT.
Coherence adaptive neighbourhood level
To define the required number of neighbouring vectors, the authors introduce a heuristic for coherency. The authors argue that the condition for a vector to be considered coherent is its agreement with a secondorder surface fitted to its eight closest neighbours. It is important to underline that this coherence function is not used to discern correct vectors from outliers. Coherency is only used to predict the number of neighbours to be taken into account when estimating the local true flow velocity.
The choice of a quadratic surface is selected assimilating the common Qparameter to identify and visualise coherent structures (Hunt et al. 1988). Adopting the Einstein summation convention, Q values are calculated as Q = −0.5(∂u _{ i }/∂x _{ j } ∙∂u _{ j }/∂x _{ i }). Imposing a surface of the form Φ = a _{ 0 } + a _{ 1 } y + a _{ 2 } x + a _{ 3 } xy + a _{ 4 } y ^{2} + a _{ 5 } x ^{2} for the velocity components will thus ensure all Q isosurfaces to be also secondorder continuous. To minimise the influence of outliers on the parabolic regression, a diagonal matrix W is implemented containing Gaussian weights utilising the deviation σ _{ j } of each vector from the local median (including all 9 vectors) as argument; W(j + 1,j + 1) = exp(−½∙σ ^{2}_{ j } ∙κ ^{−2}_{ j } ) where j = 0…8, σ ^{2}_{ j } = (u _{ j } − u _{ m })^{2} + (\(v_{j}\) − \(v_{m}\))^{2}, u _{ m } = median(u _{ j }), \(v_{m}\) = median(\(v_{j}\)) and \(\kappa_{j} = \varepsilon + \tfrac{1}{9}\varSigma \sigma_{j}\). The coefficients of the parabolic surface fitted to the components of the nine vectors are then estimated in a leastsquares manner; a = (X ^{T} WX)^{−1}(X ^{T} W f) where a = [a _{0} a _{1} … a _{5}]^{T}, f = [(u,v)_{ j }], X = [1 y _{ j } x _{ j } x _{ j } y _{ j } y ^{2}_{ j } x ^{2}_{ j } ].
The coherence C is subsequently quantified as the average residual between the scrutinised vector’s components u _{0} and \(v_{0}\) and Φ _{ u,v } evaluated at the vector’s location (x _{0},y _{0}), normalised with the median of the vector magnitudes V _{ m } and background error ε (Westerweel and Scarano 2005);
The differentiation between coherent and noncoherent vectors is thereon done by thresholding; values of C inferior to the threshold T are classified as coherent. Although the threshold T can be adjusted to reflect the sensitivity of the number of neighbours to the size of clusters, the authors found performances to be relatively unaffected by the choice of T and a threshold of 10 % was empirically found by the authors to yield a reliable and generally robust selection criterion.
Once the coherence function has been evaluated for all the data points in the vector field, the level of neighbourhood L for each data point is progressively increased considering the neighbours of the neighbours until at least half of the basis for comparison comprises coherent vectors. Note that L as such is a spatially varying parameter. To account for vector dependency due to correlation window overlap WOR, a minimum value for L is imposed which depends on WOR; L _{min} = Round(4∙WOR). In the case of a structured grid for example, the total number of neighbours N _{ o } is readily given as N _{ o } = (2L + 3)^{2} − 1 (Fig. 4a). This stopping criterion ensures the median of an examined neighbourhood will return a reliable and coherent prediction for ensuing validation purposes since at least half the considered adjoining vectors are deemed coherent. The coherency check accordingly addresses the effects of under and overdetection in the presence of outlier clusters and is straightforward to implement in existing validation routines.
Figure 4b illustrates the outcome of the coherency test when a cluster of outliers is surrounded by coherent vectors. The local neighbourhood level gradually increases towards the centre of the cluster, as indicated by the greyscale, such that each outlier can be compared with a reliable prediction even when surrounded by outliers.
Adaptive angle and magnitude median normalised residual
While the methodology presented above will be shown to already improve standard validation processes, the authors implement two additional modifications to the traditional normalised residual calculation to further lessen the number of overdetections: (1) average Gaussianweighted median estimation and (2) comparison of direction and magnitude instead of Cartesian vector components. The underlying principle still remains consistent with common detection routines; a normalised residual is evaluated for each vector of the field based on the fluctuation of its neighbours and is used to discern correct vectors from outliers.

Averageweighted median estimation
To identify the scrutinised vector as being erroneous, a comparison is required with an adequate estimation of the true, underlying flow vector. Such a prediction is ideally based on interpolation of neighbouring vectors. Because of the fundamental sensitivity of interpolation to the presence of spurious vectors, the median offers a more robust alternative. Following the selection of an adequate neighbourhood level based on coherency, a distancebased weighting is introduced when calculating a vector prediction from the N _{ o } vectors to reflect their relative importance. While still inversely proportional with spacing d _{ i } between the central vector located at (x _{ o },y _{ o }) and those in the constrained vicinity, in the current paper the weights w _{ i } are drawn from a Gaussian functional in line with adaptive Gaussian windowing (AGW) with optimal filter width σ (Agui and Jiménez 1987);
To achieve an efficiency of the statistical estimator higher than that of the weighted median, an averaging is introduced. The resulting averageweighted median operation will be symbolised in the following by awmed(∙). The concept of this novel process is illustrated considering the velocity magnitude, i.e. awmed(V), for the situation in Fig. 5a where the central vector is adjoined by N _{ o } neighbours (here N _{ o } = 8). The N _{ o } velocity magnitudes (indicated by the vertical abscissa location of the ● symbols) are sorted in ascending order V ^{S} with the corresponding weights w ^{S}, attributed according to Eq. (2), represented by the bar widths in Fig. 5b. The weighted median (solid vertical line) is located at half the cumulative sum S _{ w,No } of the weights w ^{S} per its definition. To classify as an outlier, vectors will need a magnitude sufficiently different from this value. Such vectors will consequently have weights lying at the extremes of the set w ^{S}. Vectors with weights lying in the immediate vicinity of the weighted median on the other hand cannot constitute outliers and can thus be used for reliable interpolation. An averaging interval Δ _{ w } varying between 0 and 1 and centred on the weighted median is therefore introduced. The new, averageweighted median value is finally evaluated as the weighted average of those velocity magnitude values of which the bar widths overlap with the Δ _{ w } interval. The averaging weights λ _{ i } are then taken proportional to this amount of overlap;
where \(S_{w,i} = \sum _{j = 1}^{i} w_{j}^{S}\) and \(\lambda_{i} = \hbox{min} (\tfrac{{S_{w,i} }}{{S_{{w,N_{o} }} }}  \tfrac{{1  \varDelta_{w} }}{2},\tfrac{{w_{i}^{S} }}{{S_{{w,N_{o} }} }},\tfrac{{1 + \varDelta_{w} }}{2}  \tfrac{{S_{w,i  1} }}{{S_{{w,N_{o} }} }}).\)
Note that this averageweighted median constitutes a form of weighted AGW interpolation but with improved reliability against outliers since the considered neighbours are less likely to be outliers. A unity value of Δ _{ w } degenerates the operation into a weighted average of all neighbouring values, whereas a value of 0 yields again the weighted median. As will be demonstrated in Sect. 4, a value of Δ _{ w } = 0.3–0.5 is found to offer a generically conducive compromise between over and underdetection (Fig. 8).

Angle and magnitude validation
The single validation parameter will be the normalised residual r ^{*} combining the individual residuals r _{ α } and r _{ V } related to, respectively, a vector’s angle α and magnitude V;
where \(r_{V} = \tfrac{{V_{o}   V_{awm} }} {{{\text{median}}(V_{j}  V_{awm} ) + \varepsilon }}\), \(V_{awm} = \sqrt {awmed(u_{j} )^{2} + awmed(v_{j} )^{2} }\) and V ^{2}_{ j } = u ^{2}_{ j } + \(v_{j}^2\) with j = 1…N _{ o }
The denominator of r _{ V } invokes the standard median operator since the median norm V _{ awm } already applies a distance weighting. Parameter ε relates again to the measurement error and is indicative of the background error for the vector magnitude (ε ≈ 0.1 pixels). The normalised residual in angle is calculated in a similar manner;
The choice of α ^{*}_{ j } ensures angle differences to be smaller than π radians. Value α _{ j } is the simple arctangent of the displacement components. Angle α _{ awm } considers the averageweighted median of the individual phases to negate any bias originating from vector magnitudes;
Misdetection of outliers is addressed by automatic adaptation of the acceptable RMS level in α _{ j } to predicted vector magnitude; the minimum measurable angle is defined by the angle of the triangle formed by V _{ awm } and ε;
Once the normalised residual has been evaluated throughout the vector field, r ^{*} values below a threshold of 2 are considered nonvalid. This value is in agreement with the findings of Westerweel and Scarano (2005) and Duncan et al. (2010).

Computational effort
The selection of the adequate neighbourhood level and the evaluation of the averageweighted median can be expected to come with some computational overhead. To estimate the increase in processing time as a result of the elaborated vector validation, the evaluation of the experimental images discussed in further detail in Sect. 5 is considered. The total processing time for the porous disc recordings with AWAMT increased by a factor of 1.01 relative to the traditional NMT. Similarly, the ratio in computation time between NMT and AWAMT for the analysis of the 280 image recordings related to the supersonic jet equalled 1.05. Standalone, the proposed validation based on magnitude and angle, although strongly dependent on flow type, number of outliers and clustering factor, was approximately four times more computationally intense compared to the standard routine based on Cartesian components. The above heuristics are only exemplary and pertinent to the current test cases. Nevertheless, results imply the computational expense of the more elaborate AWAMT method to be marginal relative to the overall process and will be shown to be outweighed by the achievable improvement in measurement accuracy in the remainder of this paper.
Because of the enhanced robustness, the iterative displacement evaluation with AWAMT returns both lower absolute levels in ensemble average image disparity δ _{ I } and a faster decay with iteration number (Fig. 6). The image disparity δ _{ I } is defined as the ensembleaveraged absolute difference in image intensity between the corrected snapshots (based on the validated displacement fields obtained each step of the iterative image analysis), normalised by the maximum image intensity. Figure 6 also presents the normalised probability density in δ _{ I } for the two validation routines and shows AWAMT to be consistently assimilated with lower probabilities at higher disparities. This attests the proposed method to yield displacement fields which are more representative of the underlying distortion in particle image intensity distribution, offering the potential to speed up convergence of image analyses adopting optical flow concepts.
Numerical assessment
Evaluated test cases
In order to assess the proposed adaptive vector validation in terms of ameliorated under and overdetection ratios, deterministic velocity fields were contaminated with spurious vectors.
Three flow cases were considered: a turbulent channel flow, a cellular vortex and isotropic turbulence (Fig. 7). The first two flow fields^{Footnote 1} were obtained from the PIV Challenge website (Stanislas et al. 2001, 2003). The PIV images were analysed with an adaptive PIV algorithm (Theunissen et al. 2007). This algorithm locates and sizes correlation windows on the basis of local seeding density and velocity gradients, thus returning velocity data on an unstructured grid. Images were initially sampled with square correlation window sizes of 128 pixels and recursively refined. To enforce a very gradual reduction in interrogation window size, 20 refinement iterations were imposed to yield a minimum final window size of 15 pixels. Bias of the results towards any of the assessed outlier detection routines was avoided by manually inspecting at each intermediate iteration vector areas producing high levels of local variation. Potential outliers were accordingly replaced by the local median. The third test case consisted of readily available direct Navier–Stokes velocity data provided on a structured grid from the Johns Hopkins Turbulence Databases^{Footnote 2} (Li et al. 2008).
The vector fields were selected as to cover a wide variety of vector field characteristics (Fig. 7). Both the channel flow and vortex are characterised by spatially nonisotropic flow features. The vortex represents an isolated region of strong velocity gradients, while the turbulent channel flow portrays besides a region of circular motion a strong spatial variation in flow properties. In the outer area, the flow is quasiuniform, whereas approaching the wall the vector field becomes more turbulent with accompanying variations in both vector magnitude and direction. The isotropic turbulence case on the other hand features a spatially more uniform distribution of vector magnitudes and directions.
To simulate realistic velocity fields containing outliers, each of the three final velocity fields was corrupted with spurious vectors of prescribed characteristics. In particular, two pertinent parameters were varied in line with Shinneeb et al. (2004): outlier magnitude and clustering. When replacing a vector V _{ o } = (u _{ o },\(v_{o}\)) with a spurious element V _{ s } = (u _{ s },\(v_{s}\)), the outlier norm is defined to be at most a percentage M of the local vector magnitude. The erroneous velocity components are then calculated by multiplying the norm with a random number distributed uniformly between −1 and 1, U([−1,1]), resulting in an outlier with random direction and deviating a certain percentage in magnitude from the correct local velocity;
The clustering factor C _{ f } is defined as the number of randomly imposed neighbouring vectors, each with magnitude ratio M (Fig. 8). Clusters were distributed randomly across the vector fields. In the simulations, C _{ f } is varied between 1 and 40, where a value of one equals randomly located isolated outliers. While it can be argued that cluster sizes of 40 vectors are rare, cluster sizes in the order of 10 are commonly encountered when dealing with image regions of poor quality, low seeding or insufficient spatial resolution in regions of strong velocity gradients. Nevertheless, the extent of C _{ f } allows the detection of any asymptotic tendency. The number of imposed erroneous vectors was kept constant irrespective of C _{ f } at least 15 % the total number of vectors in accordance with good PIV practice.^{Footnote 3} Above this, critical value experimental settings would generally have to be reevaluated to possibly mitigate the amount of outliers and enhance measurement reliability.
For each outlier parameter setting, 3000 Monte Carlo simulations were performed to ensure convergence in statistical findings. Results are presented in terms of over and underdetection ratios R _{ o } and R _{ u }, respectively. Parameter R _{ o } is defined as the ratio between the number of correct vectors wrongly detected as outliers (N _{ w }) and the total number of vectors (valid and invalid) in the field N _{ t }, while R _{ u } expresses the ratio between the number of missed outliers (N _{ m }) and the imposed number of spurious vectors (N _{ i }).
In addition, the ratio between N _{ m } and N _{ t }, denoted by R ^{*}_{ u } , allows the calculation of the percentage of erroneously invalidated correct vectors (N _{ w }) with respect to either the number of correct vectors (N _{ c }) or the number of imposed outliers (N _{ i });
With the fixed percentage of imposed outliers (N _{ c } ≅ 0.85 N _{ t }), these ratios become N _{ w } /N _{ t } ≈ 1.18∙R _{ o } and N _{ w } /N _{ i } ≈ 6.67∙R _{ o }. Table 1 presents an overview of the definition of the different parameters for clarity.
Validation algorithm performance
Figure 9 presents the results of Monte Carlo simulations to illustrate the effect of Δ _{ w } in the averageweighted median on the validation performance in terms of over and underdetection. The relevant flow fields were degraded with outliers of randomness M = 5 and clustering factor of 1. Though not presented, observable tendencies remained consistent when altering either M or C _{ f }.
For small Δ _{ w }, the averageweighted median serves as a standard distanceweighted median providing a robust outlier detection criterion in terms of underdetection. Nevertheless, this approach is less efficient than interpolation. Increasing Δ _{ w } will assimilate the awmed(·) with an adaptive Gaussianweighted interpolation, utilising only vectors which are less likely to be outliers and warrant a reliable interpolation. When increasing Δ _{ w }, more vectors, including potential outliers, are again taken into account, thereby reducing the reliability of the interpolation. This renders the validation less stringent, underdetecting more vectors (Fig. 9a) yet simultaneously classifying fewer correct data values as erroneous (Fig. 9b). Detection ratios R _{ u } and R _{ o } will consequently obey opposite behaviours with varying Δ _{ w }. Figure 9 corroborates R _{ u } to increase in an exponential fashion, whereas the overdetection ratio shows a quasilinear decline. Given that the depicted tendencies are quasiflowcase independent, the authors propose a value of Δ _{ w } = 0.3–0.5 as a generally conducive compromise to minimise both the under and overdetection.
Figures 10, 11 and 12 present the under and overdetection ratios defined in Eq. (9) with varying sizes of outlier clusters for the three flow cases when fixing the magnitude ratios M, respectively, to 0.1, 1 and 10. Results of the new algorithm (AWAMT) are juxtaposed with the NMT (Westerweel and Scarano 2005) and DWNMT method (Duncan et al. 2010). To stress the importance of the adaptivity introduced in the current work, both methodologies have been extended to include the coherency test and automatically select the adequate number of neighbours in the validation process. These extended routines are annotated as ANMT and ADWNMT, respectively. Although cluster sizes C _{ f } were incremented in steps of one, data symbols are depicted sporadically to retain figure clarity.
Independent of the considered flow case, all figures substantiate the detrimental influence of outlier clusters. With growing cluster size, R _{ u } initially rises steeply up to C _{ f } = 10. Depending on the M value, for larger clusters either a quasiconstant level is reached or R _{ u } continues to grow more gradually. For the turbulent channel flow case with M = 0.1 (at C _{ f } = 10), this results in the inability to detect up to 90 % of imposed outliers with NMT or DWNMT (Fig. 10). By increasing M, the outliers’ disparity grows, facilitating their detection. Figures 10, 11 and 12 imply the overall levels of R _{ u } to decrease by roughly a factor 0.66–0.75 for every increase in order of magnitude of M. At M = 1, this still leaves 10–40 % of the individual (C _{ f } = 1) spurious vectors undetected by the NMT method, deteriorating to 40–60 % and above for clusters containing more than ten vectors.
An asymptotic behaviour with C _{ f } is also observed in the overdetection ratio R _{ o }, though strongly dependent on the flow type and randomness level. For M = 0.1, application of NMT to the isolated vortex, for example, returns a ratio N _{ w } /N _{ i } growing from 15 % at C _{ f } = 1 to 23 % at C _{ f } = 10, reaching a quasiconstant level of 20 % for larger C _{ f }. When augmenting M to 10, these ratios alter to 11, 15 and 16 %, respectively. Data related to the DNS vector field for M = 0.1 on the other hand result in N _{ w } /N _{ i } = 0.026 (C _{ f } = 1), 0.033 (C _{ f } = 10) and 0.013 (C _{ f } = 40), while ratios become negligible (less than 0.05 %) for M = 10. The observable flow dependency can be explained as follows. With exception of the central area, neighbouring vectors in the vortical flow field show a high degree of similarity. As a result, any small discrepancy can render a vector invalid leading to an elevated overdetection. Because of their inherent nature, the turbulent flows on the other hand allow slightly more variation in each vector before it is identified as spurious. Overdetection is also prominent at the edge of outlier clusters because a correct velocity estimate may seem incoherent with its nearest (spurious) neighbours as illustrated in Fig. 13. This can be demonstrated considering for simplicity a uniform horizontal velocity field with component u. The central vector will be assumed correct and to be surrounded by eight spurious neighbours of which the velocity components are defined by Eq. (8). Given that the statistical median of the random variable X ∈ U([−1,1]) equals zero and that median(X) = ½, the normalised residual following the NMT^{Footnote 4} is then given as \(r_{\text{NMT}}^{*} = (\tfrac{M}{\sqrt 8 } + \tfrac{\varepsilon }{u})^{  1}\). Adopting the common validation criterion \(r_{\text{NMT}}^{*} < 2\), the central vector consequently has a high probability of being mistakenly identified as erroneous for any value of M below \(\sqrt 2\) or when u is in the same order of magnitude as ε. This behaviour is confirmed by the observed trends of reduced R _{ o } and R _{ u } with increasing M in Fig. 14.
Adopting a distancebased weighting (DWNMT) offers an improvement in overdetection only in case of unstructured data in accordance with the findings of Duncan et al. (2010). The current figures suggest such achievements to be again strongly reliant on flow case and randomness magnitude M. The cellular vortex case, for example, indicates DWNMT to lower the overdetection R _{ o } from approximately 2.5 % with NMT to 1 % across the range of M values (Figs. 10, 11, 12). Such gains are, however, less prominent in the channel flow and of course nihil for structured DNS data. Moreover, distance weighting is observed to adversely address underdetection as related R _{ u } values are consistently higher or at least on a par with NMT, even in case of isolated spurious vectors (C _{ f } = 1).
The presented results advocate the beneficial impact when implementing an adaptive neighbourhood extent (exemplified in Fig. 13) in NMT and DWNMT. At low M, underdetection can be abated by roughly a factor 1.5; when applied to the wall turbulent flow field for example, for a cluster of ten vectors R _{ u } drops from 90 to 65 % and from 80 to 65 % in case of the DNS flow (Fig. 10). Improvements become most remarkable at higher levels of randomness where R _{ u } is lowered by at least a factor 4, from 30 to 7 % at C _{ f } = 10 and M = 10 for the channel flow and from 20 to 4 % for the DNS case (Fig. 12). Betterment is also achieved in R _{ o } as a result of the added adaptivity, though the relative improvement drops with higher M values. Irrespective of cluster size, coherency adaptivity lowers the NMTrelated R _{ o } level. At M = 1 for example by 0.1 % for the vortex field and 0.01 % for the channel flow, whereas for M = 0.1 the differences in the vortex flow amount to 1 % when C _{ f } = 5 and 0.3 % when C _{ f } = 40. Maintaining a constant cluster size of eight vectors and varying the outlier randomness further corroborates the neighbourhood adaptivity to attain under and overdetection levels sufficiently below those of the standard approaches (Fig. 14). Underdetection ratios of traditional validation routines asymptotically reach values of 20 % with increasing M compared to levels approaching 0 % when implementing adaptivity. For the case of the isolated vortex, NMT retains 2 % overdetection, whereas the original and extended DWNMT and AWAMT reach levels below 0.8 %. This is an important finding as it implies traditional validation routines are, contrary to those enhanced with adaptivity, unable to identify all spurious vectors within the cluster, independent of their magnitude. While appreciable gains can be achieved in R _{ u }, all validation methods reach comparable asymptotic values in overdetection when applied to more turbulent flows.
Validation on the basis of residuals in magnitude and orientation allows the AWAMT approach proposed within this work to further reduce over and underdetections. As per the simplistic mathematical model discussed afore, potential advantages will be particularly noticeable at lower M and displacement magnitudes in the order of one pixel or below. Figure 10 advocates the adaptation of the background fluctuation level in vector phase to its magnitude to offer noticeable improvements particularly at M = 0.1. Across the various flow fields, AWAMT consistently yields the lowest R _{ u } and R _{ o } levels compared to the standard and enhanced median threshold techniques. Underdetection levels are overall lessened by roughly 10 % compared to the improved ANMT and ADWNMT. Changes in R _{ o } are flow dependent but vary between 0.15 and 0.3 %. With increasing M, relative improvements obtained by adding the magnitude and angle validation diminish compared to the benefit of purely a varying neighbourhood.
To summarise, the performed assessment has shown the traditional NMT and DWNMT to be highly sensitive to the presence of outlier clusters especially in terms of underdetection. Although overdetection is prominent in the vicinity of such clusters, it is strongly dependent on the local level of velocity fluctuation and lowers as randomness increases. By adapting the considered neighbourhood level to local flow coherency, underdetection can be improved considerably in the case of large outlier clusters and strong spatial velocity variations, while gains in overdetection are most noticeable with smaller displacements. Further improvements in under and overdetection are achieved by adapting the validation process to consider vector magnitude and orientation, whereby ameliorations are particularly noticeable in case of smaller displacements. Incorporation of an adaptive weighted angle and magnitude threshold in the vector validation process is subsequently expected to be most beneficial to reduce under and overdetection in turbulent flows, flows containing strong velocity gradients, image sequences with small particle image displacements and image recordings of lower quality which would give rise to outlier clusters. This will be confirmed by the experimental assessment in the following section.
Experimental application
Vector validation can have a strong influence on the outcome of a PIV analysis. Because of its iterative nature, the influence of nondetected spurious vectors or incorrectly replaced velocities is propagated into the image deformation stage with associated consequences. To assess the new vector validation algorithm in a real application, the adaptive routine has been applied to experimental PIV images of the nearwake flow behind a porous disc and overexpanded supersonic jet and compared with the conventional NMT technique.
Porous disc
Measurements were taken behind a circular disc placed in the low turbulence wind tunnel of the University of Bristol. This tunnel attains turbulence levels below 0.05 % and has an octagonal test section of 0.8 m × 0.6 m. Four 3mmdiameter piano wires held the disc in place, which was subjected to a freestream velocity U _{ fs } of 30 m/s impinging perpendicular to the frontal surface. The disc had a thickness of 6 mm and a diameter D _{disc} of 6 cm resulting in a negligible blockage of 0.16 % at a diameterbased Reynolds number Re _{ D } of 11.6 × 10^{4}. Six perforations, each with a radius r _{ p } of 3.87 mm (r _{ p } ≈ 0.065∙D_{disc}), were located at a radius r _{ a } of 1.08 cm to establish a porosity β (=open/closed area) of 0.11 (Fig. 15a).
PIV measurements were taken with a 2D2C Dantec Dynamics PIV system. Seeding was generated by atomising a mixture of PEG80 and water producing 1μm tracer particles. Illumination was provided by a Litron 200 mJ laser with a repetition rate of 15 Hz. An optical arrangement of cylindrical and spherical lenses transformed the laser beam into a 1mmthick laser sheet positioned along the centre of two pores. Images were recorded with a Speedsense M340 camera. A 75mm focal length lens with fstop set at 16 was utilised, producing particle image diameters of approximately 2–3 pixels. The CMOS sensor consisted of 10 μm pixels arranged in a 2560 × 1600 array. With a calibration factor of 15.5 pixels/mm, the corresponding field of view covered approximately 2.75 disc diameters downstream and 1.72∙D_{disc} in vertical direction. The separation between laser pulses was set at 40 μs, producing a maximum particle image displacement of approximately 20 pixels at the pores. An exemplary image snapshot is depicted in Fig. 15b.
In total, 500 image recordings were analysed with a standard PIV processing routine incorporating iterative correlation window size reduction (Scarano and Riethmuller 2000) and image deformation using quintic Bspline interpolation (Astarita and Cardone 2005). Correlation windows were reduced in four iterations to final sizes of 37 × 37pixels^{2} (~2.4 mm × 2.4 mm) with an overlap of 50 % resulting in a structured vector field with approximately 1.2mm grid spacing. Every iteration, the obtained vector field was subjected to validation utilising either the universal outlier method (NMT) or the newly proposed adaptive weighted angle and magnitude threshold technique (AWAMT). Invalidated vectors were subsequently replaced with the median of the eight closest neighbours.
The undersampled ensembleaveraged flow field behind the porous disc is detailed in Fig. 16 and shows complex flow features. Flow with momentum higher than the freestream is ejected from the pores and interacts with the outer shear layers to create zones of recirculating flow on the upper and lower part of the disc. Between approximately 1.2∙D_{disc} and 2∙D_{disc}, a large zone of reverse flow appears. This region is formed by the merging of the outer shear layers, forging two stagnation points along the centreline at the zone edges. In addition, two outward vortices are present within the reverse flow zone. The near wake pushes the freestream outwards similar to the bluff body wake behind solid discs (Kalra and Uhlherr 1971) which merges again at approximately 2.5∙D_{disc} downstream initiating wake recovery. It should be noted that such features are only present in the time average. From an instantaneous perspective, the jets display a flapping behaviour, giving rise to the appearance of the multiple stagnation points in the ensemble average. This flapping is in reaction to the vortex shedding from the disc which takes place at random locations along the circumference (Miau et al. 1997). The flapping in addition gives rise to mobile zones of turbulence and accompanying velocity gradients, making the flow a challenging test case for vector validation.
Figure 17 juxtaposes contour maps quantifying the percentage of replaced vectors in the final iteration, R = R _{ o } + R ^{*}_{ u } , by the NMT and AWAMT method across the image ensemble. Since outliers are replaced, this quantity R is indicative of the vector validation performance in detecting outliers. The detrimental effect of laser reflections can be observed in the vicinity of the disc for both validation methods. Throughout, the authors have argued that existing vector validation routines are susceptible to overdetection in regions of higher turbulence intensity. Figure 17 attests especially the bounding shear layers of the disc and jets, and jet interaction region to be attributed a higher percentage of outliers compared to the bulk. However, Fig. 17 also demonstrates the AWAMT approach to consistently detect fewer outliers in these regions compared to NMT. This supports the Monte Carlo simulations which indicated AWAMT to abate the number of undetected outliers and lower the number of overdetections. In the shear layers of the jets exiting from the perforations for example, NMT invalidates 60 % of the vectors compared to 30 % by AWAMT. In the outer shear layers, AWAMT lowers the number of replaced outliers on average from 30 to 15 %.
The advantage of coherence adaptivity in terms of measurement accuracy is highlighted in Figs. 18 and 19 where ensembleaveraged profiles in horizontal velocity and longitudinal turbulence obtained with NMT, ANMT and AWAMT are juxtaposed. Despite the higher uncertainty in secondorder statistics as a result of the limited number of velocity fields, tendencies in differences between the validation methods will prevail and can be used to qualitatively assess performances. While velocity profiles at x/D _{disc} = 0.2 are on a par in the regions y/D _{disc} < 0.1 and y/D _{disc} > 0.25, a larger disparity between the validation methodologies can be observed in jet centreline velocities. Whereas ANMT and AWAMT yield a peak velocity ratio of approximately 1.05 and 1.1, respectively, NMT predicts a ratio of approximately 0.8. The observed modulation in jet velocity thus shows a strong correlation with R as the inherent vector reinterpolation will introduce a smoothening effect. The coherence adaptivity in ANMT and AWAMT reduces overdetection and limits the assimilated modulation, corroborating the importance of the proposed adaptivity process. Travelling downstream, the two pore jets increase in width and the centrelines arc inwards to merge at x/D _{disc} = 0.7 similar to welldocumented parallel jet theory (Anderson and Spall 2001). Velocity gradients gradually reduce in strength and validation based on vector magnitude and direction becomes less stringent, causing ANMT and AWAMT to attain nigh equal results. An underestimation of the jet centreline velocity obtained with NMT remains noticeable; 0.64 for AWAMT and ANMT compared to 0.61 with NMT at x/D _{disc} ≈ 0.7.
To provide an estimate of the underlying true flow field, PIV data extracted along y/D _{disc} = 0.18 are superimposed with results obtained from a twocomponent Dantec Dynamics Laser Doppler Anemometry (LDA) system operating in crossed beam mode (Fig. 18b). The LDA measurement volume extended approximately 0.17 mm (~0.0028∙D_{disc}) in streamwise normal direction providing spatially highly resolved measurement data. Because of the inherent beam alignment measurements closest to the disc were restricted to 0.3 disc diameters. Velocity samples were spaced approximately 0.017∙D _{disc} up to 1.3 diameters downstream. At each measurement, location velocity statistics were evaluated on the basis of typically 6000 instantaneous samples sampled at 4 kHz from which the depicted error bars at 95 % confidence level were inferred. Error bars for PIV data are not depicted in the figures as they scale directly with the LDA data by a factor \(\sqrt {12}\), which is based on the number of independent data samples.
The observable tendency in LDA data confirms velocity exiting from the pores can surpass the freestream condition, suggesting the holes to act as contractions. Towards the disc, the magnitude of the average LDA horizontal velocity component is seen to exceed the PIV data which is caused by the bias of the PIV data towards lower velocities. In vertical direction, the flow emitted from the pore decreases from nearly freestream conditions to reverse flow over approximately half the pore diameter, equating to a velocity gradient du/dy ~ 0.37 pixels/pixel. It is well known that such magnitudes in velocity gradient are challenging for any PIV image analysis (Westerweel 2008) and velocities will be biased towards lower values as supported by the observations. Given its small interrogation volume and by weighting velocity data by the corresponding transit times, LDA velocity data will suffer to a much lesser extent from such a bias (Gould and Loseke 1993). As substantiated by Fig. 18, in the region 0.3 ≤ x/D _{disc} < 0.9 where R _{NMT} > R _{AWAMT}, NMT yields the lowest velocity values in comparison with AWAMT, advocating the improved accuracy of the latter. Incorporating coherence adaptivity clearly enhances the accuracy of the ensemble average velocity data (cf. ANMT vs. NMT), which can be further ameliorated by means of validation based on velocity magnitude and direction (cf. AWAMT vs. ANMT). Beyond 0.9 disc diameters, differences in the percentage of replaced vectors by the two methods become smaller and all validation methods return velocity data coinciding with LDA data.
The smoothening inherent to vector replacement can also be used to explain the smaller amplitudes in longitudinal fluctuations obtained with NMT as opposed to ANMT and AWAMT (Fig. 19a). Differences in root mean square value of the streamwise velocity tend to persist further downstream as opposed to the velocity magnitude and are still visible at x/D _{disc} = 1.5. Nearer to the disc, at x/D _{disc} = 0.2, the turbulence levels predicted with NMT surmount those of AWAMT and ANMT. However, LDA data corroborate these lower levels of AWAMT in Fig. 19b, further substantiating the conduciveness of the proposed validation criteria in AWAMT. Despite heightened uncertainty, AWAMT and ANMT also show to capture the higher levels in longitudinal turbulence measured with LDA between 0.5∙D _{disc} and 1.1∙D _{disc} (Fig. 19b). It should be noted that turbulence intensity profiles are expected to reveal a bimodal shape near every jet pore (Lin and Sheu 1990), with peaks separated by approximately 0.6–0.7 jet half widths. Because the latter equals the pore radius in close vicinity of the disc (Tanaka 1970), the presently adopted interrogation window size of 37 pixels, W _{ S } /r _{ p } ≈ 0.62, offered insufficient spatial resolution to fully resolve the turbulence intensity distribution across the jet. Nevertheless, whereas the bimodal shape is reminiscent in the AWAMT and ANMT data (Fig. 19a), only a single apex is obtained with NMT. On the basis of the improved accordance with LDA data, this example has demonstrated the potential gain in accuracy of PIV data and therefore implies the importance of the vector validation process within iterative image analyses in case of turbulent flows.
Overexpanded supersonic jet
Experiments were conducted at the von Karman Institute for Fluid Dynamics, Brussels. The supersonic overexpanded jet flow was issued from a conical nozzle with exit diameter D _{noz} of 17.3 mm and throat diameter of 5.85 mm. A pressure ratio between stagnation chamber and ambient of 25 was imposed, producing an exit velocity U _{jet} of approximately 633 m/s equivalent to a maximum displacement of about 9.5 pixels. At a corrected Mach number of 3.33, normal shock relations predict a velocity of 153.4 m/s (≈2.3 pixels) downstream of the first normal shock at the nozzle exit (u/U _{jet} ≈ 0.24). Submicron oil tracer particles issued from a Laskin nozzle were injected upstream of the nozzle. The flow was illuminated in a light sheet of 0.5 mm thickness by a Nd:Yag laser pulsed at 0.5 μs. A 12bit PCO digital camera captured a field of view of approximately 4 × 2 cm^{2} covered by a sensor area of 1280 × 544 pixels^{2}, equating to a conversion factor of 34 μm/pixel. Details regarding the experimental campaign can be found in Jerónimo et al. (2002). A total of 280 PIV image pairs were analysed with the same interrogation algorithm as described in the porous disc case adopting final square correlation windows of size W _{ S } /D _{noz} ≈ 0.037 and 50 % mutual overlap.
The characteristic shock cell patterns of the overexpanded jet, which are visible in the average velocity field (Fig. 20b), are emphasised by strong gradients in seeding density as illustrated in Fig. 20a, enabling the first normal shock to be easily discerned. The image recording further reveals the absence of seeding in the outer jet areas near the nozzle exit and the presence of turbulent mixing layers. Moreover, sliplines emanating from the intersection points of oblique shocks with the Mach disc (Yüceil et al. 2000) are visible as regions of lower density. These shear layers grow and merge at the jet’s centreline to develop a turbulent wake (Love et al. 1959). The presence of both inhomogeneous seeding concentrations and rapid changes in flow scales makes this flow field susceptible to overdetection and constitutes a challenging test case for vector validation.
Comparison of the percentage of replaced vectors R in Fig. 21 reveals the traditional NMT approach to replace a higher number of vectors (~30 %) in the vicinity of the normal shock (x/D _{noz} ≈ 0.25) compared to AWAMT (R _{AWAMT} ≈ 10 %). This tendency can be observed to continue along the central sliplines. The outer turbulent shear layers are also susceptible to a slightly higher probability of vector replacement with NMT due to the velocity gradients. On the other hand, NMT arguably invalidates less vectors in the regions of very low seeding density (x/D _{noz} ≤ 0.75, y/D _{noz} ≈ 0.5) where unreliable correlation can be expected, whereas AWAMT correctly invalidates a higher percentage of vectors.
The detrimental effects of overdetection are again noticeable when juxtaposing profiles of ensemble statistics in horizontal velocity magnitude (Fig. 22) and turbulence intensity (Fig. 23). Near the nozzle (x/D _{noz} = 0.1), differences between NMT, ANMT and AWAMT in terms of streamwise velocity are negligible within the potential core of the jet but become apparent in the outer, poorly seeded regions. The outer regions are nevertheless attributed heightened RMS levels as vectors, even when reinterpolated, remain unreliable in this region (Fig. 23). It should be noted that presented quantitative data in terms of higher order statistics are associated with larger uncertainty due to the small number of flow fields. This does not, however, endanger their potential to evaluate comparative performances of the assessed validation methods. The profile positioned at x/D _{noz} = 0.28 is slightly behind the normal shock. Jerónimo et al. (2002) estimated the amplitude of the normal shock’s average longitudinal oscillation Δx caused by the interaction between the turbulent boundary layer and oblique shocks to be in the order of 1 mm (Δx/D _{noz} ~ 0.06). In this area, NMT replaces about 30 % of the vectors. Given the nominal stepwise variation in velocity across the shock, replaced velocities will thus tend towards either higher or lower values. This is evidenced by the corresponding probability density functions (Fig. 23b). The bimodal probability density function (pdf) relevant to NMT shows elevated probabilities at u/U _{jet} ≈ 0.3 and u/U _{jet} ≈ 0.6, whereas AWAMT allows more variety in the retrieved velocity data. Although not depicted, the distribution in horizontal velocity obtained with ANMT is nearly identical to AWAMT, explaining the agreement between the two approaches in terms of mean and turbulence statistics. The inherent velocity bias with NMT artificially introduces a higher longitudinal turbulence level which is visible in the turbulence profile at the corresponding spatial location (Fig. 23a). At x/D _{noz} = 0.48, the extraction line crosses the turbulent sliplines. Because of the validation utilising coherency heuristics in AWAMT and ANMT, less vectors are incorrectly identified as outliers, minimising any induced smoothening contrary to the lower turbulence levels obtained with NMT (Fig. 22a). This is in line with the findings for the porous disc. The advantage of the alternative validation process is further evidenced in Fig. 23a by the elevated fluctuation levels in the outer shear layers, which at this downstream position start to become properly seeded. More importantly, NMT hinders accurate retrieval of the evolution in centreline velocity across the shock. Figure 22b reveals choosing a more conducive vector validation process is capable of reducing the associated modulation in velocity jump; u/U _{jet} = 0.38 with NMT and u/U _{jet} = 0.37 with AWAMT versus the theoretical value of u/U _{jet} = 0.24. A difference between AWAMT and ANMT is also noticeable with the latter yielding a u/U _{jet} = 0.375. The figure also shows that by incorrectly replacing more vectors along the turbulent slipline (cf. Fig. 21), and NMT predicts a faster velocity recovery. Further downstream differences between the validation methods become negligible in terms of vector replacement equating their performances relevant to velocity statistics.
Conclusions
Velocity fields obtained from PIV image analysis techniques are always contaminated with erroneous vectors, and such outliers often appear in clusters as a result of underlying degraded image quality or strong gradients in flow velocity. Existing validation methodologies for instantaneous PIV velocity fields are commonly based on comparison of the scrutinised vector with its immediate neighbourhood. As a result, such methods are unable to detect false vectors when clustered and are moreover prone to mistakenly invalidate correct vectors. For this reason, a novel adaptive method for outlier detection has been proposed in this paper with the aim to render validation processes more robust in the presence of outlier clusters. The detection of false vectors will thereby be improved and overdetection can be reduced without the need to finetune inherent parameters.
The proposed method emulates the process of outlier detection in human vision whereby the considered neighbourhood for comparison is a priori extended until the database is sufficiently reliable for posterior validation tasks. Selection of the appropriate vicinity is dictated by a measure of coherency. The latter is quantified as the discrepancy between local velocity values and a parabolic regression. For each vector, the neighbourhood is automatically enlarged until at least half the enclosed vectors are coherent. To further improve the validation algorithm, vector comparison is performed on the basis of magnitude and direction instead of the traditional horizontal and vertical vector components. To limit the potential diversity in vector direction, the acceptable background fluctuation level is automatically adjusted to the vector magnitude and constitutes a second feature of adaptivity. Moreover, applicability to both structured and unstructured data grids is ensured by the implementation of a distancebased Gaussian weighting system.
The algorithm has been assessed with Monte Carlo simulations using three flow fields: an isolated vortex, a turbulent channel flow and a DNS simulation of isotropic turbulence. Flow fields were contaminated with outliers of varying magnitude and degree of clustering. The common outlier detection schemes resulted in high numbers of undetected outliers and number of wrongly invalidated correct vectors. Depending on the amount of clustering and outlier magnitude as much as 80 % of the spurious vectors could remain undetected, while 3 % of the total vectors could be overdetected. Implementation of the coherency adaptivity dramatically improved the outlier detection, potentially reducing the underdetection by as much as onefourth for small outlier magnitudes or even onetenth for larger magnitudes. These findings advocate coherency adaptivity to be a powerful tool to improve the performance of existing validation routines even in the presence of outlier clusters. The concept is computationally simple and implementation is straightforward, even in established validation routines. Validation on the basis of angle and magnitude enabled a further lowering of the missed outliers and mistaken outliers especially in case of lower displacement magnitudes. Overall, the proposed validation method proved to be the most robust and general without any reliance on userdefined parameters. Related validation performances consistently surpassed the traditional routines and were better or at least on a par with the adaptivity enhanced conventional methodologies.
When implemented in a standard PIV image analysis process and applied to experimental PIV images of a porous disc’s nearwake and overexpanded supersonic jet, the proposed outlier detection routine was shown to be capable of identifying more erroneous vectors (improved underdetection). As a consequence of the adaptive validation in terms of velocity magnitude and direction, overdetection was simultaneously reduced in turbulent flow regions. When incorporating the presented validation method, PIV data were in better agreement with LDA measurements and theoretical analyses, proving its ability to ameliorate the measurement accuracy and resolution.
Notes
Timeresolved channel flow: 3rd PIV Challenge, Case B, Synthetic images. Strong vortex: 1st PIV challenge, Case A, Experimental images.
Dataset isotropic1024coarse: xrange 1.1781–1.5650, yrange 1.1781–1.5650, zoffset: 0.0055, time: 1.9013.
The integer number of clusters for a given C _{ f } is such that the number of outliers N _{ i } amounts to at least 15 % of the total number of vectors N _{ t }; N _{ i } = ceil(0.15∙N _{ t } ∙C ^{−1}_{ f } )∙C _{ f }. This may lead to variations in N _{ i } depending on C _{ f } and N _{ t }. These variations are visible as oscillations in the obtained results (e.g. Fig. 10).
u _{ i } = M∙u∙X/2^{½}, median(u _{ i }) = M∙u/2^{½}∙median(X) = 0, median(u _{ i } − 0) = median(M∙u∙X/2^{½}) = M∙u/2^{½}∙½.
References
Aguí JC, Jiménez J (1987) On the performance of particle tracking. J Fluid Mech 185:447–468
Anderson E, Spall R (2001) Experimental and numerical investigation of twodimensional parallel jets. J Fluids Eng 123:401–406
Astarita T, Cardone G (2005) Analysis of interpolation schemes for image deformation methods in PIV. Exp Fluids 38:233–243
Duncan J, Dabiri D, Hove J, Gharib M (2010) Universal outlier detection for particle image velocimetry (PIV) and particle tracking velocimetry (PTV) data. Meas Sci Technol 21:057002
Etabari A, Vlachos PP (2005) Improvements on the accuracy of derivative estimation from DPIV velocity measurements. Exp Fluids 39:1040–1050
Garcia D (2011) A fast allinone method for automated postprocessing of PIV data. Exp Fluids 50:1247–1259
Gould RD, Loseke WK (1993) A comparison of four velocity bias correction techniques in Laser Doppler Velocimetry. J Fluids Eng 115(3):508–514
Griffin J, Schultz T, Holman R, Ukeiley L, Cattafesta L (2010) Application of multivariate outlier detection to fluid velocity measurements. Exp Fluids 49:305–317
Hunt JCR, Wray AA, Moin P (1988) Eddies, streams, and convergence zones in turbulent flows. In: Proceedings of the summer program 1988, Center for Turbulence Research
Jerónimo A, Riethmuller ML, Chazot O (2002) PIV application to Mach 3.75 overexpanded jet. In: Proceedings 11th international symposium on application of laser techniques to fluid mechanics, Lisbon, Portugal
Kalra TR, Uhlherr PHT (1971) Properties of bluff body wakes. In: 4th Australasian conference on hydraulics and fluid mechanics, Melbourne, Australia
Keane RD, Adrian RJ (1992) Theory of crosscorrelation analysis of PIV images. Appl Sci Res 49:191–215
Lecuona A, Nogueira J, Rodríguez PA (2002) Data validation, interpolation and signal to noise increase in iterative PIV methods. In: Proceedings of the 11th international symposium on applications of laser techniques to fluid mechanics, Lisbon, Portugal
Li Y, Perlman E, Wan M, Yang Y, Burns R, Meneveau C, Burns R, Chen S, Szalay A, Eyink G (2008) A public turbulence database cluster and applications to study Lagrangian evolution of velocity increments in turbulence. J Turbul 9:31
Liang DF, Jiang CB, Li YL (2003) Cellular neural network to detect spurious vectors in PIV data Exp. Fluids 34:52–62
Lin YF, Sheu MJ (1990) Investigation of two parallel unventilated jets. Exp Fluids 10:17–22
Love ES, Grigsby CE, Lee LP, Woodling MJ (1959) Experimental and theoretical studies of axisymmetric free jets. NASA Technical report R6
Miau JJ, Leu TS, Liu TW, Chou JH (1997) On vortex shedding behind a circular disk. Exp Fluids 23:225–233
Nogueira J, Lecuona A, Rodríguez PA (1997) Data validation, false vectors correction and derived magnitudes calculation on PIV data. Meas Sci Technol 8:1493–1501
Raben SG, Charonko JJ, Vlachos PP (2012) Adaptive gappy proper orthogonal decomposition for particle image velocimetry data reconstruction. Meas Sci Technol 23:025303
Raffel M, Leitl B, Kompenhans J (1992) Data validation for particle image velocimetry. In: Proceedings of the 6th international symposium on application of laser techniques to fluid mechanics. Lisbon, Portugal
Raiola M, Discetti S, Ianiro A (2015) On PIV random error minimization with optimal PODbased loworder reconstruction. Exp Fluids 56:75
Reiz B, Pongor S (2011) Psychologically inspired, rulebased outlier detection in noisy data. In: Proceedings 13th international symposium on symbolic and numeric algorithms for scientific computing, Timisoara, Romania
Scarano F (2004) A superresolution particle image velocimetry interrogation approach by means of velocity second derivatives correlation. Meas Sci Technol 15:475
Scarano F, Riethmuller ML (2000) Advances in iterative multigrid PIV image processing. Exp Fluids 29:S51–S60
Sciacchitano A, Dwight RP, Scarano F (2012) Navierstokes simulations in gappy PIV data. Exp Fluids 53(5):1421–1435
Shinneeb AM, Bugg JD, Balachandar R (2004) Variable threshold outlier identification in PIV data. Meas Sci Technol 15:1722–1732
Song X, Yamamoto F, Iguchi M, Murai Y (1999) A new tracking algorithm of PIV and removal of spurious vectors using Delaunay tessellation. Exp Fluids 26:371–380
Stanislas M, Okamoto K, Kaehler CJ (2001) Main results of the first international PIV challenge. Meas Sci Technol 14:R63–R89
Stanislas M, Okamoto K, Kaehler CJ, Westerweel J (2003) Main results of the second international PIV challenge. Exp Fluids 39:170–191
Tanaka E (1970) The interference of two dimensional parallel jets: 1st report, experiments on a dual jet. Bull JSME 13(56):272–280
Theunissen R, Scarano F, Riethmuller ML (2007) An adaptive sampling and windowing interrogation method in PIV. Meas Sci Technol 18:275–287
Wang H, Gao Q, Feng L, Wei R, Wang J (2015) Proper orthogonal decomposition based outlier correction for PIV data. Exp Fluids 56:43
Westerweel J (1994) Efficient detection of spurious vectors in particle image velocimetry data. Exp Fluids 16:236–247
Westerweel J (2008) On velocity gradients in PIV interrogation. Exp Fluids 44:831–842
Westerweel J, Scarano F (2005) Universal outlier detection for PIV data. Exp Fluids 39:1096–1100
Young CN, Johnson DA, Weckman EJ (2004) A modelbased validation framework for PIV and PTV. Exp Fluids 36:23–25
Yüceil KB, Ötügen MG, Arik E (2000) Underexpanded sonic jets: a PIV study. In: 10th international symposium on application of laser techniques to fluid mechanics, Lisbon, Portugal
Acknowledgments
This work has been funded by the UK’s Engineering and Physical Sciences Research Council (EPSRC  EP/L010755/1). The authors greatly appreciate their support.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
About this article
Cite this article
Masullo, A., Theunissen, R. Adaptive vector validation in image velocimetry to minimise the influence of outlier clusters. Exp Fluids 57, 33 (2016). https://doi.org/10.1007/s0034801521108
Received:
Revised:
Accepted:
Published:
DOI: https://doi.org/10.1007/s0034801521108
Keywords
 Particle Image Velocimetry
 Outlier Detection
 Laser Doppler Anemometry
 Vector Magnitude
 Particle Image Velocimetry Data