Abstract
Realistic renderings of materials with complex optical properties, such as goniochromatism and nondiffuse reflection, are difficult to achieve. In the context of the print and packaging industries, accurate visualisation of the complex appearance of such materials is a challenge, both for communication and quality control. In this paper, we characterise the bidirectional reflectance of two homogeneous print samples displaying complex optical properties. We demonstrate that inplane retroreflective measurements from a single input photograph, along with genetic algorithmbased BRDF fitting, allow to estimate an optimal set of parameters for reflectance models, to use for rendering. While such a minimal set of measurements enables visually satisfactory renderings of the measured materials, we show that a few additional photographs lead to more accurate results, in particular, for samples with goniochromatic appearance.
1 Introduction
Materials like nondiffuse metallic paints, varnish coatings, and effect paints have complex optical properties that produce fascinating appearance in manufactured products. Metallic paints contain metal flakes, causing the incident light to be specularly reflected. Effect paints are made using thin metal oxide layers on transparent mica platelets [28] and contain pearlescent pigments. The multilayered structure of pearlescent pigments helps increasing changes in visual appearance of a material, with respect to the incident and viewing directions [28], including angledependent spectral reflectance [22]. These materials, often referred as “goniochromatic” [32], are commonly used in the print and packaging industry.
Such materials are produced using different printing techniques (e.g. offset, gravure, screen printing [22]) and contribute to some of the main challenges in the printing line, including:

1.
performing fast and easy process control measurements;

2.
synthetically reproduce and match visual properties of packaging materials for customer approval and quality control;

3.
communicate material appearance across production and quality control departments in a print production line.
To characterise and communicate the visual appearance properties of goniochromatic print and packaging materials during print production, typically bidirectional reflectance distribution function (BRDF) measurements are required [10, 32]. Commercially available devices, such as multiangle spectrophotometers and goniospectrophotometers, could be used to perform such bidirectional measurements [22]. However, such devices prove to be slow and relatively expensive, therefore not suited for inline measurements in the production process.
Imagebased measurements [14] could represent an efficient, fast, and a practical method to accurately estimate bidirectional reflectance, also in the context of the print and packaging industries, able to satisfy the needs of control and inline quality evaluation. Furthermore, backscattering measurements often provide enough information to analytically characterise the reflectance properties of a given material [1, 16, 17], whereas additional measurements can be used to improve the initial estimates [9].
Building upon the above, in this paper we estimate the BRDF of print samples using a small set of salient measurements taken with a simple, lowcost imagebased setup, easy to integrate in inline quality evaluation for print and packaging industries. These measurements are used to estimate the optimal set of parameters of a commonly used BRDF model [26], by means of a genetic algorithm (GA)based BRDF fitting method. We demonstrate that even for print samples showing goniochromatic optical properties, typically challenging to capture, we are able to obtain visually satisfactory renderings.
The main contributions of this paper are:

1.
the use of common BRDF models to faithfully represent the appearance of nondiffuse, goniochromatic print samples described in this paper;

2.
the use of retroreflective inplane measurements as a key to successfully represent the appearance of nondiffuse packaging print samples;

3.
a GA BRDF fitting method, rather than the commonly used Nelder–Mead downhill simplex algorithm, to obtain the optimal set of BRDF model parameters.
Along with the print samples, we use an additional nondiffuse sample, “Blue Metallic Paint” (BMP), from the MERL dataset [30]. The BMP material is used to assess the performance of inplane BRDF measurements to faithfully represent the appearance of materials with visual characteristics comparable to the print samples measured, as opposite to a full measurement dataset. Figure 1 demonstrates the results achievable with our setup and approach, showing some renderings of the materials used in our study, fitted using our GA method. Finally, we compare measurements taken using our setup with the ones of a commercially available goniospectrophotometer.
2 Background and related work
The reflectance properties of a homogeneous, opaque material can be described using the BRDF, defined by Nicodemus et al. [37] as
In Eq. (1), \(\mathbf {l}\) and \(\mathbf {v}\) are incident and viewing direction unit vectors, \(E_\mathrm{i}\) is incident spectral irradiance, \(L_\mathrm{i}\) is incident spectral radiance (flux per unit area, per unit solid angle (\(\omega _\mathrm{i}\))), \(L_\mathrm{r}\) is the reflected spectral radiance and d is the differential. The unit of a BRDF is inverse steradian [1/sr]. There exist a variety of possible designs for BRDF measurement setups [14]; measured data can be left in tabular form, or represented in a compact way by means of BRDF models, either phenomenological or physically based, depending upon the specific needs of the application. In the remainder of this section, we discuss related work on BRDF measurement and models. For a comprehensive survey on the taxonomy of BRDF measurement setups and reflectance models, we refer the reader to the work by Guarnera et al. [14].
2.1 Imagebased BRDF measurement setups
A number of imagebased measurement setups, making use of one or more cameras as sensors, have been proposed [27, 29, 31, 35, 38, 47, 51], since they allow to perform bidirectional measurements in a fast and relatively inexpensive way. Ngan et al. [35] presented an imagebased measurements to measure anisotropic materials like velvet by wrapping it around a cylinder in different orientations. A conceptually similar setup was used in [44] to investigate the suitability of imagebased measurements to estimate the reflectance of isotropic packaging materials, represented using two wellknown reflectance models (Cook–Torrance [7] and Ward [50]). Three flexible packaging materials, with different optical properties ranging from fairly diffuse to goniochromatic, were measured using both their setup and a goniospectrophotometer; both their setup and the goniospectrophotometer cannot measure retroreflectance. For BRDF fitting, the Nelder–Mead downhill simplex algorithm [34] was used, driven by a RMSbased error cost function. Their results show a large relative error, in particular, for the goniochromatic print sample, due to the optimisation algorithm often converging to local minima. In [44], both BRDF models used have 3 free parameters (enforced in the Cook–Torrance model by replacing the Fresnel term with a constant). Phenomenological and physically based models with a higher, yet reasonable amount of free parameters, could provide better generalisation properties for packaging materials.
An important line of research is related to defining the number of measurements needed, that is, finding an optimal and minimal number of acquisitions to represent a material [38]. Xu et al. [51] demonstrated that two imagebased measurements can suffice to estimate a BRDF, under the assumption that the reflectance lies in the subspace spanned by the MERL dataset. Their measurement setup used a single nearfield fixed camera with multiple lighting directions enabling a simple and fast acquisition method. The need for reducing the number of acquisitions is not limited to BRDF acquisition, with more complex reflectance representations, such as BSSRDFs, presenting additional challenges [13].
2.2 BRDF models
The Lafortune model [24] is a generalisation to multiple steerable lobes of cosine lobebased models, such as Phong [40]. The generalisation is achieved using a \(3\times 3\) matrix, in which the direction vectors are defined to a fixed local coordinate system with respect to the surface normal. For a single specular lobe, the Lafortune model can be written as:
In the above, \(\rho _\mathrm{d}\) and \(\rho _\mathrm{s}\) are, respectively, the diffuse and specular albedo, while \(C_x\), \(C_y\), \(C_z\), and \(\alpha \) controls the shape and orientation of the specular lobe, retroreflection (with \(C_x\), \(C_y\), \(C_z\) as positive), and anisotropy (with \(C_x\ne C_y\)). \(l_{x,y,z}\) and \(v_{x,y,z}\) are direction components of the incident (\(\mathbf {l}\)) and viewing (\(\mathbf {v}\)) direction vectors. Given the six free parameters per lobe, the Lafortune model is potentially more versatile than the Ward model, thanks also to the possibility of emulating the Fresnel effect by using an additional lobe with increasing intensity towards grazing angles. Therefore, it might be expressive enough to fit complex reflectances, while still being efficient and following both reciprocity and energy conversation principles of a BRDF.
Bagher et al. [2] introduced the Shifted Gamma microfacet distribution with the Cook–Torrance model. Such a distribution results in a more accurate reflectance representation than the Beckmann distribution. Löw et al. [26] introduced two isotropic models for accurate and efficient rendering of glossy surfaces, either based on the RayleighRice light scattering theory or on the microfacet theory; both models makes use of a modified version of the ABC model [5, 6]. In particular, the microfacet model introduced in [26] Eq. (3) is based on the Cook–Torrance model [7]:
In Eq. (3), \(k_\mathrm{d}\) controls the diffuse component, G and F are, respectively, the geometrical attenuation and Fresnel factors as defined in [7] and given in Eqs. (5) and (6). \(\theta _\mathrm{h}\) is the half angle between the normal and the halfway vector \(\mathbf {h}\), \(\mathbf {l}\) and \(\mathbf {v}\) are the incident and viewing direction vectors, \(\mathbf {n}\) is a normal at a point on the surface. Finally, S is the ABCbased microfacet distribution, reported in Eq. (4):
In the above equation, B and C, respectively, control the width of the specular peaks and the falloff rate of wideangle scattering, while A is a scaling factor for the specular component. Therefore, Eq. (4) represents a nonnormalised distribution. The term f is defined as \(\sqrt{f_{x}^{2}+f_{y}^{2}}\) where \(f_{x}=\left( \sin \theta _\mathrm{r} \cos \phi _\mathrm{r}\sin \theta _\mathrm{i} \right) /\lambda \) and \(f_{y}=\left( \sin \theta _\mathrm{r} \sin \phi _\mathrm{r} \right) /\lambda \). \(\lambda \) is wavelength of the incident light.
In Eq. (6), \(c=\mathbf {v}\cdot \mathbf {h}\), \(g=\eta ^{2}+c{^2}1\) and \(\eta \) is the index of refraction. In the following, we will refer to the model described by Eq. (3) as “ABC model”.
While the models used in our work are all analytical BRDF models, it is worth to mention that a large number of surface reflectance representations fall in the datadriven class [14], that aims at representing measured reflectance data in a suitable function space, for instance, using factored representations [48]. Soler et al. [45] presented a method for learning a nonlinear manifold of measured BRDFs, starting from a set of reflectance measurements. The measurements are mapped into a 2d latent space, in which novel points can be computed by interpolation and mapped back to the 4d BRDF measurement space.
2.3 BRDF fitting metrics
Estimating the optimal set of the parameters for a reflectance model, given an optimisation algorithm, cost function, and the measured reflectance data, is a common task required to extrapolate material BRDF data, for instance, to be used in rendering. A wide range of different fitting metrics has been used in the previous work. Lafortune et al. [24] minimise the meansquare error of the reflectance multiplied by the cosine of both the incident and outgoing direction. The cost function defined by Löw et al. [26] makes use of a logarithmic function, with the understanding that it yields a better visual reproduction of wideangle scattering compared to the previously used metrics [35]. Fores et al. [12] used psychometric experiments to demonstrate that a cube rootbased fitting metric is perceptually more uniform compared to a RMS errorbased metric, and does not depend on the analytical model used. In recent years, perceptually motivated metrics have been further explored [41], and they proved to be useful also in gamut mapping tasks [46]. Recently, Lagunas et al. [25] used a deep learning architecture with a novel loss function to learn a feature space that is well correlated with visual appearance similarity of different materials. Guarnera et al. [15] proposed the use of a perceptually based image similarity metric, which accounts for both colour differences and gradient distribution. However, their approach requires renderings of the input material in a specific setting. In general, the choice of the cost function for fitting is not obvious, and depends also on the sample to be measured and the reflectance model used [26].
3 Method
3.1 Measurement samples
In our paper, we focus our attention on the two flexible packaging samples reported in Fig. 2. The gold sample is a metallic gold thin cardboard commonly used for decorative purposes in print and packaging industry, while the bluegreen sample is a packaging paper printed using effect pigments and varnish coatings. Both samples are nondiffuse with the bluegreen sample also being goniochromatic. Figure 3 shows the spectral shift in the bluegreen sample with the change in viewing direction. A Munsell white N9/ sheet (MW), produced according to the ANSI standards, was measured along with the gold and the bluegreen samples and used as reference white for bidirectional reflectance calculations of samples measured with our setup. Along with the print samples, a metallic paint sample (“Blue Metallic Paint”—BMP), from the MERL dataset [31], is used to assess the performance of inplane BRDF measurements in representing the appearance of print samples, as opposite to full BRDF measurements.
3.2 BRDF measurement setup
Our measurement setup for flexible samples is schematically represented in Fig. 4. In order to measure a sample, this is wrapped around a cylinder of known radius. Each point on the curved sample surface corresponds to an incident (\(\theta _\mathrm{i}\)) and reflection (\(\theta _\mathrm{r}\)) angle with respect to the surface normal and incident direction (\(\theta _\mathrm{L}\)) of the light source in the setup. Our setup performs inplane measurements (azimuthal angles \(\phi _\mathrm{i} = \phi _\mathrm{r}=0\)) and the captured image records the radiance (\(L_\mathrm{r}\left( \theta _\mathrm{i},\theta _\mathrm{r}\right) )\) exiting from the sample surface, expressed in terms of digital pixel values (R, G, B); the (R, G, B) values clearly depend also on the perchannel camera sensor spectral sensitivity (\(\bar{r}\), \(\bar{g}\), \(\bar{b}\)), other than on the material properties. Figure 4 (“Top View”) shows a schematic diagram of our measurement setup. A 16 bit Nikon D200 DSLR camera was used for the measurements. A film projector, consisting of a halogen tungsten lamp, was used as the light source. The radius of the cylinder used is 56 mm, while the distance between the cylinder and the light source is 1 m, as well as the distance between the cylinder and the camera. Please refer to [42] for details about the estimation of the incident (\(\theta _\mathrm{i}\)) and reflection (\(\theta _\mathrm{r}\)) angles; details about the accuracy of our measurement setup are reported in [43].
The samples were measured at four different illumination directions (\(\theta _\mathrm{L}= 0^{\circ }, 20^{\circ }, 30^{\circ }\), and \(40^{\circ }\)) (Fig. 4). In order to capture retroreflected light from the sample surface, \(\theta _\mathrm{L}= 0^{\circ }\) incident light direction was used during the measurements. Due to practical constraints, it was not possible to have incident light direction (\(\theta _\mathrm{L} = 0^{\circ }\)) inplane with the camera as it blocks the camera view. In order to overcome this limitation, the samples were illuminated at approximately \(\phi _\mathrm{L}= 4.6^{\circ }\) (see “Side View” in Fig. 4). Since the azimuthal angle (\(\phi _\mathrm{L}\)) is fairly small, we consider these measurements as approximately inplane, i.e. with \(\phi _\mathrm{i}=\phi _\mathrm{r}=0^{\circ }\).
In order to compare our measurements with the ones from a professional device, the samples were measured using both our setup and a goniospectrophotometer, the Murakami’s GCMS3B [33] (GCMS in the following). The GCMS records the spectral radiance factor (390–730 nm at 10 nm intervals) at anormal incident (\(\theta _\mathrm{i}\)) and reflection (\(\theta _\mathrm{r}\)) angles in the range of \(+80^{\circ }\) to \(80^{\circ }\) at \(5^{\circ }\) intervals. GCMS uses a tungsten halogen light bulb as a light source and a silicon photodiode array as a detector. The sample lays flat on a plate, which rotates between anormal angles \(\pm 80^{\circ }\) with respect to the incident light source, the latter normal to the sample surface; the instrument performs automatic correction for the change in illumination and viewing area due to sample rotation. The reference white plate used in the instrument is assumed to be a perfect reflecting diffuser. Therefore, we calculate its BRDF as \(\beta =\pi f_\mathrm{r}\).
Following the definition of radiance factor [39], the discussions in [20], and using the Munsell White N9 reflectivity (78.66%), we calculate the bidirectional reflectance for the sample as follows:
In Eq. (7), \(L_\mathrm{r}\) and \(L_\mathrm{r}^\mathrm{PRD}\) are radiance at the sample and the perfect reflecting diffuser (PRD) surface. \(\theta \) and \(\phi \) are the polar and azimuth angles, respectively. Indexes i and r are incident and reflected radiation and \(\lambda \) is the wavelength. PRD not being real, in practice, reference white materials like the spectralon tile that can be traceable to a metrological reference or a transfer standard is commonly used as a PRD [19]. We use the MW, which is wrapped around the cylinder along with the gold and bluegreen sample, as a PRD in Eq. (7).
3.3 BRDF fitting
3.3.1 Choice of the fitting metric
Print samples, such as the ones used in [44], show nondiffuse and goniochromatic properties which are challenging to visualise. Due to these complex optical properties, we test two different fitting metrics. The metric \(M_{1}\), commonly used in the previous work, is given in Eq. (8). It uses a \(\cos {\theta _\mathrm{i}}\) assuming a uniform incoming radiance at the sample surface thus giving more weight to error in the specular region [35].
In Eq. (8), P is the measurement at each pixel and \(f_{\mathrm{r}_\mathrm{m}}\) and \(f_{\mathrm{r}_\mathrm{e}}\) are the bidirectional reflectance measured and estimated using the reflectance model, respectively. \(\theta _\mathrm{i}\) is the anormal incident angle. The cost function \(M_{2}\) as defined by Löw et al. [26] is able to produce more visually accurate results, and it is reported in Eq. (9).
In Eq. (9), similar to the \(M_{1}\) cost function, \(f_{\mathrm{r}_\mathrm{m}}\) and \(f_{\mathrm{r}_\mathrm{e}}\) are the bidirectional reflectance measured and estimated using the reflectance model, respectively, and \(\theta _\mathrm{i}\) is the anormal incident angle.
The BRDFs of the print samples, as well as the BMP sample (from the MERL dataset), were estimated using an optimal set of BRDF parameters for the two reflectance models described in Sect. 2, Lafortune [24] and microfacet model by Löw et al. [26]. The print samples were measured both using our setup and the GCMS instrument.
3.3.2 Lafortune model
Figure 5 shows the directional vectors of the Lafortune model, in our setup coordinate system. Since both our setup and the GCMS instrument perform inplane measurements, and the samples used are isotropic (\(C_{x}=C_{y}=C_{xy}\)), Eq. (2) can be rewritten as in Eq. (10), where we report also the normalisation factor used.
where diffuse (\(\rho _\mathrm{d}\)) and specular (\(\rho _\mathrm{s}\)) albedo are optimised per channel. The Lafortune model parameters \(\rho _{\mathrm{d}_\mathrm{RGB}}\), \(\rho _{\mathrm{s}_\mathrm{RGB}}\), \(C_{xy}\), \(C_{z}\), and \(\alpha \) were optimised using \(M_{1}\) cost function, Nelder–Mead downhill simplex algorithm [34] as the optimisation tool, and the measured data from our setup (all \(\theta _\mathrm{L}\) directions); additionally, measurements from the GCMS were used for comparisons.
3.3.3 ABC model
Using individual diffuse (\(\rho _\mathrm{d}\)) and specular (\(\rho _\mathrm{s}\)) component albedo per channel, the microfacet ABC model from Eq. (3) can be rewritten as given in Eq. (11) to estimate the sample BRDF.
\(S_\mathrm{RGB}\) is the modified ABC distribution with parameter A (in \(S_\mathrm{RGB}\)) being used as a scaling parameter per channel for the specular component albedo and \(k_{\mathrm{d}_\mathrm{RGB}}\) is the diffuse component albedo.
To find a salient measurement dataset for analytically estimating material BRDF using the microfacet ABC model, we performed in total eight optimisations consisting of two cost functions (\(M_{1}\) and \(M_{2}\)), and four different sets of measurements. Three of these sets of measurements represent different subsets of the measurements made using our setup, as detailed in the following:

1.
Illumination direction \(\theta _\mathrm{L}= 0^{\circ }\) (which includes retroreflective measurements);

2.
Illumination direction \(\theta _\mathrm{L}= \{0^{\circ }, 40^{\circ }\}\) (as in the previous point, plus one additional direction to further improve the estimates),

3.
All illumination directions: \(\theta _\mathrm{L}= \{0^{\circ }, 20^{\circ },30^{\circ },40^{\circ }\}\).
In addition to the above, for each sample, we fitted the GCMS measurements. As for the BMP sample, inplane measurements from the MERL dataset were used, testing both the \(M_1\) and \(M_2\) metrics.
Estimating an optimal set of ABC model parameters using Nelder–Mead downhill simplex algorithm proved to be difficult, as A in (\(S_\mathrm{RGB}\)) is not normalised. The model parameters, \(k_{\mathrm{d}_\mathrm{RGB}}\), \(A_\mathrm{RGB}\) (in S), B, C, and \(\eta \) (in F), were therefore optimised for the three samples using the \(M_{1}\) and \(M_{2}\) cost functions and the GA method instead, as detailed in the next subsection.
3.3.4 BRDF fitting algorithm
Fitting measured BRDF data to an analytical BRDF model typically implies optimising for the set of parameters that minimises a given cost function. The cost function, defined over the range of possible parameter values of the BRDF model, measures the difference between the acquired reflectance data and its representation using the selected model. Optimisation algorithms, such as the Nelder–Mead downhill simplex or Powells, may converge to a local minimum or a saddle point, rather than finding global minima, in particular, in the challenging cases involving nonconvex objective functions.
To address this issue, an evolutionary algorithm such as a GAbased method could be used, in particular, in situations where a large number of BRDF model parameters need to be optimised. Due to their applicability both in constrained or unconstrained nonlinear systems, GA methods have been successfully used in computer graphics, for instance, to derive new BRDF models [4], to represent measured subsurface scattering data in a compact way [23], to derive and appearancepreserving mapping between the parameter space of any two arbitrary analytical BRDF models [15], for applicationspecific tone mappings [8] and to estimate unknown illumination spectra in facial appearance acquisition setups [13].
In the context of BRDF fitting, among the potential advantages, there is an increased probability to have in output a set of model parameters derived from a global minimum of the objective function. In fact, GA test a number of different solutions (represented by the population) at any given step of the optimisation (i.e. generation). Thus, by controlling the population size and the number of stall generations (i.e. number of consecutive generations that do not lead to an improved solution), it is possible to converge to more accurate results, while there is no theoretical guarantee to reach a global minimum. Furthermore, GA does not require the user to specify an initial guess of the parameters, a challenging task due to the complex effect of the parameters on material appearance [15, 36], in particular, in the presence of goniochromatic materials and model parameters with no clear bounds.
The parameters range has a significant impact both on the quality of the solution and on the fitting time. This is particularly true for the ABC model, in which the microfacet distribution is not normalised and the parameters controlling it (A, B, and C) do not have a clear upper bound, as well as the parameter to control the Fresnel term. To address this issue, we rely on the fitting results available in the supplemental material of [26], under the assumption that the reflectances of our materials lie in the subspace spanned by the MERL dataset. Similar assumptions about the gamut of the MERL dataset have been used in the previous work [30, 41, 51]. Indeed, a wider range of parameters could be used. However, to the best of our knowledge, this has been done so far only for the purpose of conducting detailed experiments on surface appearance perception [49].
In our implementation, with a single panmictic population of 100 individuals, parents for the next generation are selected using the stochastic universal sampling algorithm [3], children are given by the weighted arithmetic mean of two parents, where the weight depends on the fitness values of the parents, and small random mutations are obtained by enforcing a direction in the change which is consistent with the last successful generation, with a step length accounting for the boundaries derived from the MERL dataset, as described in the above.
4 Results
Mitsuba 0.6 [21] was used to render the estimated materials BRDF. To display our results, we used the geometry and lighting described in Havran et al. [18]. Figures 7, 9, and 11 show the renderings obtained using the optimised reflectance models, discussed in Sect. 5.
Figure 6 compares the Lafortune model fits parameters obtained from measurements using our setup (all available \(\theta _\mathrm{L}\) directions) and the GCMS instrument. In all cases, the Nelder–Mead downhill simplex algorithm converged to local minima, thus preventing to reach satisfactory fits. Since the samples are isotropic, it follows that \(C_{x} = C_{y}\), which causes the BRDF, and hence the cost function, to assume the same value when \(\{ C_{xy}=\xi , C_{z}=\chi \}\) and \(\{C_{xy}=\chi , C_{z}=\xi \}\), with \(\{\chi ,\xi \} \in \mathbb {R}\) (see Eq. 10). Therefore, fitting only inplane measurements to the Lafortune model leads to additional issues and suboptimal fits. The same consideration applies regardless of the device used to acquire the inplane measurements (i.e. GCMS, our setup or the inplane only data extracted from the MERL dataset) and the fitting algorithm. Therefore, in our experiments we did not further explore the use of the Lafortune model. Figure 7 shows renderings obtained using the Lafortune model.
To assess the quality of the fits achievable using inplane BRDF measurements, rather than the full BRDF, we used the subset of inplane reflectance data for BMP sample in the MERL dataset; Fig. 8 reports the results of the experiment, while Fig. 9 shows the corresponding renderings, including as a reference the reconstructed appearance of the material using the whole BRDF data.
Figure 10 compares the fits obtained for the microfacet ABC model using the GA algorithm, relying on measurements from the GCMS (first row) and from our setup (second to last row); Fig. 11 reports the corresponding renderings.
To objectively compare the effectiveness of the measurements used to estimate the BRDF parameters, we used the relative error (Err), computed using Eq. (12), which accounts for the maximum value in the measurements. In Eq. (12), \(f_{\mathrm{r}_\mathrm{m}}\) represents the measurements obtained using our setup, \(f_{\mathrm{r}_\mathrm{e}}\) represents the data estimated using the optimised microfacet ABC model, and N is the total number of data points (P).
Figure 12 shows the relative error using different measurement datasets, for both material samples and metrics.
5 Discussion
With reference to Figs. 6 and 7, inplane measurements were not sufficient to achieve satisfactory fits for the Lafortune model, regardless the measurement device used. In fact, the \(C_{x} = C_{y}\) condition for isotropic materials, along with the use of inplane only measurements, resulted into optimisation converging to suboptimal local minima. Even though the estimated BRDF shows a good fit with the measurements (Fig. 6), the renderings obtained fail to display the goniochromatic properties of the sample. Therefore, for some combinations of surface reflectance and analytical BRDF model, this represents a limitation of our measurement setup, since using outofplane measurements could result in more robust estimates. Gold sample renderings (Fig. 7a) show a greenish colour cast, which we believe is due to the spectral sensitivity functions (\(\bar{r}\), \(\bar{g}\), and \(\bar{b}\)) of the camera that was used as a detector.
As for the microfacet ABC model, the parameter A of the microfacet distribution acts as a scaling factor for the specular term, thus resulting into a nonnormalised distribution. This consideration, along with the lack of a clear upper bound for all the model parameters, suggested the use of a GA method to fit the acquired reflectance data, instead of commonly used optimisation tools. For the print samples measured in this paper, the microfacet ABC model, fitted using our GA method, allows to obtain visually satisfactory renderings that correctly display nondiffuse and goniochromatic properties. However, our setup is able to acquire few measurements at grazing angles, due to design limitations. Therefore, the lack of information about surface reflectance at grazing angle may affect the estimation of the model parameter related to the material refractive index (\(\eta \)), thus affecting the quality of the estimated Fresnel effect. A possible solution would be replacing the cylinder in our setup with an elliptical surface.
The microfacet ABC model parameters were derived from different sets of measurements with our setup, comparing the results. Inplane measurements that include the retroreflective slice of the BRDF (\(\theta _\mathrm{L}=0^{\circ }\)), allowed us to obtain visually satisfactory renderings for the measured samples (Fig. 11). The inclusion of additional measurements (\(\theta _\mathrm{L} = 40^{\circ }\)) increases the quality of the renderings, in particular, for the goniochromatic bluegreen sample. The limited resolution of the GCMS instrument (at \(5^{\circ }\) intervals) fails to capture the specular and goniochromatic properties. In comparison, our setup provides a sparser set of measurements, locally more dense. In practice, the density of our measurements depends on the cylinder radius on which the sample is wrapped around, the distance between detector and the sample, and the resolution of the camera used as a detector. Performing measurements using our setup is also faster compared to measuring using the GCMS instrument, as expected for an imagebased acquisition setup.
With respect to the relative error calculated between the measurements and estimated data (Fig. 12), the performance of both \(M_{1}\) and \(M_{2}\) metrics is numerically rather similar. Fits obtained using the logarithmic cost function (\(M_{2}\)) led to more realistic renderings, able to faithfully convey the goniochromatic properties of the bluegreen sample. The difference between BMP sample rendered using the two different fits achieved for the ABC model, using the \(M_{1}\) and \(M_{2}\) metrics, is noticeable (Fig. 9).
6 Conclusion
We characterise the surface reflectance of two print samples displaying complex optical properties by fitting their BRDF to commonly used reflectance models. Goniochromatic and nondiffuse optical properties are rendered using the estimated BRDF.
Inplane retroreflective measurements taken with our setup, along with the GA method as a BRDF fitting tool, allowed to estimate an optimal set of the reflectance model parameters. Renderings obtained using the microfacet ABC BRDF model show that using just inplane retroreflective measurements is salient enough to render the reflectance properties of the print samples measured. However, more measurements led to more accurate renderings, in particular, for the goniochromatic sample. Inplane measurements obtained from our setup, as well as from the goniospectrophotometer, did not allow to derive satisfactory fits for the Lafortune model, given its analytical definition for isotropic materials. We believe outofplane measurements would be required, in order to solve the resulting ambiguities.
Our measurement setup represents a simple and fast BRDF measurement tool and, along with the GAbased BRDF fitting, could be used to build upon the existing methods [11] for acquiring and rendering discrete sparkles for both isotropic and anisotropic packaging materials, along with goniochromatism and specularity.
References
Ashikhmin, M., Premoze, S.: Distributionbased BRDFs. Unpublished Technical Report, p. 10 (2007)
Bagher, M.M., Soler, C., Holzschuch, N.: Accurate fitting of measured reflectances using a shifted gamma microfacet distribution. In: Computer Graphics Forum, vol. 31, pp. 1509–1518. Wiley Online Library (2012)
Baker, J.E.: Reducing bias and inefficiency in the selection algorithm. In: Proceedings of the Second International Conference on Genetic Algorithms, vol. 206, pp. 14–21 (1987)
Brady, A., Lawrence, J., Peers, P., Weimer, W.: GenBRDF: discovering new analytic BRDFs with genetic programming. ACM Trans. Graph. 33(4), 114 (2014)
Church, E.L., Takacs, P.Z.: Optimal estimation of finish parameters. In: Optical Scatter: Applications, Measurement, and Theory, vol. 1530, pp. 71–86. International Society for Optics and Photonics (1991)
Church, E.L., Takacs, P.Z., Leonard, T.A.: The prediction of BRDFs from surface profile measurements. In: Scatter from Optical Components, vol. 1165, pp. 136–151. International Society for Optics and Photonics (1990)
Cook, R.L., Torrance, K.E.: A reflectance model for computer graphics. ACM Trans. Graph. 1(1), 7–24 (1982). https://doi.org/10.1145/357290.357293
Debattista, K.: Applicationspecific tone mapping via genetic programming. In: Computer Graphics Forum, vol. 37, pp. 439–450. Wiley Online Library (2018)
Dupuy, J., Jakob, W.: An adaptive parameterization for efficient material acquisition and rendering. Trans. Graph. (Proc. SIGGRAPH Asia) 37(6), 274:1–274:18 (2018). https://doi.org/10.1145/3272127.3275059
Ershov, S., Ďurikovič, R., Kolchin, K., Myszkowski, K.: Reverse engineering approach to appearancebased design of metallic and pearlescent paints. Vis. Comput. 20(8–9), 586–600 (2004)
Ferrero, A., Campos, J., Rabal, A., Pons, A.: A single analytical model for sparkle and graininess patterns in texture of effect coatings. Opt. Express 21(22), 26812–26819 (2013)
Fores, A., Ferwerda, J., Gu, J.: Toward a perceptually based metric for BRDF modeling. In: Color and Imaging Conference, vol. 2012, pp. 142–148. Society for Imaging Science and Technology (2012)
Gitlina, Y., Guarnera, G.C., Dhillon, D., Hansen, J., Lattas, A., Pai, D., Ghosh, A.: Practical measurement and reconstruction of spectral skin reflectance. Comput. Graph. Forum 39(4), 75–89 (2020). https://doi.org/10.1111/cgf.14055
Guarnera, D., Guarnera, G.C., Ghosh, A., Denk, C., Glencross, M.: Brdf representation and acquisition. Comput. Graph. Forum 35(2), 625–650 (2016). https://doi.org/10.1111/cgf.12867
Guarnera, D., Guarnera, G.C., Toscani, M., Glencross, M., Li, B., Hardeberg, J.Y., Gegenfurtner, K.: Perceptually validated crossrenderer analytical BRDF parameter remapping. IEEE Trans. Vis. Comput. Graph. 26(6), 2258–2272 (2020). https://doi.org/10.1109/TVCG.2018.2886877
Guo, J., Pan, J.: A physicallybased BRDF model for retroreflection. In: Proceedings of the Computer Graphics International Conference, p. 36. ACM (2017)
Guo, J., Guo, Y.W., Pan, J.G.: A retroreflective BRDF model based on prismatic sheeting and microfacet theory. Graph. Models 96, 38–46 (2018)
Havran, V., Filip, J., Myszkowski, K.: Perceptually motivated BRDF comparison using single image. In: Computer Graphics Forum, vol. 35, pp. 1–12. Wiley Online Library (2016)
Höpe, A., Hauer, K.O.: Threedimensional appearance characterization of diffuse standard reflection materials. Metrologia 47(3), 295–304 (2010). https://doi.org/10.1088/00261394/47/3/021
Höpe, A., Hauer, K.O.: Threedimensional appearance characterization of diffuse standard reflection materials. Metrologia 47(3), 295 (2010)
Jakob, W.: Mitsuba renderer 2010 (2010)
Kehren, K.: Optical properties and visual appearance of printed special effect colors. Ph.D. thesis, Technischen Universität Darmstadt, Darmstadt, Germany (2013)
Kurt, M.: GenSSS: a genetic algorithm for measured subsurface scattering representation. Vis. Comput. (2020). https://doi.org/10.1007/s00371020018000
Lafortune, E.P.F., Foo, S.C., Torrance, K.E., Greenberg, D.P.: Nonlinear approximation of reflectance functions. In: Proceedings of the 24th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH ’97, pp. 117–126, New York, NY, USA. ACM Press/AddisonWesley Publishing Co. ISBN 0897918967 (1997) https://doi.org/10.1145/258734.258801
Lagunas, M., Malpica, S., Serrano, A., Garces, E., Gutierrez, D., Masia, B.: A similarity measure for material appearance. ACM Trans. Graph. 38(4), 1–12 (2019). https://doi.org/10.1145/3306346.3323036
Löw, J., Kronander, J., Ynnerman, A., Unger, J.: Brdf models for accurate and efficient rendering of glossy surfaces. ACM Trans. Graph. 31(1), 9 (2012)
Lu, J.R., Koenderink, J., Kappers, A.M.L.: Optical properties (bidirectional reflection distribution functions) of velvet. Appl. Opt. 37(25), 5974–5984 (1998)
Maile, F.J., Pfaff, G., Reynders, P.: Effect pigments: past, present and future. Prog. Org. Coat. 54(3), 150–163 (2005)
Marschner, S.R., Westin, S.H., Lafortune, E.P.F., Torrance, K.E., Greenberg, D.P.: Imagebased BRDF measurement including human skin. In: 10th Eurographics Workshop on Rendering, pp. 139–152 (1999)
Matusik, W.: A datadriven reflectance model. Ph.D. thesis, Massachusetts Institute of Technology (2003)
Matusik, W., Pfister, H., Brand, M., McMillan, L.: A datadriven reflectance model. ACM Trans. Graph. 22(3), 759–769 (2003)
McCamy, C.: Observation and measurement of the appearance of metallic materials, part I. Macro appearance. Color Res. Appl. 21(4), 292–304 (1996)
Murakami’s gcms3b goniospectrophotometric color measurement system manual. https://aviantechnologies.com/wpcontent/uploads/MurakamiGCMS3BGCMS4ColorMeasurement.pdf. Accessed 29 June 2020
Nelder, J.A., Mead, R.: A simplex method for function minimization. Comput. J. 7(4), 308–313 (1965)
Ngan, A., Durand, F., Matusik, W.: Experimental analysis of BRDF models. Render. Tech. 2005(16th), 2 (2005)
Ngan, A., Durand, F., Matusik, W.: Imagedriven navigation of analytical BRDF models. In: Proceedings of the 17th Eurographics Conference on Rendering Techniques, EGSR ’06, pp. 399–407, Goslar, DEU. Eurographics Association. ISBN 3905673355 (2006)
Nicodemus, F.E., Richmond, J., Hsia, J.J., Ginsberg, I.W., Limperis, T.: Geometrical Considerations and Nomenclature for Reflectance. National Bureau of Standards, Washington (1977)
Nielsen, J.B., Jensen, H.W., Ramamoorthi, R.: On optimal, minimal BRDF sampling for reflectance acquisition. ACM Trans. Graph. (2015). https://doi.org/10.1145/2816795.2818085
Palmer, J., Grant, B.G.: The Art of Radiometry. SPIE Press, Bellingham (2010)
Phong, B.T.: Illumination for computer generated pictures. Commun. ACM 18(6), 311–317 (1975). https://doi.org/10.1145/360825.360839
Serrano, A., Gutierrez, D., Myszkowski, K., Seidel, H.P., Masia, B.: An intuitive control space for material appearance. ACM Trans. Graph. 35(6), 1861–18612 (2016)
Sole, A., Farup, I., Tominaga, S.: An image based multiangle method for estimating reflection geometries of flexible objects. In: Color and Imaging Conference, 2014, pp. 91–96 (2014)
Sole, A., Farup, I., Nussbaum, P., Tominaga, S.: Evaluating an imagebased bidirectional reflectance distribution function measurement setup. Appl. Opt. 57(8), 1918–1928 (2018). https://doi.org/10.1364/AO.57.001918
Sole, A., Farup, I., Nussbaum, P., Tominaga, S.: Bidirectional reflectance measurement and reflection model fitting of complex materials using an imagebased measurement setup. J. Imaging (2018). https://doi.org/10.3390/jimaging4110136
Soler, C., Subr, K., Nowrouzezahrai, D.: A versatile parameterization for measured material manifolds. In: Computer Graphics Forum, vol. 37, pp. 135–144. Wiley Online Library (2018)
Sun, T., Serrano, A., Gutierrez, D., Masia, B.: Attributepreserving gamut mapping of measured BRDFs. Comput. Graph. Forum 36(4), 47–54 (2017). https://doi.org/10.1111/cgf.13223
Tominaga, S., Tanaka, N.: Estimating reflection parameters from a single color image. IEEE Comput. Graph. Appl. 20(5), 58–66 (2000)
Tongbuasirilai, T., Unger, J., Kronander, J., Kurt, M.: Compact and intuitive datadriven brdf models. Vis. Comput. 36, 1–18 (2019). https://doi.org/10.1007/s0037101901664z
Toscani, M., Guarnera, D., Guarnera, G.C., Hardeberg, J.Y., Gegenfurtner, K.R.: Three perceptual dimensions for specular and diffuse reflection. ACM Trans. Appl. Percept. (2020). https://doi.org/10.1145/3380741
Ward, G.J.: Measuring and modeling anisotropic reflection. SIGGRAPH Comput. Graph. 26(2), 265–272 (1992)
Xu, Z., Nielsen, J.B., Yu, J., Jensen, H.W., Ramamoorthi, R.: Minimal brdf sampling for twoshot nearfield reflectance acquisition. ACM Trans. Graph. 35(6), 1–12 (2016)
Acknowledgements
We would like to thank and acknowledge support from the research and training projects Spectraskin, MUVApp, and ApPEARS at the Colour and Visual Computing Laboratory (www.colourlab.no). We would like to thank the anonymous reviewers of this paper for their valuable feedback and arguments to improve the overall quality of this paper.
Funding
Open Access funding provided by NTNU Norwegian University of Science and Technology (incl St. Olavs Hospital  Trondheim University Hospital). This work was supported by the “MUVApp” Project N250293, “Spectraskin” Project N288670 funded by the Research Council of Norway, and from the European Union’s Horizon 2020 research and innovation programme under the Marie SkodowskaCurie Grant Agreement No. 814158 (ApPEARS Project [https://www.appearsitn.eu]).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Sole, A., Guarnera, G.C., Farup, I. et al. Measurement and rendering of complex nondiffuse and goniochromatic packaging materials. Vis Comput 37, 2207–2220 (2021). https://doi.org/10.1007/s00371020019809
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00371020019809