Abstract
Variation propagation modelling in multistage machining processes through use of analytical approaches has been widely investigated for the purposes of dimension prediction and variation source identification. Yet the variation prediction of complex features is non-trivial task to model mathematically. Moreover, the application of the variation propagation approaches and associated variation source identification techniques using Skin Model Shapes is unclear. This paper proposes a multilayer shallow neural network regression approach to predict geometrical deviations of parts given manufacturing errors. The neural network is trained on a simulated data, generated from machining simulation of a point cloud of a part. Further, given a point cloud data of a machined feature, the source of variation can be identified by optimally matching the deviation patterns of the actual surface with that of shallow neural network generated surface. To demonstrate the method, a two-stage machining process and a virtual part that has planar, cylindrical and torus features was considered. The geometric characteristics of machined features and the sources variation could be predicted at an error of 1% and 4.25%, respectively. This work extends the application of Skin Model Shapes in variation propagation analysis in multistage manufacturing.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
Introduction
All manufacturing processes are inherently imprecise, thus producing parts with variation (Srinivasan and Heights 1999). The ability of assessing the effect of those variations by virtual models provides a competitive advantage for manufacturing and product development organizations (e.g. Schleich et al. 2017). For the purposes of product development, Skin Model Shapes, models derived from discretized nominal models or point cloud data, provide a better accuracy in variation propagation related analysis compared to the classical methods, such as vector loops and small displacement torsor (Schleich et al. 2016; Schleich and Wartzack 2016). The variation propagation analysis is based on the mechanical assembly of virtual parts (Schleich and Wartzack 2015), mainly for the purposes of performing tolerance synthesis and analysis (Nabil Anwer et al. 2014; Schleich and Wartzack 2014).
In multistage machining, the part variations propagate at each stage in process, resulting a complex relationship between the sources of variation and the machined parts. Such relationship is often studied under the notion of stream of variation. This mainly includes analytical modeling of the relationship for use in activities such as quality control, optimal placement of inspection stations, process planning, and process-oriented tolerancing (Abellán-nebot et al. 2013).
However, the techniques of variation propagation analysis used in product development and manufacturing processes have been developing independently without adapting the advances from each other (Abellán-nebot et al. 2013). Towards addressing this need, Wang et al. (2019) proposed a model that combines stream of variation for inter-station variation and small displacement torsor for variation in the assembly of workpiece and machine tool components. Even though, the method applies for most of the practical shapes, there is also a need to include geometric variation and workpiece deformity in the model (Wang et al. 2019). Such geometric shapes can be modeled using the principles of Skin Model Shapes (Schleich et al. 2014). However, the prediction of geometric variation of novel shapes using Skin Model Shapes in relation to variation sources is ongoing research (Schleich and Wartzack 2017). In that direction, a machining simulation with induced variations can be applied in representing actual processes (Yacob et al. 2018). Nevertheless, machining simulation with induced error at each stage can become slow for making continuous analysis and process planning, especially using a point cloud in CAM environment. Moreover, a generic mathematical relation between variation sources and the machined feature is complicated (Shi 2006).
Thus, this paper proposes a multilayer shallow neural network (SNN) regression approach to predict the geometric deviations of a part given variation sources’ deviations at a specific machining stage. In multistage machining process, the predicted geometric deviations become inputs to a trained model of a subsequent stage, thereby predicting variation propagation stage wise. Furthermore, in variation source identification, the predicted surface by a SNN is made to optimally match the actual machined surface by iteratively tuning the input values.
For the first time, Skin Model Shape (here after SMS) has been applied in variation source identification of machined parts. This approach extends the analytical methods applied in variation propagation modelling by introducing how SNN can be used in prediction of geometric variation and variation source identification. After discussing the background works in “Background” section, this paper presents three major sections. In “Prediction of geometric characteristics” and “Variation source identification” sections, the approaches to geometric characteristics prediction and error source identification are presented. After presenting a demonstration case in “Demonstration case” section, a discussion and conclusion are presented in the subsequent sections.
Background
Skin Model Shapes
A SMS can be generated from a tessellated nominal model by scaling the vertices of a feature of interest to match the desired deviations (Schleich et al. 2014). The scaling is performed so that vertices lie within the range of specified tolerance or variation range of observed data (Nabil Anwer et al. 2014; Schleich and Wartzack 2016). Specifically, second order shapes and Gaussian random fields (Zhang 2012) and signal processing approaches such as discrete-cosine-transform (Huang and Ceglarek 2002) and natural modes decomposition (Samper and Cedex 2019), and machining simulation with induced errors (Yacob et al. 2018) can be applied. Alternatively, SMS can be generated from observed data using techniques such as screened poisson surface reconstruction (Yacob et al. 2018) or NURBS-based (Zhang et al. 2017).
The central message of the concept of Skin model is the use of a univocal language in variation related analysis in design, manufacturing and inspection (Anwer et al. 2013; Schleich and Wartzack 2014). Arguably, the same model must be used in geometric prediction during design, manufacturing process planning and variation source identification. However, the use of SMSs towards variation propagation analysis in a multistage machining has not been extensively studied.
Variation propagation modelling
Variation in multistage machining is often studied under the notion of stream of variation. Stream of variation is a strategy that aims to model and analyze variation and its propagation in a multistage machining by applying the state-space model (Mantripragada and Whitney 1999; Shi 2006). The state-space model defines the relationship between key product characteristics and the sources of variation, i.e. the fixture-, tooltip (machining)- and datum-induced deviations, in a matrix form (Abellán-nebot et al. 2013). A more detailed description is available in Abellán-nebot et al. (2012a, 2013) and Shi (2006). Similar approaches based on the concept of small displacement torsor (Bourdet and Clement 1988) has been proposed for manufacturing processes, whereby the part and fixture are treated as a mechanism (Villeneuve et al. 2001). The methods based on the concept of small displacement torsor is often applied for tolerance synthesis to limit defects per setup given design requirements, and tolerance analysis to verify if a machining process meets a functional tolerance (Abellán-nebot et al. 2013).
Moreover, the concept of stream of variation is also applied in variation source identification per station. The approaches mainly include pattern matching of variances obtained from principal component analysis (Shi 2006) and statistical estimation of variation sources by hypothesis testing (Zhou et al. 2004). The manufacturing data is collected by random sampling of machined parts. Such approaches cannot be applied for a point cloud data as number of data points per sampled part is very large.
Most studies related to SMS focus on application of SMS in design stage of a product lifecycle. Thus far, few mathematical models have been proposed for determining the geometric characteristics of planar and cylindrical features given manufacturing variation sources’ deviations e.g. (Liu et al. 2018; Wu et al. 2017, 2018). However, the mathematical approaches require expert knowledge to apply in more complex products (Schleich and Wartzack 2017). Even though, the work reported in Liu et al. (2018) and Wu et al. (2017, 2018) can be extended in error source identification in multistage machining process, there has not been systematic attempt for error source identification based on SMSs. The prediction of geometric properties of a part produced in multistage machining is a non-trivial task, given the need to consider all sources of error and their combinatorial effect. Mapping of variation sources and to geometric properties is one of the current research challenges in variation modelling using SMSs (Schleich and Wartzack 2017).
Neural network
Neural network is an architecture that attempts to mimic the human brain. In a typical feedforward neural network, a multilayer architecture, containing input, hidden, and output layers, is used. Each layer contains multiple neurons that are represented by real-valued activations. In a feedforward network that applies backpropagation algorithm, the weights and biases are first initialized. The sum of the connection’s weights and biases determine whether to activate a neurons, thereby one layer affects the pattern on the activated neurons on the next layer. Following this, the weights and biases are repeatedly evaluated and updated in such a way that the mean squared error between predicted and actual values is reduced, often with the help of gradient decent. The network connection is adjusted in such a way that both linear and non-linear relationships between input data (predictors) and target values are inferred. Generally, when the input data is pre-defined before training and the number of hidden layers is less than 3, the architecture is referred as a shallow neural network, otherwise a deep neural network. A neural network’s model quality is determined by its ability to generalize (Hunter et al. 2012). A more detailed description on the working principles of neural networks can be found in Lecun et al. (2015) and Liu et al. (2017).
Neural networks have been applied in many fields in solving non-trivial problems (Liu et al. 2017). In manufacturing, different neural network models have been applied in tool condition monitoring (Burke and Rangwala 1991; Penedo et al. 2012; Wang and Cui 2013), machinery fault diagnosis and predictive maintenance (Hu et al. 2017; Li et al. 2018; Tian 2012; Wang et al. 2018; Zhang et al. 2013). However, most of the research related to conventional machine tools is inclined towards tool condition monitoring and surface roughness prediction (Kim et al. 2018). Limited attention has been given towards application of neural networks in variation propagation using point clouds.
Prediction of geometric characteristics
An accurate prediction of geometric characteristics of a machined part, thereby estimating capability of the machining process, would enable the selection of the most robust set of operations to manufacture a part. The accuracy of the prediction can be improved using historical shop-floor data (Abellán-nebot et al. 2013). Given a relationship between sources of error and a part, a process planner can evaluate the manufacturing accuracy of a process plan and take appropriate measures to reduce variation (Abellan-Nebot et al. 2012b). In this paper, a machining simulation followed by a SNN-based prediction is used to characterize the geometric shapes. The approach was inspired by SMS generation (e.g. Schleich et al. 2014) and stream of variation (e.g. Abellán-nebot et al. 2013; Shi 2006) techniques.
Data generation through machining simulation
A machining simulation with induced errors can mimic the actual machining process, thereby the simulation result closely matches the actual part with variation (Ibaraki and Yoshida 2017; Yacob et al. 2018). It is a generally accepted notion that part surfaces are a superimposition of lay, waviness and roughness (Henzold 2006). The surface waviness and roughness under a large applied force has a negligible contribution at distances greater than 20 mm away from the source, in line with Saint–Venant’s Principle (Guo et al. 2016). Thus, the simulation setup can focus only on the lay without significantly affecting the setup accuracy. By the same token, 2D (flat) locators can be reduced to a single point locator without significantly reducing the setup accuracy.
In a typical 3–2–1 fixture layout, features are assembled to a fixture in the sequence of primary, secondary and tertiary locators. A gravitational force is exerted on the part when assembling to the primary locators (3 locators). External forces are then applied to move the part against of secondary locators (2 locators) and tertiary locator (1 locator). The sequence of assembly to the secondary and tertiary is of no particular importance as long as all points are in contact. To assemble features to the corresponding locators, a SMS’s features must first be partitioned (Schleich and Wartzack 2015), as shown in Fig. 1. The primary feature of the model shape is first registered to the primary locators, which the rest of the point cloud is transformed by equivalent amount. This step fixes 3 degrees of freedom. The set of point clouds is then made to rotate around axis normal to the primary plane and slide in the direction normal to the secondary plane, which fixes another 2 degrees of freedom. Finally, the shape model slides in the direction of the intersection of primary and secondary direction until it meets the tertiary locator, which fixes the final degree of freedom. Mathematically, given the rotation matrix Rprim and translation Tprim needed to register the primary feature, the rotation of the resulted point cloud around normal to the primary Rsec, translation to the secondary plane Tpt, and translation to tertiary plane Tps can be expressed as:
where \( \varvec{A} \in {\mathbb{R}}^{3} \) is model shape, npt is a normal vector to the secondary plane (intersection of primary and tertiary planes) and nps is a normal vector to the tertiary plane (intersection of primary and secondary planes), as shown in Fig. 1.
Following a setup with induced errors, a machining simulation can be performed to obtain a machined surface. However, to the best knowledge of the authors, there are no effective CAx tools that enable machining simulation on point cloud with induced fixture and tooltip errors. Nonetheless, the point cloud of primitive shapes, such as planes and cylinders, can be machined by placing and subtracting a corresponding point cloud of a feature, without compromising the accuracy and intended purpose of the simulation. The use of primitive shapes enables simulating directly on point cloud data, whereby the cutting feature’s points become the points of the machined surface, after adjusting the position for tooltip deviation. The approach is in line with the principles of constructive solid geometry techniques, whereby a signed distance is used to determine whether the points are inside or outside specific feature.
It is worth mentioning that cutting conditions, such as roughing and finishing, that result change in waviness and roughness of the machined surfaces are not directly considered in part quality prediction. In such predictions, the effect of cutting tool wear, machine tool axes deviations, spindle-thermal variation and cutting force are collectively expressed as tooltip deviations, which is assumed constant per operation (Abellan-Nebot et al. 2012b). Further, the effect of non-attributable factors on the machined surface are indirectly captured by Gaussian random fields, and added to the orientation and positional errors caused by attributable factors.
For instance, Fig. 2 illustrates virtual facing and boring processes by point cloud of a plane and cylinder while assembled to a fixture of 3–2–1 layout. The simulation steps in setup 1, shown in Fig. 2a, can be described mathematically as follows:
The point cloud of a stock \( \varvec{P}_{\text {stock}} = \left\{ {\left( {\varvec{X},\varvec{Y},\varvec{Z}} \right) \in {\mathbb{R}}^{3} } \right\} \), a point cloud of reference landmarks Q, that are arbitrarily placed in space, can be added to Pstock
For a point cloud of a cutting plane in the shape of a would be machined surface \( \varvec{C}_{\text {cp}} = \left\{ {\left( {\varvec{X}_{\text {cp}} ,\varvec{Y}_{\text {cp}} ,\varvec{Z}_{\text {cp}} } \right) \in {\mathbb{R}}^{3} } \right\} \), the point cloud of machined part \( \varvec{P}_{\text {stock},Q } \) while assembled to a fixture can be represented by
For machining cylindrical features by cutting cylinder \( \varvec{C}_{\text {cy}} = \left\{ {\left( {\varvec{X}_{\text{cy}} ,\varvec{Y}_{\text{cy}} ,\varvec{Z}_{\text{cy}} } \right) \in {\mathbb{R}}^{3} } \right\} \), with nominal axis \( \varvec{P}_{\text {axis}} = \left\{ {\left( {x_{0} ,y_{0} } \right) \in {\mathbb{R}}^{2} } \right\} \) and radius r, the signed radial error \( \varvec{r}_{\text {error}} \) can be estimated by
The point cloud of a machined part while assembled to a fixture becomes
The landmarks \( \varvec{Q}_{\text{assembly} } \) can be extracted from \( \varvec{P}_{\text {assembly }} \); when a Procrustes registration \( PD(\varvec{Q},\varvec{Q}_{\text {assembly}} \)) is performed, the resulting rotation matrix \( \varvec{R} \) and translation vector \( \varvec{T} \) are applied in transforming the fixture-assembled point cloud \( \varvec{P}_{\text {assembly }} \) back to a nominal position via reference landmarks. Thus, the resulting point cloud of a machined part \( \varvec{P} \) can be obtained by
Furthermore, the cutting plane \( \varvec{C}_{cp} \) is transformed by an equivalent magnitude to yield a machined surface \( {\boldsymbol{\mathcal{N}}} \)
The resulting point cloud of the machined surface provides an orientation and position information. Form error can later be added to the point cloud using methods such as Gaussian random fields. To obtain the rigid transformation of the a nominal model due to a fixture error alone, a Procrustes registration from nominal position to a displaced position, \( {{PD}}( {\varvec {Q}}_{\text{assembly}} ,{\varvec{Q}}) \), can be applied. Furthermore, the simulation results alone can be used in the subsequent steps of the method proposed in this paper, without the need to render the surface or convert to image. The resulting point clouds, along with source of errors used during machining simulation, become the training data for a shallow neural network.
Training a shallow neural network
A specific combination of error source deviations (fixture, tooltip and datum deviations) yields a specific geometrical pattern on the machine surface (Shi 2006). Given error source deviations, the geometrical characteristics of the machined surface can be predicted by SNN regression.
The SNN requires a labelled training data that includes all combination of source of errors and the machined surface. One of the economical methods of generating data of combinatorial nature is Design of Experiments; however, SNN models perform better with randomized input data. Therefore, fixture and tooltip deviations can be sampled from a uniform distribution ranging between minimum and maximum deviations. For datum error, the point deviations from the nominal in the direction of X, Y, and Z are used.
Moreover, empirical results show that the accuracy of estimation of variation sources’ deviations, given a machined surface, can be increased by adding a vector connecting the secondary locators’ positions. This vector is associated with the model shape’s rotation, and transformation matrix parameters that capture the effects of the primary locators. Specifically, the parameters of the transformation matrix, derived using \( {\text{PD}}({\mathbf{Q}}_{\text{assembly}} ,{\mathbf{Q}} \)), significantly increase the accuracy of estimated variation sources given a machined surface, by adding a relationship between the locator deviations and a nominal model. To shield the user from the need to input the parameters, however, a SNN generated parameters, for a given fixture deviations, can be used. Figure 3 illustrates the SNN architecture that can be used to predict the rotation parameters R1×9 and translation parameters T1×3 given 6 locators’ deviations.
The aforementioned inputs are mapped to the deviations of the machined feature, such that the relationship is learned by the SNN. The relationship is more accurate and practical when performed for a single stage at a time. For a multistage machining, a series of predictions can be made based on upstream datum information, and current stage’s fixture and tooltip deviations. Algorithm I shows steps to generate a labelled training data. Figure 4 illustrates the inputs and outputs of a SNN architecture, where the outputs are predicted separately to increase accuracy.
The set of input and output values to the neural network can mathematically be expressed as follows. For \( K \) experiments, the set of locator deviations \( \varvec {d}_{1 \ldots K}^{1 \ldots L} = \left\{ {d_{k}^{l} \in {\mathbb{R}}:l = 1,2 \ldots L, k = 1,2 \ldots K} \right\} \), tooltip deviations \( {d}_{1 \ldots K}^{tt} = \left\{ {\varvec{d}_{k}^{tt} \in {\mathbb{R}}: k = 1,2 \ldots K} \right\} \), and datum points deviations \( \varvec {d}_{1 \ldots K}^{i,1 \ldots M} \) = \( \left\{ {({\varvec {d}}_{k}^{{X_{i} ,m}} ,{\varvec{d}}_{\text{k}}^{{Y_{i} ,m}} ,{\varvec {d}}_{k}^{{Z_{i} ,m}} ) \in {\mathbb{R}^3}:m = 1,2 \ldots M, k = 1,2 \ldots K} \right\} \), the input data set \( \varvec{I} \) become:
where \( L \) is the total number of locators, \( M \) is total number of points in datum plane.
Similarly, the output data set \( \varvec{O} \),
where \( N \) is the total number of points in the output shape.
For a trained SNN model \( {{\varTheta }} \) and given input \( \varvec{I}' \), a specific deviation \( \varvec{O^{\prime}} = (\varvec{d}^{{ 'X_{o} }} ,\varvec{d}^{{ 'Y_{o} }} ,\varvec{d}^{{ 'Z_{o} }} ) \) is obtained by
The predicted deviations can then be used to update the position of the nominal feature, thereby generating a surface with variation \( {\boldsymbol{\mathcal{N}}}\varvec{'} \)
The datum’s and the resulting machined surfaces’ points should be reduced to a reasonable number before performing the machining simulation. To reduce the number of points, random down sampling, Octree based mean point extraction (Yacob et al. 2018) or K-means clustering (Jain 2010) methods can be applied.
Moreover, in a multistage machining, a stage-wise prediction can be applied. The respective SNN models are trained for a set of given fixture, tooltip and datum deviations of a specific stage. When performing a prediction, the datum deviations obtained from the output of previous stage’s trained model is used as input in the subsequent stage, as shown in Fig. 5. For a smooth stitching at the edges of predicted surface and the point cloud of the part, the steps proposed in Yan and Ballu (2017) can be applied. Further, it is worth mentioning that once the SNN is trained for all possible combination of fixture, datum and tooltip deviations, no further intervention is needed by the user when making predictions for given inputs.
Variation source identification
As stated in the above, a specific combination of the 3 variation sources yield specific surface variation, which can be predicted with the help of a SNN. Reversing the prediction process, for a given machined surface, the error sources can be fine-tuned so that the predicted surface closely matches the actual. The resulting deviations of the error sources that closely match the surfaces are considered as the actual sources of error. In relation to SMS, pattern matching can be performed on the surfaces of interest by reducing the distance between the surfaces, in line with the technique applied in iterative closet point (ICP). The individual points deviation can be obtained by computing Hausdorff distance (Girardeau-montaut et al. 2005) or Euclidian distance from simulated points to the best fitting shape of the actual points. Figure 6 illustrates the deviations of points that must be reduced to match the pattern of simulated (or SNN predicted) points to the actual data points.
The quality of surface matching between the SNN-predicted and the actual one can be estimated by computing the root-mean-squared-error (RMSE). To experiment with variation sources values that would give a matching surface, different locator and tooltip deviations within minimum and maximum allowable deviations can iteratively be tested. Since the three primary locators make a plane, independent of the shape complexity of the part, the corresponding contact points on the primary feature datum become a plane. Thus, to generate different datum orientations based on pre-selected points \( \varvec{S} = \left\{ {\left( {\varvec{X}_{s} ,\varvec{Y}_{s} ,\varvec{Z}_{s} } \right) \in {\mathbb{R}}^{3} } \right\} \), equation of a plane with coefficients \( a,b,c \) and \( d \) can be considered. Thus, for a given \( \varvec{X}_{s} \) and \( \varvec{Y}_{s} \), a new \( \varvec{Z} '_{s} \) value is derived from
and the new datum points then become
Further, the RMSE between the measured surface and the surface generated by the SNN \( {\boldsymbol{\mathcal{N}}} ' \) is estimated by
Since locator-induced and tooltip-induced variations can give the same position of a machined surface, to increase the accuracy of the prediction, two or more machined features in the same setup can be used as inputs. Minimizing the sum of RMSEs of the features, while keeping the worst locator, tooltip and datum deviations as constraints, provides the magnitudes of the source of variation. Mathematically,
The optimal outputs \( \varvec {d}^{1 \ldots L} \), \( d^{tt} \), and \( {\varvec{\mathcal{M}}}' \) through \( a, b,c \) and \( d \), become the deviations of the variation sources. Figure 7 summarizes the steps to estimate the variation source deviations iteratively, by reducing the difference between SNN-based prediction and scanned feature.
Demonstration case
This paper extends a 2D case study presented in Abellán-nebot et al. (2013) by adding cylindrical and torus features while considering the 3D variation, as shown in Fig. 8. Feature A was machined in Station 1 and features B, C, D, E and F were machined in Station 2. The results reported below will emphasize on feature E, as it is relatively difficult to predict its complex geometry.
Machining simulation
First, multiple machining simulations with induced errors were performed to generate the would-be machined part. The part model was assembled to the primary, secondary and tertiary locators in sequence. In Station 1, a set of coplanar points were used as cutting-points and as representation of the Feature A. The position of the coplanar points was used to delineate the parts’ points that were below and above. To perform machining simulation for Station 2, the cutting points for each feature were set to prespecified depth of cut and dimensions of the feature. Based on the position of the cutting features, the points that were above, below, inside or outside the features were delineated accordingly. Moreover, a set of three landmark points, arbitrarily placed in space, were used to track the transformation of the model on and off the locators. Figure 9 shows the simulation result, where the star points were used to cut and represent the machined surface. Moreover, the simulation accuracy was validated against stream of variation model using the inputs provided in a case study reported in Abellan-Nebot et al. (2012b), which the simulation prediction was within 0.025%. The approach independent of the toolpath generation algorithms and their effect on the part. The simulation focuses on the deviation of the tool from nominal toolpath, which is assumed to be constant per operation.
To generate a labelled training data, multiple simulation experiments were completed by assembling the SMSs to the 6 locators and machining by corresponding features. The point cloud of a nominal model was used as stock in the first station, from which 40 samples were generated. The datum and machined surfaces were represented by 100 points each; the X, Y, and Z deviations were arranged in the form of \( \varvec{d}_{k} = (\varvec{d}_{k}^{X,1 \ldots 100} ,\varvec{d}_{k}^{Y,1 \ldots 100} ,\varvec{d}_{k}^{Z,1 \ldots 100} ) \), which along with the locator deviations became inputs to the SNN. The locator and tooltip deviations were sampled from uniform distribution \( {\mathbf{\mathcal{U}}}\left( { - 0.1, 0.1} \right) \). Similarly, for Station 2, using the 40 samples of Station 2 as inputs, each sample was simulated 40 times, generating 1600 samples in 10.9 min. The samples became the training data for predicting the machined features. The samples were generated by following Algorithm 1 and the training conducted using the Deep neural network toolbox of MATLAB 2018a. In this paper, a 3.50 GHz, 4 Cores, Intel® Xeon® CPU with Windows 10 operating system and NVIDIA GPU Quadro P2000 was used to generate the simulation data and train the SNN models.
Prediction of geometric characteristics
Based on the training data obtained from the machining simulation, a feedforward neural network was trained using conjugate gradient algorithm in a GPU enabled parallel computing machine. The networks were structured in the form of 317–15–100, where the 15 hidden layers were determined based on the ability of the model to generalize on previously unseen data, as shown in Fig. 10. Similarly, a dataset of 1600 samples was selected based on the lowest mean squared error, at a cost of extra 2 min from the optimal training time, as shown in Fig. 11 The inputs 317 predictors included the 6 locator deviations, a tooltip deviation, the X, Y, and Z values of 100 points, difference between secondary locators’ points (ignoring 2 constant values), and 9 transformation matrix elements (ignoring the diagonal elements). The transformation matrix elements were generated using the 6 locators in a SNN architecture of 6–5–9.
Further, in all the cases, 70%, 15%, and 15% of the generated data were used for training, validation and testing data, respectively. In all the cases, the training termination criteria was set to a maximum validation performance of 50, maximum epochs of 10,000 and minimum gradient of 10−8. The training result of all the features, a total of 18 models, ranged 10−7–10−6 mean squared error, 6000-8000 epochs and 2–5 min to compete. Due to probabilistic nature of the neural networks, the values were slightly be different at every training session Moreover, the training result of the models yielded a correlation close to 1, between the machining simulation output (target) and actual output of the SNN model, with minimal prediction error, as shown in Fig. 12. This indicates that the output of the SNN is close to the training data.
To further test the trained model in predicting the geometric deviations of feature E, an unseen inputs of (0.0958, 0.0055, 0.0940, − 0.0016, − 0.0808, 0.0899, 0.0340) mm for Station 1 and (0.0236, − 0.0517, 0.0540, 0.0359, 0.0970, − 0.0475, 0.0339) mm for Station 2 were used. The predicted deviations were then added to the nominal points to get the predicted feature’s points, which took around 2 ms to generate. From Figs. 12c and 13a it can be deduced that the prediction error was less than 1%.
Moreover, to test the algorithm on more complex shapes, a free form surface shown in Fig. 14. was trained and tested, The feature, referred as Feature G in this paper, has the dimensions of Feature B and flatness value of 7.4 mm. The training result were similar to the one achieved using the features B–E. Figure 15 show the comparison of the test data and the prediction made by the trained SNN.
Variation source identification
To demonstrate the proposed variation source identification method, a point cloud of the model shown in Fig. 9 was considered. The point cloud was generated by machining simulation with arbitrary deviations values, with the main goal of estimating the deviation values given machined features B–F.
Thus, in organizing the optimization input parameters, datum plane coefficients \( (a, b, c, d) \), locator and tool deviations, whose constraints set between − 0.1 and 0.1 mm, and the coefficient \( d \) between 42 and 46, as formulated in Eq. 16. Then using the Matlab’s fmincon sqp solver, the RMSE between the simulated features and SNN generated features was minimized. On average it took 3.3 s per feature for the solver to converge. The results of the solver based on an arbitrary sample with machined features B to F, with and without datum information, are shown in Fig. 16. In Fig. 16a, the estimated plane coefficient \( d \) has relatively high variation that affects the position of the datum plane. However, it is worth noting that the coefficient has limited importance when it comes to subsequent analysis that focus on the orientation aspects only.
Discussion
Since every physical machining operation is first simulated, it is a plus to include variation analysis capability in the simulation tool for a more realistic result. In this paper, a SNN was used to generate a function that relates the source of variation to the machined surface; the function can be embedded to commercial simulation platforms, without the need to include the associated point cloud.
Moreover, the simulation is performed in such a way that all features of a sample are virtually machined per setup. Specifically, the computational cost of generating training data was 0.4 s per sample and the training time of 2–5 min, while the prediction made by the trained model was 0.01 s per sample. The computational advantages of using the trained model instead of simulation becomes noticeable by a user when performing experiment that require large number of runs, such statistical tolerance analysis and solving optimization problems. From users’ perspective, the time saving gained when the trained models are used continuously is likely to outweigh the cost of preparing training data and training time. Figure 17 summarizes the training time per feature to achieve a certain level of mean time squared error.
However, multiple assumptions have been made in developing the machining simulation. The fixture was reduced to a set of single point locators. The simulation model started out from a nominal model, with the assumption that the combined effect of fixture and datum deviation of the station can be obtained by increasing or decreasing locator deviations. Nevertheless, the nominal model can be replaced by a scanned model when available. Further, the surface texture and material characteristics of the part are not included in the simulation. A method to include such aspects would make the simulation complete. Nevertheless, from variation analysis point of view, surface texture has no functional meaning, especially under large forces. Furthermore, only the translation aspect of the cutting tool deviation was considered, ignoring potential cutting tool’s orientation deviation. To validate the machining simulation approach as well as the SNN-based geometry prediction, a commercial CAM simulation tool was utilized. The setup shown in Fig. 18 was used for machining simulation in Station 2; the locator deviations along with tooltip deviations and a model that was machined in station 1 were used as inputs. (The actual output model from station 1 is not shown in Fig. 18 for a better visualization). Using arbitrary deviations shown in Table 1, the outputs of the machining simulation on point cloud and SNN- based prediction gave parallelism error within 6.5% of the simulation result of a commercial software, Autodesk Inventor HSM CAM.
Furthermore, the proposed approach of variation source identification applies pattern matching technique that iteratively matches a SNN generated surface to the actual (or simulated) data points of a single stage. To test the accuracy of the estimated variation sources relative to testcases, 20 samples from each of the features B to F and the combination B, E, and F, 140 samples in total, were iteratively estimated using their respective pre-trained SNN models and optimization solver. Figure 19a shows the errors between the SNN-based prediction and the actual values of the sources of variation, when datum deviations are unknown. Most of the errors were contributed by the datum coefficients and tooltip deviations. Even though, the error of the datum plane coefficients is small compared to the constraints’ range, a small error significantly affects the estimated tooltip deviation value. However, the reliability can significantly be increased, as shown in Fig. 19b, when the datum feature is extracted from a point cloud data of a scanned part. The locator and tooltip deviations were estimated at an error of less than 1%. Empirically, the trained SNN models should have at least 15 µm geometry prediction accuracy to be reliable in variation source identification.
Moreover, it important to embed the information about the vector connecting the secondary locators and the transformation matrix after assembling nominal datum to the primary locators in the trained model. Figure 20 shows the accuracy improvement in the estimation of variation sources’ deviations when considering these information.
Conclusion
Variation modelling has a significant importance in processes planning, variation source identification, and tolerance synthesis and analysis. This paper showed how to apply a multilayer shallow neural network to predict the geometric characteristics of machined parts and estimate the variation source’s deviation in a multistage machining setting. To predict geometric shapes, a method for machining simulation on a point cloud was introduced and applied to a two-stage machining line. The resulting point cloud data, along with the induced locator and tooltip deviations, were used to train multiple SNN regression models. The trained models could predict their respective geometries at an error of less 1% in around 2 ms, for input data that the models have never seen before. The SNN-based approach has the potential to be an alternative to the mathematically complicated formulation of variation propagation models and the very slow CAM simulation-based generation of geometric models with variation. Further, such approach overcomes the current difficulty of processing point cloud data in CAD environment.
Moreover, based on the SNN generated geometry and process parameters as constraints, a linear programming model was formulated, and the associated parameters optimized. The magnitude of deviation of locators and tooltip could be estimated at an error of 4.25% and 1% when datum deviation is unknown and known, respectively, in about 3.3 s.
Despite the stated advantages, the shallow learning-based approaches are not deterministic in nature, and thus each trained model can yield slightly different results. Each point is predicted individually, which may induce variation as high 5 µm to some points. In future work, ways to improve the prediction accuracy by embedding transformation matrices due to datum deviations will be investigated.
References
Abellan-Nebot, J. V., Liu, J., & Subiron, F. R. (2012a). Stream-of-variation based quality assurance for multi-station machining processes—Modeling and planning. In Statistical and computational techniques in manufacturing (Vol. 9783642258, pp. 55–99). Berlin: Springer. https://doi.org/10.1007/978-3-642-25859-6_2
Abellan-Nebot, J. V., Liu, J., Subirón, F. R., & Shi, J. (2012b). State space modeling of variation propagation in multistation machining processes considering machining-induced variations. Journal of Manufacturing Science and Engineering, 134(2), 1–13. https://doi.org/10.1115/1.4005790.
Abellán-Nebot, J. V., Romero Subirón, F., Serrano Mira, J., Romero, F., Julio, S., & Mira, S. (2013). Manufacturing variation models in multi-station machining systems. International Journal of Advanced Manufacturing Technology, 64(1–4), 63–83. https://doi.org/10.1007/s00170-012-4016-4.
Anwer, N., Ballu, A., & Mathieu, L. (2013). The skin model, a comprehensive geometric model for engineering design. CIRP Annals—Manufacturing Technology, 62(1), 143–146. https://doi.org/10.1016/j.cirp.2013.03.078.
Anwer, Nabil, Schleich, B., Mathieu, L., & Wartzack, S. (2014). From solid modelling to skin model shapes: Shifting paradigms in computer-aided tolerancing. CIRP Annals—Manufacturing Technology, 63(1), 137–140. https://doi.org/10.1016/j.cirp.2014.03.103.
Bourdet, P., & Clement, A. (1988). A study of optimal-criteria identification based on the small-displacement screw model. CIRP Annals—Manufacturing Technology, 37(1), 503–506. https://doi.org/10.1016/S0007-8506(07)61687-4.
Burke, L. I., & Rangwala, S. (1991). Tool condition monitoring in metal cutting: A neural network approach. Journal of Intelligent Manufacturing, 2(5), 269–280. https://doi.org/10.1007/BF01471175.
Girardeau-Montaut, D., Roux, M., Marc, R., & Thibault, G. (2005). Change detection on points cloud data acquired with a ground laser scanner. International Archives of Photogrammetry, Remote Sensing and Spatial Information Sciences, 36(part 3), W19.
Guo, J., Li, B., Liu, Z., Hong, J., & Wu, X. (2016). Integration of geometric variation and part deformation into variation propagation of 3-D assemblies. International Journal of Production Research, 7543(March), 1–14. https://doi.org/10.1080/00207543.2016.1158881.
Henzold, G. (2006). Geometrical dimensioning and tolerancing for design, manufacturing and inspection: A handbook for geometrical product specification using ISO and ASME standards. Amsterdam: Elsevier.
Hu, H., Tang, B., Gong, X., Wei, W., & Wang, H. (2017). Intelligent fault diagnosis of the high-speed train with big data based on deep neural networks. IEEE Transactions on Industrial Informatics, 13(4), 2106–2116. https://doi.org/10.1109/TII.2017.2683528.
Huang, W., & Ceglarek, D. (2002). Mode-based decomposition of part form error by discrete-cosine transform with implementation to assembly and stamping system with compliant parts. CIRP Annals, 51(1), 21–26.
Hunter, D., Yu, H., Member, S., Pukish, M. S., Member, S., Kolbusz, J., et al. (2012). Selection of proper neural network sizes and architectures—A comparative study. IEEE Transactions on Industrial Informatics, 8(2), 228–240. https://doi.org/10.1109/TII.2012.2187914.
Ibaraki, S., & Yoshida, I. (2017). A five-axis machining error simulator for rotary-axis geometric errors using commercial machining simulation software. International Journal of Automation Technology., 1, 1. https://doi.org/10.20965/ijat.2017.p0179.
Jain, A. K. (2010). Data clustering: 50 years beyond K-means q. Pattern Recognition Letters, 31(8), 651–666. https://doi.org/10.1016/j.patrec.2009.09.011.
Kim, D., Kim, T. J. Y., Wang, X., Kim, M., Quan, Y., Oh, J. W., et al. (2018). Smart machining process using machine learning: A review and perspective on machining industry, 5(4), 555–568. https://doi.org/10.1007/s40684-018-0057-y.
Lecun, Y., Bengio, Y., & Hinton, G. (2015). Deep learning. Nature. https://doi.org/10.1038/nature14539.
Li, X., Zhang, W., Ding, Q., & Sun, J. Q. (2018). Intelligent rotating machinery fault diagnosis based on deep learning using data augmentation. Journal of Intelligent Manufacturing. https://doi.org/10.1007/s10845-018-1456-1.
Liu, W., Wang, Z., Liu, X., Zeng, N., Liu, Y., & Alsaadi, F. E. (2017). A survey of deep neural network architectures and their applications. Neurocomputing, 234(October 2016), 11–26. https://doi.org/10.1016/j.neucom.2016.12.038.
Liu, J., Zhang, Z., Ding, X., & Shao, N. (2018). Integrating form errors and local surface deformations into tolerance analysis based on skin model shapes and a boundary element method. CAD Computer Aided Design, 104, 45–59. https://doi.org/10.1016/j.cad.2018.05.005.
Mantripragada, R., & Whitney, D. E. (1999). Modeling and controlling variation propagation in mechanical assemblies using state transition models. IEEE Transactions on Robotics and Automation, 15(1), 124–140. https://doi.org/10.1109/70.744608.
Penedo, F., Haber, R. E., Gajate, A., & Toro, R. M. (2012). Hybrid incremental modeling based on least squares and fuzzy-NN for monitoring tool wear in turning processes. IEEE Transactions on Industrial Informatics, 8(4), 811–818. https://doi.org/10.1109/TII.2012.2205699.
Samper, S., & Cedex, A. V. (2019). Form defects tolerancing by natural modes analysis. Journal of Computing and Information Science in Engineering, 7(March 2007), 44–51. https://doi.org/10.1115/1.2424247.
Schleich, B., Anwer, N., Mathieu, L., & Wartzack, S. (2014). Skin model shapes: A new paradigm shift for geometric variations modelling in mechanical engineering. CAD Computer Aided Design, 50, 1–15. https://doi.org/10.1016/j.cad.2014.01.001.
Schleich, B., Anwer, N., Mathieu, L., & Wartzack, S. (2016). Status and prospects of skin model shapes for geometric variations management. Procedia CIRP, 43, 154–159. https://doi.org/10.1016/j.procir.2016.02.005.
Schleich, B., Anwer, N., Mathieu, L., & Wartzack, S. (2017). Shaping the digital twin for design and production engineering. CIRP Annals—Manufacturing Technology, 66(1), 141–144. https://doi.org/10.1016/j.cirp.2017.04.040.
Schleich, B., & Wartzack, S. (2014). How can computer aided tolerancing support closed loop tolerance engineering? Procedia CIRP, 21, 312–317. https://doi.org/10.1016/j.procir.2014.03.129.
Schleich, B., & Wartzack, S. (2015). Approaches for the assembly simulation of skin model shapes. CAD Computer Aided Design, 65, 18–33. https://doi.org/10.1016/j.cad.2015.03.004.
Schleich, B., & Wartzack, S. (2016). A quantitative comparison of tolerance analysis approaches for rigid mechanical assemblies. Procedia CIRP, 43, 172–177. https://doi.org/10.1016/j.procir.2016.02.013.
Schleich, B., & Wartzack, S. (2017). Challenges of geometrical variations modelling in virtual product realization. Procedia CIRP, 60, 116–121. https://doi.org/10.1016/j.procir.2017.01.019.
Shi, J. (2006). Stream of variation modeling and analysis for multistage manufacturing processes. Boca Raton: CRC Press. https://doi.org/10.1201/9781420003901.
Srinivasan, V., & Heights, Y. (1999). Role of statistics in achieving global consistency of tolerances. In F. van Houten & H. Kals (Eds.), Global consistency of tolerances (pp. 395–404). Dordrecht: Springer.
Tian, Z. (2012). An artificial neural network method for remaining useful life prediction of equipment subject to condition monitoring. Journal of Intelligent Manufacturing, 23(2), 227–237. https://doi.org/10.1007/s10845-009-0356-9.
Villeneuve, F., Legoff, O., & Landon, Y. (2001). Tolerancing for manufacturing: A three-dimensional model. International Journal of Production Research, 39(8), 1625–1648. https://doi.org/10.1080/00207540010024104.
Wang, G., & Cui, Y. (2013). On line tool wear monitoring based on auto associative neural network. Journal of Intelligent Manufacturing, 24(6), 1085–1094. https://doi.org/10.1007/s10845-012-0636-7.
Wang, K., Du, S., & Xi, L. (2019). Three-dimensional tolerance analysis modelling of variation propagation in multi-stage machining processes for general shape workpieces. International Journal of Precision Engineering and Manufacturing, 21(1), 31–44. https://doi.org/10.1007/s12541-019-00202-0.
Wang, J., Ma, Y., Zhang, L., Gao, R. X., & Wu, D. (2018). Deep learning for smart manufacturing: Methods and applications. Journal of Manufacturing Systems. https://doi.org/10.1016/j.jmsy.2018.01.003.
Wu, J., Qiao, L., & Huang, Z. (2018). Deviation modeling of manufactured surfaces from a perspective of manufacturing errors. The International Journal of Advanced Manufacturing Technology. https://doi.org/10.1007/s00170-018-2305-2.
Wu, J., Qiao, L., Zhu, Z., & Anwer, N. (2017). A novel representation method of non-ideal surface morphologies and its application in shaft-hole sealing simulation analysis. Proceedings of the Institution of Mechanical Engineers, Part B: Journal of Engineering Manufacture. https://doi.org/10.1177/0954405417738284.
Yacob, F., Semere, D., & Nordgren, E. (2018). Octree-based generation and variation analysis of skin model shapes. Journal of Manufacturing and Materials Processing, 2(3), 52. https://doi.org/10.3390/jmmp2030052.
Yan, X., & Ballu, A. (2017). Generation of consistent skin model shape based on FEA method. The International Journal of Advanced Manufacturing Technology. https://doi.org/10.1007/s00170-017-0177-5.
Zhang, M. (2012). Discrete shape modeling for geometrical product specification: Contributions and applications to skin model simulation. Ph.D. thesis. École normale supérieure de Cachan-ENS Cachan.
Zhang, Z., Wang, Y., & Wang, K. (2013). Fault diagnosis and prognosis using wavelet packet decomposition, Fourier transform and artificial neural network. Journal of Intelligent Manufacturing. https://doi.org/10.1007/s10845-012-0657-2.
Zhang, Z. Z., Zhang, Z. Z., Jin, X., & Zhang, Q. (2017). A novel modelling method of geometric errors for precision assembly. International Journal of Advanced Manufacturing Technology. https://doi.org/10.1007/s00170-017-0936-3.
Zhou, Shiyu, Chen, Yong, & Shi, Jianjun. (2004). Statistical estimation and testing for variation root-cause identification of multistage manufacturing Processes. IEEE Transactions on Automation Science and Engineering, 1(1), 73–83. https://doi.org/10.1109/TASE.2004.829427.
Acknowledgements
This work was supported by Innovair/SMF – 2019 project, VINNOVA Diar. nr. 2019-02881 under Produktion2030 program. The authors thank VINNOVA and the Produktion2030 program for supporting the project.
Funding
Open access funding provided by Royal Institute of Technology.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Yacob, F., Semere, D. A multilayer shallow learning approach to variation prediction and variation source identification in multistage machining processes. J Intell Manuf 32, 1173–1187 (2021). https://doi.org/10.1007/s10845-020-01649-z
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10845-020-01649-z