## Abstract

Complex systems are expected to play a key role in the progress of Prognostics Health Management but the breadth of technologies that will highlight gaps in the dynamic regimes are expected to become more prominent and likely more challenging in the future. The design and implementation of sophisticated computational algorithms have become a critical aspect to solve problems in many prognostic applications for multiple regimes. In addition to a wide variety of conventional computational and cognitive paradigms such as machine learning and data mining fields, specific applications in prognostics have led to a wealth of newly proposed methods and techniques. This paper reviews practices for modeling prognostics and remaining useful life applications in complex systems working under multiple operational regimes. An analysis is provided to compare and combine the findings of previously published studies in the literature, and it assesses the effectiveness of techniques for different stages of prognostic development. The paper concludes with some speculations on the likely advances in fusion of advanced methods for case specific modeling.

## Introduction

In recent years, machinery systems are becoming ever more complex and require new expertise in terms of safety and performance. A complex system is composed of many components that are interrelated and interacting elements forming a complex whole [1]. Condition monitoring of such advanced systems can be used to recognise any potential problems at an early stage and therefore reduce the risk of failures. However, the data are monitored from various sensors of components and their interpretation is often challenging because of the complicated inter-dependencies between monitored information and actual system conditions [2]. Moreover, the operational conditions and regimes force some systems to operate under dynamic operational margins. The health degradation of such systems is not always deterministic, and commonly multi-dimensional [3]. The data streams are monitored from various channels [4] and advanced decision-making processes are required to model the multidimensional health degradation phenomena [5].

The challenges brought up by the complexity of real-world applications should be considered during the development and test of a new prognostic model [6]. The literature has recognised the importance of complexity by proposing different algorithms for the multiple axes of information and multidimensional data. However, there is still a lack of information and analysis in such techniques, leaving the field with yet more requirements for further research, particularly on the common issues of incomplete understanding of multi-dimensional mechanisms failure modes [7].

## Background and Prognostic Definitions

Assuming a system is in proper working order before its use and no maintenance is necessary, it starts to operate with a specific initial health level that is mostly stable during the early periods of operations. This stability continues until a critical stage where an early incipient distortion occurs, and then the risk of failure grows with time. When a prognostic algorithm is developed, the main goal is to estimate this failure time, at which the system cannot operate under desired conditions [8]. This estimation is a statement about an uncertain event in the future but it is based on the fundamental notions of systems’ deterioration, monotonic damage accumulation, pre-detectable ageing symptoms and their correlation with a model of system degradation [4]. With regard to these notions, a prognostic framework detects, diagnoses, and analyses system deterioration with the goal of estimation of the remaining useful life (RUL) before the failure. The accuracy of RUL estimations is a key notion in condition based maintenance strategies, and it also has a critical value to improving safety, reliability, mission scheduling and planning and lowering costs and down time [9]. The deviation between actual time-to-failure (ATTF) and the estimated time-to-failure (ETTF) is of critical importance to this accuracy.

ATTF, or commonly known as True Remaining Useful Life, is an unknown future variable that can only be known after occurrence of failure [10]. ETTF, on the other hand, is the amount of time from the current moment to the systems’s functional failure [11]. As defined by the industry standard ISO-13381 [12], ETTF along with the risk of failure modes is the basic definition of prognostics. Therefore, it is generally the principal centre of prognostic studies and the estimation of RUL [13]. Accordingly, it is defined as [14]:

where *X* is the RUL variable and *Z* is the preceding condition profile until current age (*t*). The time units used in the measurement are related with the nature of operations such as cycles in commercial aircrafts, hours of operation in jet engines, kilometres or miles in automobiles [4].

When this conditional variable corresponds to ETTF, it is defined as:

Figure 1 shows a typical system deterioration model in which a healthy system with a certain level of initial health starts to degrade after an initial problem in the system, and eventually reaches a critical functional failure state [7, 15, 16]. The point of potential failure starts an exponential change of state from the stable zone with minimum deterioration to a functional failure of the system. The health degradation can be found by the condition-monitoring readings that exceed the alarm limit of potential failure. The act of prognosing the course of degradation is between the initial detection and the failure conditions [17] and follows sequential major processes of “data pre-processing”, “existing failure mode”, “future failure mode” and “post-action prognostics” [18].

In the data pre-processing stage, the system information is first received from sensors and then the features indicating fault conditions are defined. The existing failure mode applies the failure mode analysis to determine the failure effects of these features for feature extraction and fault classification. In the future failure mode, multi-step ahead estimations are performed using the fault evolution and predict RUL of the system. Then, the post-action prognostics proposes the maintenance actions that need to be done after RUL estimation.

One of the most significant issues of prognostics is utilizing the data which is versatile and falls into various categories. These include value type of single value collected at a specific epoch, waveform type of condition monitoring variable time series and multidimension type of time series from multiple operating conditions [19].

When one considers the computational prognostic algorithms under dynamic regimes, special attention is given to the multidimension type data due to the operational differences between the regimes [20]. In these complex cases, the systems are formed by various interacting components and the common system behavior cannot be easily deduced from individual elements so that the predictability of system is limited and the responses do not scale linearly [21].

In Fig. 2, a randomly generated sample of multidimensional trajectory is shown. The data is represented as a 3-tuple of “ regimes (\(\mathbf {D_b}\)) with the number of *M*”, “regime levels (\(\mathbf {L_b}\))” and “a single sensor measurement (\(x_{1:r}\))”. Such multidimensional condition monitoring data is always in need of extensive signal processing to produce meaningful information.

A multidimensional data set is formed by hierarchies of dimension levels [22]. To simulate these hierarchies, let \(\mathbf {\Omega }\) be the space of all dimensions and \(\mathbf {\Psi }\) be the space of all dimension levels. For each regime level (dimension) *D*, there is a set of regime values belonging to it. With regard to these, a basic multidimensional data set of \(\mathbf {C_b}\), can be represented as a 3-tuple [22]:

where;

is a list of regimes \((D_i,M \in \mathbf {\Omega })\) and *M* is a dimension that represents the unique values in \(\mathbf {D_b}\) and also the measure of \(C _b\).

is a list of regime levels and boundaries \((DL_{bi},^{*}ML \in \mathbf {\Psi })\). *ML* is the multi-valued dimension and boundaries level of the measure of \(C _b\). As the *M* can only have certain regime values, *ML* can only have the same number of dimension levels.

\(\mathbf {R_b}\) is a set of condition monitoring data and it is formed of multiple regimes and regime levels according to *M* and *ML*.

In order to estimate the system failure time (\(t_b\)) in this multi dimensional cell data, a function of health measure (*H*) needs to be evaluated [23].

where *t* is the current time and \(t_b\) the functional failure time. For a single monitored sensor channel with *r* number of monitored sensor points, the expression can be redefined as:

where the monitored observations are over some life distance, \(\varDelta \theta\) and the number of signals (*p*) are multiple. Therefore, the values of observations will substantially change [23].

These multiple multivariate raw sensor readings (\(R_{mn}\)) also contains noise. Referring to a single sensor readings as in equation 8, the condition monitoring data with the noise and/or the measurement uncertainties \(\varepsilon\) is defined as:

where \(\varepsilon\) is assumed to be Gaussian white noise (in analogy to white light having uniform emissions at all frequencies) and its distribution is identical, statistically independent and uncorrelated [24,25,26]. The probability density function of (\(\varepsilon\)) is given by:

where \(\mu\) and \(\sigma\) represent the mean value and the standard deviation in the normal distribution. [27].

## Review of Prognostic Methods

As discussed in the introduction section, RUL prediction methods need further analysis, and therefore the categorization of prognostic techniques, particularly around the issue of multidimensionality, proved to be challenging. The increasing complexity of systems will prompt prognostic tools and methods willing to adopt evolving technologies, ultimately resulting in generation of more accurate estimates in different domains. With regard to to the way that they participate in estimation, the prognostic methods can be defined into three main categories of physics-based, knowledge-based and data-driven approaches [7, 9, 28, 29].

Figure 3 shows the different prognostic categories and their subtypes. The purpose of such categorization is to ensure that the discipline is established in a manner which is consistent with the operational and system-related objectives.

### Physics-Based Models (PbM)

A typical PbM attempt to describe the evolution of deterioration based on a comprehensive mathematical model defining the physics-of-failure and degradation of system performance [28]. In such a model, the interactions between the system and the failure mechanism are formulated by using a combination of fault growth equations and knowledge of the principles of damage mechanics relevant to the monitored system. Crack growth modelling has been a common PbM approach in which it is assumed that an accurate mathematical model can provide knowledge for prognostic outputs. The Paris and Erdogan Law [30] is used in several crack growth modelling applications [24, 31,32,33]. The model relates the stress intensity factor range to crack growth under a fatigue stress regime.

where *a* is the crack length, *C* and *m* are constants of material characteristics, environment and stress ratio, \(\varDelta K\) is the range of stress intensity factor during the fatigue cycle and \(\frac{da}{dN}\) is the crack growth rate.

Other well-known PbM appraches also use Forman Law [34], Yu-Harris life equation for fatigue spall initiation and the Kotzalas-Harris model for failure progression estimation [35,36,37] and finite element analysis [38]. These applications have been applied in multiple domains, despite the wide variation in individual elements over the domain. The main challenge to apply PbM in “complex systems under dynamic regimes” is that these methods are mostly suitable for specific purposes and components rather than the complexity as a whole [39]. Due to their nature of being component specific, these prognostic models are hard to apply to alternative domains and most PbM are at component or subsystem level [40]. In the case of complex systems and multidimensional data, it is computationally expensive to describe the behavior of the system with different equations and identification of failure modes under different operating regimes requires extensive experimentation which is often built on a case-by-case basis [41].

### Knowledge-Based Models (KbM)

KbM prognostics predict RUL from historical events by evaluating the similarity between a monitored case and a library of previously known failures [42]. When there is not an accurate mathematical model, KbM methods without requiring any physical modelling or prior principles are functional applications where the historical failure information of systems are available [43]. The common methods in KbM mimic human-like representation and reasoning such as “expert systems” [44, 45] and “fuzzy logic” [46,47,48].

On the other hand, the similarity-based prognostics, an alternative KbM method, can overcome the mimicking difficulties by removing the requirements to model the experience of a domain expert. Due to a potential relation to this removal, this method is occasionally classified under data-driven models by several studies [41, 49, 50]. However, it follows the certain KbM characteristics of similarity evaluation between monitored cases and the use of case library.

The common similarity evaluation methods use a set of complete run-to-failure operational patterns for RUL estimation of incomplete (test) degradation patterns [6, 26, 51,52,53]. The pairwise distance between complete (*q*) and incomplete patterns (*p*) is used to find the best matching units which is then used as the basis for RUL estimation.

This method can also be applied into RUL estimation of complex systems but they initially require systematized dimensionality reduction and data-processing methods. Therefore, they are commonly used with data-driven approaches.

Figure 4 shows a sample of similarity based prognostics. The training data before the minimum distance locations are removed, and the rest of trajectories are accepted as the RULs.

### Data-Driven Models

In data-driven prognostics, the condition-monitoring data received from system indicators are regularly processed and analyzed. Unlike the PbM and KbM, they use systems’ own condition monitoring data rather than mathematical models or human expert models. A typical data-driven example includes the determination of precursors of failure and estimating RUL by considering historical records and estimation outputs from monitoring data [43]. These models have been found to be more effective in many operational cases and particularly in complex systems due to their simplicity in data handling and consistency in complex processes [39].

Data-driven approaches range from conventional stochastic and statistical methods to advanced black-box and deep learning methods. When one considers an ideal data-driven prognostic framework, one or more of these learning techniques should be included in the model.

#### Stochastic Algorithms

Stochastic data-driven prognostics are commonly Bayesian-based approaches and estimate the state of a process by a minimum prediction covariance recieved from measurements. They result in a probability distribution of RUL rather than precise estimations, and can estimate both current and future states of nonlinear systems as well as the RUL by tracking the degradation growth before the failure threshold [54].

In Bayes’ theorem, the probability of an event (*P*(*A*)) is defined by prior knowledge related with that event. This forms a reference point for updating estimations with due consideration of relevant evidence [55].

where \(A\) and \(B\) are two different observable events and the probability of \(B\), \(P(B) \ne 0\) .

If there is available condition monitoring data, a Bayesian network using the above mentioned theorem can model the degradation growth over time for prognostic forecasting. The most common types of these networks are Particle filters [54, 56,57,58,59,60], Kalman filters [61,62,63] and hidden Markov models [64,65,66,67,68].

In particle filtering , the Bayesian theorem is used to approximate the conditional state probability distribution using a swarm of points samples (particles) that have potential information of unknown parameters. This approximation is based on a state transition function \(f_s\) and a measurement function \(f_m\).

where \(\dot{\varepsilon }\) and \({\varepsilon }\) are process and measurement noise, *x* is the damage state, *z* is measurement data, *p* is model parameters and *t* is time [57].

With regard the Bayesian theorem, this approximation can be expressed as:

and can be recursively done in estimation and update stages of particle filtering where the computations are carried out by Monte Carlo sampling.

When “\(f_s\) ” is accurately defined to a damage model representing system dynamics, the particle filtering can be applied into nonlinear systems. Kalman filtering, on the other hand, is a better choice in a linear system due to its lower computational requirements. The state and measurement equations reduce to the following forms [69].

where \(\dot{\varepsilon }\) and where ** Fs** and

**are respectively the state evolution and measurement matrices. They are assumed to be known and, with them, the Kalman filter model estimates the state of a process and minimizes estimation covariance by adding the measurement related to the state.**

*Fm*Hidden Markov Models are simpler Bayesian networks comparing to particle and Kalman filtering methods. They assume that an observation at “*t*” is generated by some process whose state \(P ({x})\) is hidden from the observer and the state of this hidden process satisfies the Markov property in which future behavior is predicted from the current or present behavior [70].

The Bayesian network models require accurate degradation modeling for prognosis and have difficulties with multidimensional data. The regime of a damage state at any given time instant may not match with the upcoming regimes and conditions. Therefore, a prior data processing stage is necessary to apply these models. Also, there might be difficulties in describing the damage behavior of multiple sensor data which might have different fault types and states.

#### Statistical Algorithms

In statistical data-driven models, the results are precise estimations rather than a probability distribution, and the damage progression is based on condition monitoring data. The common prediction samples of this type are the relatively simpler trend extrapolation methods in which the health degradation is associated with a single dimensional time series which is assumed to follow a monotonic trend [71,72,73].

Figure 5 shows various extrapolation methods of curve fitting. Single degradation parameters are plotted as a function of time and a threshold level is predefined to decide the failure point. Although the estimation differences in these models may not be significant for mature samples which are close to failure, this will not be be the case for samples in their early lifetime.

Autoregressive moving average models are also widely used time series forecasting methods [74]. They fit the data to a parametric time series model and extract features based on this. The model first fit the curve in moving average part, and then adds it to the autoregressive model output to estimate the future behaviour [41]. Considering a time series \(x=1:t\), the model with autoregressive model of order *P* and the moving average model of order *Q* is expressed as:

where \(\phi\) and \(\Theta\) are respectively auto-regressive and moving average terms [75]. Such a method is generally suitable for short-term predictions but it does not provide reliable long term estimations due to its sensitivity to initial conditions and the systematic errors in the predictor [74].

*Dimensionality Reduction:*

All the time series prediction and life estimation models introduced so far show that they lack the ability to deal with multidimensional failure mechanisms and further data processing methods are required before RUL estimation. The multidimensional time series are inconsistent with each other and operate under different regimes and conditions. Therefore, they need a feature extraction transformation from high-dimensional (multi regime) space to a space of single health level dimension (single regime) [53]. Such dimensionality reduction will standardize the time series from their actual regime domains to a notionally common domain that will provide meaningful information for prognosis.

Figure 6 illustrates a dimensionality reduction process for a single sensor. The data is standardized and transformed in a form that there is only one valid regime for all sensors.

The “regression” models are one of the common models that can effectively used for both feature extraction and dimension reduction. In these applications, the multi-regime data is mapped into a lower-dimensional space where all measurement findings are maximized. In similar complex system domains, such models have been applied for standardization of the multi-regime data into a single space for further time series prediction and estimation models [52, 53, 76, 77].

A typical sample of these category, the multiple linear regression, is based on the calculation of the relationship between multiple explanatory inputs and a predefined target. The model fits a linear equation to monitored data and based on the following formula [78, 79].

where *y* is the target vector, *x* is the input and \(\beta\) is the coefficient estimates. When one considers *n* number of time series, the equation is expressed as:

As the complex models include multivariate time series and multiple signals, the formula is modified by considering *x* as a matrix rather than a vector.

Considering that a data set is formed of multiple operating conditions and fault modes with unknown characteristics, the above-mentioned “regression” model can perform the feature extraction and standardization by applying the calculated coefficients, \(\beta\), into similar matrix of observed instances [52]. However, this is a supervised model that requires a pre-defined target vector to calculate the coefficients. As the characteristic features of each instance (operational trajectory) differs from each other, any modeling of the target vector would face the problem of the damage progression forming in complex systems’ operational compositions such as initial wear level or degradation pattern.

An alternative method in this category is the principal component analysis (PCA) which is a statistical dimensionality reduction procedure using an orthogonal transformation to convert a set of correlated input variables possibly into a set of linearly uncorrelated principal components. These target components are achieved from singular value decomposition of rectangular matrices, *x* [80]. In prognostics, the first principal components of multi-dimensional data are used as the health indicator for RUL estimation [52, 53, 76, 77].

where \(\beta\) is a matrix of coefficients determined, *x* is the input matrix and *y* is the target . PCA is an unsupervised model which means that it does not require a pre-defined target variables. In prognostics of multidimensional data, it can be applied into individual run-to-failure trajectories; however, this restricts the standardization of multiple instances into a common scale, and will not allow the determination of the operational characteristics.

Multi regime normalization is a common data processing step to provide a common scale across all the dataset characteristics before the prognostic analysis. A standard method to perform component-wise standardization is the standard score [6, 26, 51, 52, 76, 81,82,83] which is denoted as :

where \(x^d\) are the multidimensional data in a specific regime feature *d*, and \(\mu ^d\) and \(\sigma ^d\) are respectively the mean and standard deviation of the same regime. It is proposed that such a component-wise “multi-regime normalization” method can standardize the multidimensional data according to each other within a single domain [51, 81]. In contradistinction to the lack of ability to consider trajectory characteristics in the regression analysis and PCA, this method can deal with the damage progression in complex systems under dynamic regimes by considering the population features. Standard score can normalize multiple trajectories with their all components and preserve the operational characteristics such as the damage progression and initial health levels of different operations.

In Fig. 7, a sample z-score grading method in a normal distribution is shown along with standard deviations, cumulative percentages and percentile equivalents. When the “multi regime normalization” is applied to multiple operational trajectories, “the standard score” determines each regime’s unique population mean and standard deviation. This will allow the simultaneous normalization of the entire data. On the other hand, in these cases, all trajectories should be available at the same time and normalization should be done at once. Nevertheless, it would be rather unlikely to find such a scenario in a real-life scenario due to the restrictions on data proprietary and confidentiality [84]. When the “multi-regime normalization” is applied into a real-world case, the standard score method should be repeated for each novel trajectory to reconsider the altered population characteristics.

#### Artificial Neural Networks and Deep Learning

Artificial neural networks (ANNs) are the most common examples of modeling techniques in data-driven prognostic approaches [85]. These statistical models are directly inspired by, and partially modeled on the behavior of the biological neural networks of the brain. The neurons, the basic units of neural networks, are capable of modeling and processing nonlinear relationships between input and output parameters in parallel [86,87,88]. The connection between inputs and outputs is achieved by exposing the network to a set of input samples, training the network, and re-adapting the network to minimize the errors [86].

ANN is formed by the functions of multiplication, summation and transfer functions [89]. The first stage, the neurons multiplies the inputs by weighs and the sum of weighted inputs are fed to o the transfer function. In this process at the neurons, the weights are automatically altered to increase the compliance of the model with the input data [86]. Considering a neuron with a single n-individual element input vector as:

the element inputs are multiplied by weights.

The neuron also includes a bias b summed with the weighted inputs to model the net input, *N*.

This sum, *N*, is the argument of the transfer function *f*.

These equations are the keys in establishing a set of interrelated functional relationships between numerous input series and desired outputs [88]. The final governing equation for a multi-layer network function is denoted as:

where the fixed real-valued weights, \((w_i)\), are multiplied by the input data, \((x_i)\), and the bias, \(b\), is added. The neuron’s output, \(y\), is obtained by the nodes and transfer function of neurons [89, 90]. Figure 8 shows such a multiple-layer neural network model in which the layers are formed of their own variables.

In common ANN based prognostics, the condition monitoring of a complex system may not produce precise data, and the desired information is not always directly linked with the input data. In such scenarios, ANN is a convenient computational model to understand the system behaviour without knowing the exact correlation between input and output parameters [91]. Because of this ability on modelling non-linear processes along with their faster and easier calculation framework, neural networks have found many implementations in complex engineering systems.

One advanced prognostic application of these neural network models covers the deviation between healthy and deteriorated signal measurements from a complex system [92]. This network structure is formed with back-propagation through time gradient calculations and designed to overcome the challenges in adaptation, filtering and classification. A Multi-Layer Perceptron (MLP) neural network model is at first defines the difference between the healthy and failed system conditions by assuming the earliest samples in each time series as a healthy time line and the latest samples as degraded time line. Then, it predicts the number of cycles remaining before the failure [92].

A similar method is proposed for the regression application for prognostics and combined with the Kalman filter method for predictions over time [81]. In this work, it is pointed out that the data pre-processing, regime identification and exploration are principal initial stages of the prognostic framework.

An alternative ANN prognostic model, echo state network-based prognostics, form a supervised learning principle and architecture for recurrent neural networks [83, 93]. In this model, a random, large and fixed recurrent neural network is driven via the input signals by inducing each neuron within the network and combining a desired output from the response signals.

For multi regime conditions, a further multilayer feed-forward architecture applies an error back propagation algorithm to develop the damage estimation models for different regime levels, i.e., take-off, climb, and cruise [94]. Similarly, the earlier trajectory similarity-based RUL estimation method is expanded with a Radial Basis Function Neural Network (RBFN) [6]. From this work, it is observed that the similarity-based prediction model has substantial advances in their prediction performance over ANN-based prediction models.

For complex systems under dynamic regimes, the use of neural networks for RUL estimation is extended for higher performance levels of the learning methodology [95, 96]. Particularly, the feature selection procedure is applied within the he neural network based prognostics and it is shown that it should be performed according to the predictability of features [97]. For multi-step estimations, the network structures such as non-linear autoregressive ANN models form dynamic filtering frameworks in which past monitoring information is used to predict the future values [98]. Nevertheless, this type of network models has challenges in estimating the exponential damage propagation and might require a recurrence relation model to transform the data for network training [98].

Neural network based prognostics have been used in various complex domains with promising learning results [7, 40, 81, 85, 92, 99,100,101]. However, it may not always possible to train the functions as desired and the network structures at several prognostic phases may not provide the expected results, especially on the time series with complex and exponential degradation patterns. In these cases, the network functions act as an autonomous system that recursively simulate the system behaviour [102, 103]. The multi-step ahead network estimations might be particularly difficult in the cases where the previous monitoring information is limited and the failure will be in the longer term [25].

Conversely, the neural filters are robust models for prognostic and provide a synthesized mapping between the simulated or experimental data and a desired target [104]. These models have been used for multi-regime condition monitoring information with high prognostic performance [40, 92, 99]. Since the multi-step ahead network-based estimations are challenging [25, 105], a synthesis of neural networks with alternative prognostic methods is essential for higher prognostic performance and various applications can be found in the literature [40, 81, 98,99,100,101, 106]. Each of these can be considered as a hybrid prognostic framework.

## Hybrid Applications

Considering the prognostics for complex systems, a certain application may not always accurately perform in the domains with interrelated components, and therefore a hybrid prognostic method or a fusion of models will improve the prognostic characteristics and capability [107]. The damage progress of complex systems under superimposed operational is not deterministic, and usually multidimensional [3]. A composed application for these cases is generally unable to handle with the damage progress and one should consider more advanced strategies [5].

No free lunch theorem (NFLT), also known as the impossibility theorem of optimisation suggests that a general-purpose universal strategy is impossible for optimisation and a scheme can outperform another one when concentrating on a specific case [108, 109]. Particularly in prognostics, there are no framework that is ideal for all problems [110]. Therefore, the prognostic models are commonly fused with alternative applications by considering the system data. Such hybrid application category consists of the combination of different prognostic models and applied in different domains [17]. A hybrid model may have more general importance when the desired features are added, and the drawbacks are removed. Also, it can leverage the strengths of the applications by leading to improved RUL estimation results in terms of prognostic metrics.

## Conclusion

Prognostic use for the complex systems under multiple regimes is becoming in recent years more and more significant, which can be seen also by the amount of papers published on various domains. Researchers are becoming aware of the necessity of accurate RUL estimations and they need various approaches in order to acknowledge the benefits for the predictive maintenance applications. Computational methods can play a significant role in this process in particular due to the development of new computational and cognitive paradigms.

The historical evolution of computational prognostic methods and their use in complex systems shows that the sophisticated algorithms have emerged and enabled advanced analysis. In the future, these methods will play even a more significant role, due to the huge amount of data monitored and stored by advancing technologies. As shown in the paper, the current algorithms provide various tools that can significantly help researchers but it is important to choose a suitable method to apply its ability for specific domains. However, instead of selecting a single best algorithm, it seems that the best solution is to use combination of methods when solving new and complex prognostic problems.

## References

- 1.
Jamshidi M (2008) Systems of systems engineering: principles and applications. CRC Press, Boca Raton

- 2.
Günel A, Meshram A, Bley T, Schuetze A, Klusch M (2013) Statistical and semantic multisensor data evaluation for fluid condition monitoring in wind turbines. In: Proceedings of 16th international conference on sensors and measurement technology, Germany

- 3.
Saxena A, Goebel K, Simon D, Eklund N (2008) Damage propagation modeling for aircraft engine run-to-failure simulation. In: International conference on prognostics and health management, 2008. PHM 2008. IEEE, pp 1–9

- 4.
Uckun S, Goebel K, Lucas PJ (2008) Standardizing research methods for prognostics. In: International conference on prognostics and health management, 2008. PHM 2008. IEEE, pp 1–10

- 5.
Cempel C (2009) Generalized singular value decomposition in multidimensional condition monitoring of machines—a proposal of comparative diagnostics. Mech Syst Signal Process 23(3):701

- 6.
Wang T (2010) Trajectory similarity based prediction for remaining useful life estimation. Ph.D. thesis, University of Cincinnati

- 7.
Bektas O (2018) An adaptive data filtering model for remaining useful life estimation. Ph.D. thesis, The University of Warwick

- 8.
Pecht M (2008) Prognostics and health management of electronics. Wiley, New York

- 9.
Peng Y, Dong M, Zuo MJ (2010) Current status of machine prognostics in condition-based maintenance: a review. Int J Adv Manuf Technol 50(1–4):297

- 10.
Jones J, Warrington L, Davis N (2001) The use of a discrete event simulation to model the achievement of maintenance free operating time for aerospace systems. In: Reliability and maintainability symposium, 2001. Proceedings. Annual. IEEE, pp 170–175

- 11.
Medjaher K, Zerhouni N, Baklouti J (2013) Data-driven prognostics based on health indicator construction: Application to pronostia’s data. In: 2013 European control conference (ECC). IEEE, pp 1451–1456

- 12.
ISO-13381, ISO 13381-1:2015 condition monitoring and diagnostics of machines—prognostics—part 1: general guidelines. Tech. rep., International Organization for Standardization (2015)

- 13.
Efthymiou K, Papakostas N, Mourtzis D, Chryssolouris G (2012) On a predictive maintenance platform for production systems. Proc CIRP 3:221

- 14.
Jardine AK, Lin D, Banjevic D (2006) A review on machinery diagnostics and prognostics implementing condition-based. Mech Syst Signal Process 20(7):1483

- 15.
Lewis K (2017) Technical note– TN 016: 2017 maintenance requirements analysis manual. Technical report, the Asset Standards Authority (ASA), Australia

- 16.
Goode K, Moore J, Roylance B (2000) Plant machinery working life prediction method utilizing reliability and condition-monitoring data. Proc Inst Mech Eng Part E J Process Mech Eng 214(2):109

- 17.
Lee J, Wu F, Zhao W, Ghaffari M, Liao L, Siegel D (2014) Prognostics and health management design for rotary machinery systems–reviews, methodology and applications. Mech Syst Signal Process 42(1):314

- 18.
Tobon-Mejia DA, Medjaher K, Zerhouni N (2010) The ISO 13381-1 standard’s failure prognostics process through an example. In: Prognostics and health management conference, 2010. PHM’10. IEEE, pp 1–12

- 19.
Jardine AK, Lin D, Banjevic D (2006) A review on machinery diagnostics and prognostics implementing condition-based maintenance. Mech Syst Signal Process 20(7):1483

- 20.
Bektas O, Jones JA, Sankararaman S, Roychoudhury I, Goebel K (2018) Reconstructing secondary test database from PHM08 challenge data set. Data Brief 21:2464

- 21.
Bar-Yam Y (2003) Complexity of military conflict: multiscale complex systems analysis of littoral warfare, Report to Chief of Naval Operations Strategic Studies Group

- 22.
Vassiliadis P (1998) Modeling multidimensional databases, cubes and cube operations. In: Tenth international conference on scientific and statistical database management, 1998. Proceedings. IEEE, pp 53–62

- 23.
Cempel C (2003) Multidimensional condition monitoring of mechanical systems in operation. Mech Syst Signal Process 17(6):1291

- 24.
Li Y, Kurfess T, Liang S (2000) Stochastic prognostics for rolling element bearings. Mech Syst Signal Process 14(5):747

- 25.
Menezes JMP, Barreto GA (2008) Long-term time series prediction with the narx network: an empirical evaluation. Neurocomputing 71(16):3335

- 26.
Lam J, Sankararaman S, Stewart B (2014) Enhanced trajectory based similarity prediction with uncertainty quantification. In: Annual conference of the prognostics and health management society 2014

- 27.
Cattin DP (2013) Image restoration: introduction to signal and image processing. MIAC Univ Basel Retr 11:93

- 28.
Zaidan MA (2014) Bayesian approaches for complex system prognostics. Ph.D. thesis, University of Sheffield

- 29.
Eker ÖF (2015) A hybrid prognostic methodology and its application to well-controlled engineering systems. Ph.D. thesis, Cranfield University

- 30.
Paris PC, Erdogan F (1963) A critical analysis of crack propagation laws. ASME

- 31.
Li Y, Billington S, Zhang C, Kurfess T, Danyluk S, Liang S (1999) Adaptive prognostics for rolling element bearing condition. Mech Syst Signal Process 13(1):103

- 32.
Li CJ, Choi S (2002) Spur gear root fatigue crack prognosis via crack diagnosis and fracture mechanics. In: Proceedings of the 56th meeting of the society of mechanical failures prevention technology, pp 311–320

- 33.
Li CJ, Lee H (2005) Gear fatigue crack prognosis using embedded model, gear dynamic model and fracture mechanics. Mech Syst Signal Process 19(4):836

- 34.
Oppenheimer CH, Loparo KA (2002) Physically based diagnosis and prognosis of cracked rotor shafts. In: AeroSense 2002. International Society for Optics and Photonics, pp 122–132

- 35.
Orsagh RF, Sheldon J, Klenke CJ (2003) Prognostics/diagnostics for gas turbine engine bearings. In: ASME turbo expo 2003, collocated with the 2003 international joint power generation conference. American Society of Mechanical Engineers, pp 159–167

- 36.
Orsagh R, Roemer M, Sheldon J, Klenke CJ (2004) A comprehensive prognostics approach for predicting gas turbine engine bearing life. In: ASME turbo expo 2004: power for land, sea, and air. American Society of Mechanical Engineers, pp 777–785

- 37.
Kacprzynski G, Sarlashkar A, Roemer M, Hess A, Hardman B (2004) Predicting remaining life by fusing the physics of failure modeling with diagnostics. JOM J Miner Met Mater Soc 56(3):29

- 38.
Marble S, Morton BP (2006) Predicting the remaining life of propulsion system bearings. In: Aerospace conference, 2006. IEEE, p 8

- 39.
Heng A, Zhang S, Tan AC, Mathew J (2009) Rotating machinery prognostics: state of the art, challenges and opportunities. Mech Syst Signal Process 23(3):724

- 40.
Brotherton BP, Jahns G, Jacobs J, Wroblewski D (2000) Prognosis of faults in gas turbine engines. In: Aerospace conference proceedings 2000, vol 6. IEEE, 163–171

- 41.
Liao L, Köttig F (2014) Review of hybrid prognostics approaches for remaining useful life prediction of engineered systems, and an application to battery life prediction. IEEE Trans Reliab 63(1):191

- 42.
Sikorska J, Hodkiewicz M, Ma L (2011) Prognostic modelling options for remaining useful life estimation by industry. Mech Syst Signal Process 25(5):1803

- 43.
George V, Frank L, Michael R, Andrew H, Biqing W (2006) Intelligent fault diagnosis and prognosis for engineering systems. Wiley, New York

- 44.
Butler KL (1996) An expert system based framework for an incipient failure detection and predictive maintenance system. In: International conference on intelligent systems applications to power systems. Proceedings, ISAP’96. IEEE, pp 321–326

- 45.
Biagetti T, Sciubba E (2004) Automatic diagnostics and prognostics of energy conversion processes via knowledge-based systems. Energy 29(12–15):2553

- 46.
Feng E, Yang H, Rao M (1998) Fuzzy expert system for real-time process condition monitoring and incident prevention. Expert Syst Appl 15(3–4):383

- 47.
Satish B, Sarma N (2005) A fuzzy bp approach for diagnosis and prognosis of bearing faults in induction motors. In: Power engineering society general meeting, 2005. IEEE, pp 2291–2294

- 48.
Dmitry K, Dmitry V (2004) An algorithm for rule generation in fuzzy expert systems. In: Proceedings of the 17th international conference on pattern recognition. ICPR 2004, vol 1. IEEE, pp 212–215

- 49.
Eker ÖF, Camci F, Jennions IK (2014) A similarity-based prognostics approach for remaining useful life prediction. In: European conference of prognostics and health management society 2014

- 50.
Mosallam A, Medjaher K, Zerhouni N (2016) Data-driven prognostic method based on bayesian approaches for direct remaining useful life prediction. J Intell Manuf 27(5):1037

- 51.
Wang T, Yu J, Siegel D, Lee J (2008) A similarity-based prognostics approach for remaining useful life estimation of engineered systems. In: International conference on prognostics and health management. PHM 2008. IEEE, pp 1–6

- 52.
Ramasso E (2014) Investigating computational geometry for failure prognostics. Int J Progn Health Manag 5(1):005

- 53.
Bektas O, Alfudail A, Jones JA (2017) Reducing dimensionality of multi-regime data for failure prognostics. J Fail Anal Prev 17(6):1268

- 54.
An D, Choi JH, Kim NH (2013) Prognostics 101: a tutorial for particle filter-based prognostics algorithm using matlab. Reliab Eng Syst Saf 115:161

- 55.
Bayes T, Price R, Canton J (1763) An essay towards solving a problem in the doctrine of chances. C. Davis, Printer to the Royal Society of London

- 56.
Orchard ME, Vachtsevanos GJ (2009) A particle-filtering approach for on-line fault diagnosis and failure prognosis. Trans Inst Meas Control 31:221–246

- 57.
Orchard M, Wu B, Vachtsevanos G (2005) A particle filtering framework for failure prognosis. In: World tribology congress III. American Society of Mechanical Engineers, pp 883–884

- 58.
Saha B, Goebel K (2009) Modeling li-ion battery capacity depletion in a particle filtering framework. In: Proceedings of the annual conference of the prognostics and health management society, pp 2909–2924

- 59.
Miao Q, Xie L, Cui H, Liang W, Pecht M (2013) Remaining useful life prediction of lithium-ion battery with unscented particle filter technique. Microelectron Reliab 53(6):805

- 60.
Wang P, Gao RX (2014) Particle filtering-based system degradation prediction applied to jet engines. In: Annual conference of the prognostics and health management society. Citeseer, p 1

- 61.
Hu C, Youn BD, Chung J (2012) A multiscale framework with extended kalman filter for lithium-ion battery soc and capacity estimation. Appl Energy 92:694

- 62.
Julier SJ, Uhlmann JK (1997) New extension of the kalman filter to nonlinear systems. In: AeroSense 97. International society for optics and photonics, pp 182–193

- 63.
Swanson DC (2001) A general prognostic tracking algorithm for predictive maintenance. In: Aerospace conference, 2001, IEEE Proceedings, vol 6. IEEE, pp 2971–2977

- 64.
Bunks C, McCarthy D, Al-Ani T (2000) Condition-based maintenance of machines using hidden Markov models. Mech Syst Signal Process 14(4):597

- 65.
Camci F (2005) Process monitoring, diagnostics and prognostics using support vector machines and hidden markov models. Ph.D. thesis, Wayne State University, Detroit

- 66.
Baruah P, Chinnam RB (2005) Hmms for diagnostics and prognostics in machining processes. Int J Prod Res 43(6):1275

- 67.
Dong M, He D (2007) A segmental hidden semi-Markov model (HSMM)-based diagnostics and prognostics framework and methodology. Mech Syst Signal Process 21(5):2248

- 68.
Ramasso E (2009) Contribution of belief functions to hidden markov models with an application to fault diagnosis. In: IEEE international workshop on machine learning for signal processing. MLSP 2009. IEEE, pp 1–6

- 69.
Orhan E (2012) Particle filtering. Center for Neural Science, University of Rochester, Rochester, NY 8(11)

- 70.
Ghahramani Z (2001) An introduction to hidden Markov models and bayesian networks. Int J Pattern Recognit Artif Intell 15(01):9

- 71.
Batko W (1984) Prediction method in technical diagnostics, Unpublished doctoral dissertation, Cracov Mining Academy

- 72.
Kazmierczak K (1983) Application of autoregressive prognostic techniques in diagnostics. In: Proceedings of the vehicle diagnostics conference. Tuczno, Poland

- 73.
Cempel C (1987) Simple condition forecasting techniques in vibroacoustical diagnostics. Mech Syst Signal Process 1(1):75

- 74.
Box GE, Jenkins GM, Reinsel GC (2015) Time series analysis: forecasting and control. Wiley, New York

- 75.
Whitle P (1951) Hypothesis testing in time series analysis, vol 4. Almqvist & Wiksells, Uppsala

- 76.
Ramasso E (2014) Investigating computational geometry for failure prognostics in presence of imprecise health indicator: Results and comparisons on c-mapss datasets. In: European conference on prognostics and health management 5(1): 005

- 77.
Juesas P, Ramasso E, Drujont S, Placet V (2016) On partially supervised learning and inference in dynamic Bayesian networks for prognostics with uncertain factual evidence: illustration with Markov switching models

- 78.
Chatterjee S, Hadi AS (1986) Influential observations, high leverage points, and outliers in linear regression. Stat Sci 1:379–393

- 79.
Freedman DA (2009) Statistical models: theory and practice. Cambridge University Press, Cambridge

- 80.
Holland SM (2008) Principal components analysis (PCA). Department of Geology, University of Georgia, Athens, GA, pp 30, 602–2501

- 81.
Peel L (2008) Data driven prognostics using a kalman filter ensemble of neural network models. In: International conference on prognostics and health management, 2008. PHM 2008. IEEE, pp 1–6

- 82.
Malinowski S, Chebel-Morello B, Zerhouni N (2015) Remaining useful life estimation based on discriminating shapelet extraction. Reliab Eng Syst Saf 142:279

- 83.
Rigamonti M, Baraldi P, Zio E, Roychoudhury I, Goebel K, Poll S (2016) Echo state network for the remaining useful life prediction of a turbofan engine. In: Proceedings of the third European prognostic and health management conference, PHME

- 84.
Ramasso E, Saxena A (2014) Performance benchmarking and analysis of prognostic methods for CMAPSS datasets. Int J Progn Health Manag 5(2):1

- 85.
Goebel K, Saha B, Saxena A, Mct N, Riacs N (2008) A comparison of three data-driven techniques for prognostics. In: 62nd meeting of the society for machinery failure prevention technology (MFPT), pp 119–131

- 86.
Bishop CM (1995) Neural networks for pattern recognition. Oxford University Press, Oxford

- 87.
Kozlowski JD, Watson MJ, Byington CS, Garga AK, Hay TA (1999, 2001) Electrochemical cell diagnostics using online impedance measurement, state estimation and data fusion techniques. In: Intersociety energy conversion engineering conference, vol 2. SAE, pp 981–986

- 88.
Byington CS, Watson M, Edwards D (2004) Data-driven neural network methodology to remaining life predictions for aircraft actuator components. In: Aerospace conference, 2004. Proceedings. IEEE, vol 6. , pp 3581–3589

- 89.
Krenker A, Bester J, Kos A (2011) Introduction to the artificial neural networks. Artificial neural networks: methodological advances and biomedical applications. InTech, Rijeka. ISBN, pp 978–953

- 90.
Barad SG, Ramaiah PV et al (2012) Neural network approach for a combined performance and mechanical health monitoring of a gas turbine engine. Mech Syst Signal Process 27:729

- 91.
Murata N, Yoshizawa S, Amari Si (1994) Network information criterion-determining the number of hidden units for an artificial neural network model. IEEE Trans Neural Netw 5(6):865

- 92.
Heimes FO (2008) Recurrent neural networks for remaining useful life estimation. In: International conference on prognostics and health management, 2008. PHM 2008. IEEE, pp 1–6

- 93.
Peng Y, Wang H, Wang J, Liu D, Peng X (2012) A modified echo state network based remaining useful life estimation approach. In: 2012 IEEE conference on prognostics and health management (PHM), pp 1–7

- 94.
Abbas M (2010) System-level health assessment of complex engineered processes. Ph.D. thesis, Georgia Institute of Technology

- 95.
Jianzhong S, Hongfu Z, Haibin Y, Pecht M (2010) Study of ensemble learning-based fusion prognostics. In: Prognostics and health management conference, 2010. PHM’10. IEEE, pp 1–7

- 96.
Riad A, Elminir H, Elattar H (2010) Evaluation of neural networks in the subject of prognostics as compared to linear regression model. Int J Eng Technol 10(1):52

- 97.
Javed K, Gouriveau R, Zemouri R, Zerhouni N (2012) Features selection procedure for prognostics: an approach based on predictability. IFAC Proc Vol 45(20):25

- 98.
Bektas O, Jones J (2016) NARX time series model for remaining useful life estimation of gas turbine engines In: Proceedings of Third European Conference of the Prognostics and Health Management Society

- 99.
Parker Jr BE, Nigro TM, Carley MP, Barron RL, Ward DG, Poor HV, Rock D, DuBois TA (1993) Helicopter gearbox diagnostics and prognostics using vibration signature analysis. In: Optical engineering and photonics in aerospace sensing. International society for optics and photonics, pp 531–542

- 100.
Bonissone PP, Goebel K (2002) When will it break? a hybrid soft computing model to predict time-to-break margins in paper machines. In: International symposium on optical science and technology. International society for optics and photonics, pp 53–64

- 101.
Baraldi P, Compare M, Sauco S, Zio E (2013) Ensemble neural network-based particle filtering for prognostics. Mech Syst Signal Process 41(1):288

- 102.
Haykin S, Li XB (1995) Detection of signals in chaos. Proc IEEE 83(1):95

- 103.
Haykin S, Principe J (1998) Making sense of a complex world [chaotic events modeling]. IEEE Signal Process Mag 15(3):66

- 104.
Demuth H, Beale M, Hagan M (2008) Neural network toolbox\(^{{{\rm TM}}}\) 6, User’s guide, pp 37–55

- 105.
Principe JC, Euliano NR, Lefebvre WC (1999) Neural and adaptive systems: fundamentals through simulations with CD-ROM. Wiley, New York

- 106.
Bektas O, Jones JA, Sankararaman S, Roychoudhury I, Goebel K (2019) A neural network filtering approach for similarity-based remaining useful life estimation. Int J Adv Manuf Technol 101(1–4):87–103

- 107.
Sun B, Zeng S, Kang R, Pecht M (2010) Benefits analysis of prognostics in systems. In: Prognostics and health management conference, 2010. PHM’10. IEEE, pp 1–8

- 108.
Ho YC, Pepyne DL (2001) Simple explanation of the no free lunch theorem of optimization. In: Proceedings of the 40th IEEE conference on decision and control, 2001, vol 5. IEEE, pp 4409–4414

- 109.
Koppen M (2004) No-free-lunch theorems and the diversity of algorithms. In: Congress on evolutionary computation, 2004. CEC2004, vol 1. IEEE, pp 235–241

- 110.
Coble JB (2010) Merging data sources to predict remaining useful life—an automated method to identify prognostic parameters. Ph.D. thesis, University of Tennessee

## Author information

### Affiliations

### Corresponding author

## Additional information

### Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

## Rights and permissions

**Open Access** This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.

## About this article

### Cite this article

Bektas, O., Marshall, J. & Jones, J.A. Comparison of Computational Prognostic Methods for Complex Systems Under Dynamic Regimes: A Review of Perspectives.
*Arch Computat Methods Eng* **27, **999–1011 (2020). https://doi.org/10.1007/s11831-019-09339-7

Received:

Accepted:

Published:

Issue Date: