Skip to main content
Log in

Expectation–maximization algorithm for system-based lifetime data with unknown system structure

  • Original Paper
  • Published:
AStA Advances in Statistical Analysis Aims and scope Submit manuscript

Abstract

In science and engineering, we are often interested in learning about the lifetime characteristics of the system as well as those of the components that made up the system. However, in many cases, the system lifetimes can be observed but not the component lifetimes, and so we may not also have any knowledge on the structure of the system. Statistical procedures for estimating the parameters of the component lifetime distribution and for identifying the system structure based on system-level lifetime data are developed here using expectation–maximization (EM) algorithm. Different implementations of the EM algorithm based on system-level or component-level likelihood functions are proposed. A special case that the system is known to be a coherent system with unknown structure is considered. The methodologies are then illustrated by considering the component lifetimes to follow a two-parameter Weibull distribution. A numerical example and a Monte Carlo simulation study are used to evaluate the performance and related merits of the proposed implementations of the EM algorithm. Lognormally distributed component lifetimes and a real data example are used to illustrate how the methodologies can be applied to other lifetime models in addition to the Weibull model. Finally, some recommendations along with concluding remarks are provided.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

References

  • Al-Nefaiee, A.H., Coolen, F.: Nonparametric predictive inference for system failure time based on bounds for the signature. Proc. Inst. Mech. Eng. O J. Risk Reliab. 10, 513–522 (2013)

    Google Scholar 

  • Arnold, B.C., Balakrishnan, N., Nagaraja, H.N.: A First Course in Order Statistics. Wiley, New York (1992)

    MATH  Google Scholar 

  • Balakrishnan, N., Mitra, D.: Left truncated and right censored weibull data and likelihood inference with an illustration. Comput. Stat. Data Anal. 56, 4011–4025 (2012)

    Article  MathSciNet  MATH  Google Scholar 

  • Balakrishnan, N., Ng, H.K.T., Navarro, J.: Exact nonparametric inference for component lifetime distribution based on lifetime data from systems with known signatures. J. Nonparametr. Stat. 23, 741–752 (2011a)

    Article  MathSciNet  MATH  Google Scholar 

  • Balakrishnan, N., Ng, H.K.T., Navarro, J.: Linear inference for type-II censored lifetime data of reliability systems with known signatures. IEEE Trans. Reliab. 60, 426–440 (2011b)

    Article  Google Scholar 

  • Bhattacharya, D., Samaniego, F.J.: Estimating component characteristics from system failure-time data. Nav. Res. Logist. 57, 380–389 (2010)

    MathSciNet  MATH  Google Scholar 

  • Dempster, A.P., Laird, N.M., Rubin, D.B.: Maximum likelihood from incomplete data via the EM algorithm. J. R. Stat. Soc. Ser. B 39, 1–38 (1977)

    MathSciNet  MATH  Google Scholar 

  • Dube, S., Pradhan, B., Kundu, D.: Parameter estimation of the hybrid censored log-normal distribution. J. Stat. Comput. Simul. 81, 275–287 (2011)

    Article  MathSciNet  MATH  Google Scholar 

  • Eryilmaz, S., Koutras, M.V., Triantafyllou, I.S.: Signature based analysis of \(m\)-consecutive-\(k\)-out-of-\(n\): \(f\) systems with exchangeable components. Nav. Res. Logist. 58, 344–354 (2011)

    Article  MathSciNet  MATH  Google Scholar 

  • Eykhoff, P.: System Identification—Parameter and System Estimation. Wiley, New York (1974)

    MATH  Google Scholar 

  • Kochar, S., Mukerjee, H., Samaniego, F.J.: The signature of a coherent system and its application to comparisons among systems. Nav. Res. Logist. 46, 507–523 (1999)

    Article  MathSciNet  MATH  Google Scholar 

  • Lawless, J.F.: Statistical Models and Methods for Lifetime Data, vol. 362, 2nd edn. Wiley, Hoboken (2011)

    MATH  Google Scholar 

  • Ljung, L.: System Identification: Theory for the User. Prentice-Hall Inc., Upper Saddle River (1999)

    MATH  Google Scholar 

  • Louis, T.A.: Finding the observed information matrix when using the em algorithm. J. R. Stat. Soc. Ser. B 44, 226–233 (1982)

    MathSciNet  MATH  Google Scholar 

  • McLachlan, G., Krishnan, T.: The EM Algorithm and Extensions, 2nd edn. Wiley, Hoboken (2008)

    Book  MATH  Google Scholar 

  • Murthy, D.P., Xie, M., Jiang, R.: Weibull Models, vol. 505. Wiley, Hoboken (2004)

    MATH  Google Scholar 

  • Navarro, J., Ruiz, J.M., Sandoval, C.J.: Properties of coherent systems with dependent components. Commun. Stat. Theory Methods 36, 175–191 (2007)

    Article  MathSciNet  MATH  Google Scholar 

  • Ng, H.K.T., Chan, P.S., Balakrishnan, N.: Estimation of parameters from progressively censored data using EM algorithm. Comput. Stat. Data Anal. 39, 371–386 (2002)

    Article  MathSciNet  MATH  Google Scholar 

  • Ng, H.K.T., Navarro, J., Balakrishnan, N.: Parametric inference from system lifetime data under a proportional hazard rate model. Metrika 75, 367–388 (2012)

    Article  MathSciNet  MATH  Google Scholar 

  • Pham, H., Pham, M.: Software reliability models for critical applications. Technical Report EGG-2663, Idaho National Engineering Laboratory EG&G, Idaho Falls, ID (1991)

  • Rinne, H.: The Weibull Distribution: A Handbook. CRC Press, Boca Raton (2010)

    MATH  Google Scholar 

  • Samaniego, F.: System Signatures and Their Applications in Engineering Reliability. Springer, New York (2007)

    Book  MATH  Google Scholar 

  • Tangirala, A.: Principles of System Identification: Theory and Practice. CRC Press, Boca Raton (2015)

    MATH  Google Scholar 

  • Tanner, M.A.: Tools for Statistical Inference: Observed Data and Data Augmentation Methods, 2nd edn. Springer, New York (1993)

    Book  MATH  Google Scholar 

  • Teng, X., Pham, H.: A software-reliability growth model for \(n\)-version programming systems. IEEE Trans. Reliab. 51(3), 311–321 (2002)

    Article  Google Scholar 

  • Weibull, W.: A statistical distribution function of wide applicability. J. Appl. Mech. 18, 292–297 (1951)

    MATH  Google Scholar 

  • Wu, C.F.J.: On the convergence properties of the EM algorithm. Ann. Stat. 11, 95–103 (1983)

    Article  MathSciNet  MATH  Google Scholar 

  • Zhang, J., Ng, H.K.T., Balakrishnan, N.: Statistical inference of component lifetimes with location-scale distributions from censored system failure data with known signature. IEEE Trans. Reliab. 64, 613–626 (2015)

    Article  Google Scholar 

Download references

Acknowledgements

The authors thank two anonymous referees for their careful review and useful comments and suggestions on an earlier version of this manuscript which resulted in this improved version. HKTNs work was supported by a Grant from the Simons Foundation (#280601).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Hon Keung Tony Ng.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Yang, Y., Ng, H.K.T. & Balakrishnan, N. Expectation–maximization algorithm for system-based lifetime data with unknown system structure. AStA Adv Stat Anal 103, 69–98 (2019). https://doi.org/10.1007/s10182-018-0323-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10182-018-0323-x

Keywords

Navigation