Abstract
In science and engineering, we are often interested in learning about the lifetime characteristics of the system as well as those of the components that made up the system. However, in many cases, the system lifetimes can be observed but not the component lifetimes, and so we may not also have any knowledge on the structure of the system. Statistical procedures for estimating the parameters of the component lifetime distribution and for identifying the system structure based on system-level lifetime data are developed here using expectation–maximization (EM) algorithm. Different implementations of the EM algorithm based on system-level or component-level likelihood functions are proposed. A special case that the system is known to be a coherent system with unknown structure is considered. The methodologies are then illustrated by considering the component lifetimes to follow a two-parameter Weibull distribution. A numerical example and a Monte Carlo simulation study are used to evaluate the performance and related merits of the proposed implementations of the EM algorithm. Lognormally distributed component lifetimes and a real data example are used to illustrate how the methodologies can be applied to other lifetime models in addition to the Weibull model. Finally, some recommendations along with concluding remarks are provided.
Similar content being viewed by others
References
Al-Nefaiee, A.H., Coolen, F.: Nonparametric predictive inference for system failure time based on bounds for the signature. Proc. Inst. Mech. Eng. O J. Risk Reliab. 10, 513–522 (2013)
Arnold, B.C., Balakrishnan, N., Nagaraja, H.N.: A First Course in Order Statistics. Wiley, New York (1992)
Balakrishnan, N., Mitra, D.: Left truncated and right censored weibull data and likelihood inference with an illustration. Comput. Stat. Data Anal. 56, 4011–4025 (2012)
Balakrishnan, N., Ng, H.K.T., Navarro, J.: Exact nonparametric inference for component lifetime distribution based on lifetime data from systems with known signatures. J. Nonparametr. Stat. 23, 741–752 (2011a)
Balakrishnan, N., Ng, H.K.T., Navarro, J.: Linear inference for type-II censored lifetime data of reliability systems with known signatures. IEEE Trans. Reliab. 60, 426–440 (2011b)
Bhattacharya, D., Samaniego, F.J.: Estimating component characteristics from system failure-time data. Nav. Res. Logist. 57, 380–389 (2010)
Dempster, A.P., Laird, N.M., Rubin, D.B.: Maximum likelihood from incomplete data via the EM algorithm. J. R. Stat. Soc. Ser. B 39, 1–38 (1977)
Dube, S., Pradhan, B., Kundu, D.: Parameter estimation of the hybrid censored log-normal distribution. J. Stat. Comput. Simul. 81, 275–287 (2011)
Eryilmaz, S., Koutras, M.V., Triantafyllou, I.S.: Signature based analysis of \(m\)-consecutive-\(k\)-out-of-\(n\): \(f\) systems with exchangeable components. Nav. Res. Logist. 58, 344–354 (2011)
Eykhoff, P.: System Identification—Parameter and System Estimation. Wiley, New York (1974)
Kochar, S., Mukerjee, H., Samaniego, F.J.: The signature of a coherent system and its application to comparisons among systems. Nav. Res. Logist. 46, 507–523 (1999)
Lawless, J.F.: Statistical Models and Methods for Lifetime Data, vol. 362, 2nd edn. Wiley, Hoboken (2011)
Ljung, L.: System Identification: Theory for the User. Prentice-Hall Inc., Upper Saddle River (1999)
Louis, T.A.: Finding the observed information matrix when using the em algorithm. J. R. Stat. Soc. Ser. B 44, 226–233 (1982)
McLachlan, G., Krishnan, T.: The EM Algorithm and Extensions, 2nd edn. Wiley, Hoboken (2008)
Murthy, D.P., Xie, M., Jiang, R.: Weibull Models, vol. 505. Wiley, Hoboken (2004)
Navarro, J., Ruiz, J.M., Sandoval, C.J.: Properties of coherent systems with dependent components. Commun. Stat. Theory Methods 36, 175–191 (2007)
Ng, H.K.T., Chan, P.S., Balakrishnan, N.: Estimation of parameters from progressively censored data using EM algorithm. Comput. Stat. Data Anal. 39, 371–386 (2002)
Ng, H.K.T., Navarro, J., Balakrishnan, N.: Parametric inference from system lifetime data under a proportional hazard rate model. Metrika 75, 367–388 (2012)
Pham, H., Pham, M.: Software reliability models for critical applications. Technical Report EGG-2663, Idaho National Engineering Laboratory EG&G, Idaho Falls, ID (1991)
Rinne, H.: The Weibull Distribution: A Handbook. CRC Press, Boca Raton (2010)
Samaniego, F.: System Signatures and Their Applications in Engineering Reliability. Springer, New York (2007)
Tangirala, A.: Principles of System Identification: Theory and Practice. CRC Press, Boca Raton (2015)
Tanner, M.A.: Tools for Statistical Inference: Observed Data and Data Augmentation Methods, 2nd edn. Springer, New York (1993)
Teng, X., Pham, H.: A software-reliability growth model for \(n\)-version programming systems. IEEE Trans. Reliab. 51(3), 311–321 (2002)
Weibull, W.: A statistical distribution function of wide applicability. J. Appl. Mech. 18, 292–297 (1951)
Wu, C.F.J.: On the convergence properties of the EM algorithm. Ann. Stat. 11, 95–103 (1983)
Zhang, J., Ng, H.K.T., Balakrishnan, N.: Statistical inference of component lifetimes with location-scale distributions from censored system failure data with known signature. IEEE Trans. Reliab. 64, 613–626 (2015)
Acknowledgements
The authors thank two anonymous referees for their careful review and useful comments and suggestions on an earlier version of this manuscript which resulted in this improved version. HKTNs work was supported by a Grant from the Simons Foundation (#280601).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Yang, Y., Ng, H.K.T. & Balakrishnan, N. Expectation–maximization algorithm for system-based lifetime data with unknown system structure. AStA Adv Stat Anal 103, 69–98 (2019). https://doi.org/10.1007/s10182-018-0323-x
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10182-018-0323-x