A Nonparametric Control Chart for Dynamic Disease Risk Monitoring

  • Lu You
  • Peihua QiuEmail author


Some deadly diseases can be treated or even prevented if they or some of their symptoms are detected early. Disease early detection and prevention is thus important for our health improvement. In this paper, we suggest a novel and effective new method for disease early detection. By this method, a patient’s risk to the disease is first quantified at each time point by survival data analysis of a training dataset that contains patients’ survival information and longitudinally observed disease predictors (e.g., disease risk factors and other covariates). To improve the effectiveness of the proposed method, variable selection is used in the survival analysis to keep only important disease predictors in disease risk quantification. Then, the longitudinal pattern of the quantified risk is monitored sequentially over time by a nonparametric control chart. A signal will be given by the chart once the cumulative difference between the risk pattern of the patient under monitoring and the risk pattern of a typical person without the disease in concern exceeds a control limit.


Disease screening Disease early detection Dynamic process Longitudinal data Statistical process control Survival data 



The authors thank the editors for the invitation of this contribution to the edited book. One referee provided some comments about the paper for improvements, which is greatly appreciated. This research is supported in part by an NSF grant in USA.


  1. Akaike, H. (1992). Information theory and an extension of the maximum likelihood principle. Second International Symposium on Information Theory Proceeding, 1, 610–624.Google Scholar
  2. Cai, Z., & Sun, Y. (2003). Local linear estimation for time-dependent coefficients in cox’s regression models. Scandinavian Journal of Statistics, 30, 93–111.MathSciNetCrossRefGoogle Scholar
  3. Epanechnikov, V. A. (1969). Non-parametric estimation of a multivariate probability density. Theory of Probability & Its Applications, 14, 153–158.MathSciNetCrossRefGoogle Scholar
  4. Fan, J., & Li, R. (2001). Variable selection via nonconcave penalized likelihood and its oracle properties. Journal of the American Statistical Association, 96, 1348–1360.MathSciNetCrossRefGoogle Scholar
  5. Fan, J., Yao, Q., & Tong, H. (1996). Estimation of conditional densities and sensitivity measures in nonlinear dynamical systems. Biometrika, 83, 189–206.MathSciNetCrossRefGoogle Scholar
  6. Friedman, J., Hastie, T., Höfling, H., & Tibshirani, R. (2007). Pathwise coordinate optimization. The Annals of Applied Statistics, 1, 302–332.MathSciNetCrossRefGoogle Scholar
  7. Klein, J. P., & Moeschberger, M. L. (1997). Survival Analysis: Techniques for Censored and Truncated Data. New York: Springer.CrossRefGoogle Scholar
  8. Li, J., & Qiu, P. (2016). Nonparametric dynamic screening system for monitoring correlated longitudinal data. IIE Transactions, 48, 772–786.CrossRefGoogle Scholar
  9. Li, J., & Qiu, P. (2017). Construction of an efficient multivariate dynamic screening system. Quality and Reliability Engineering International, 33, 1969–1981.CrossRefGoogle Scholar
  10. Mendis, S., Puska, P., & Norrving, B. (2011). Global atlas on cardiovascular disease prevention and control. World Health Organization.,.
  11. Qiu, P. (2014). Introduction to Statistical Process Control. Boca Raton, FL: Chapman Hall/CRC.Google Scholar
  12. Qiu, P., Xia, Z., & You, L. (2019). Process monitoring ROC curve for evaluating dynamic screening methods. Technometrics,. Scholar
  13. Qiu, P., & Xiang, D. (2014). Univariate dynamic screening system: an approach for identifying individuals with irregular longitudinal behavior. Technometrics, 56, 248–260.MathSciNetCrossRefGoogle Scholar
  14. Qiu, P., & Xiang, D. (2015). Surveillance of cardiovascular diseases using a multivariate dynamic screening system. Statistics in Medicine, 34, 2204–2221.MathSciNetCrossRefGoogle Scholar
  15. Qiu, P., Zi, X., & Zou, C. (2018). Nonparametric dynamic curve monitoring. Technometrics, 60, 386–397.MathSciNetCrossRefGoogle Scholar
  16. Simon, N., Friedman, J., Hastie, T., & Tibshirani, R. (2011). Regularization paths for Cox’s proportional hazards model via coordinate descent. Journal of Statistical Software, 39, 1–13.CrossRefGoogle Scholar
  17. Tian, L., Zucker, D., & Wei, L. (2005). On the Cox model with time-varying regression coefficients. Journal of the American Statistical Association, 100, 172–183.MathSciNetCrossRefGoogle Scholar
  18. Tibshirani, R. (1996). Regression shrinkage and selection via the lasso. Journal of the Royal Statistical Society: Series B (Methodological), 58, 267–288.MathSciNetzbMATHGoogle Scholar
  19. Tibshirani, R. (1997). The LASSO method for variable selection in the Cox model. Statistics in Medicine, 16, 385–395.CrossRefGoogle Scholar
  20. Wright, D. J. (1986). Forecasting data published at irregular time intervals using an extension of Holt’s method. Management Science, 32, 499–510.CrossRefGoogle Scholar
  21. Xiang, D., Qiu, P., & Pu, X. (2013). Nonparametric regression analysis of multivariate longitudinal data. Statistica Sinica, 23, 769–789.MathSciNetzbMATHGoogle Scholar
  22. You, L., & Qiu, P. (2019a). Fast computing for dynamic screening systems when analyzing correlated data. Journal of Statistical Computation and Simulation, 89, 379–394.Google Scholar
  23. You, L., & Qiu, P. (2019b). An effective method for online disease risk monitoring. Technometrics,.
  24. Yu, K., & Jones, M. (1998). Local linear quantile regression. Journal of the American Statistical Association, 93, 228–237.MathSciNetCrossRefGoogle Scholar
  25. Yuan, M., & Lin, Y. (2006). Model selection and estimation in regression with grouped variables. Journal of the Royal Statistical Society: Series B (Statistical Methodology), 68, 49–67.MathSciNetCrossRefGoogle Scholar
  26. Zou, H. (2006). The adaptive LASSO and its oracle properties. Journal of the American Statistical Association, 101, 1418–1429.MathSciNetCrossRefGoogle Scholar
  27. Zou, H., & Hastie, T. (2005). Regularization and variable selection via the elastic net. Journal of The Royal Statistical Society: Series B (Statistical Methodology), 67, 301–320.MathSciNetCrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2020

Authors and Affiliations

  1. 1.Department of BiostatisticsUniversity of FloridaGainesvilleUSA

Personalised recommendations