Testing Shape Constraints in Lasso Regularized Joinpoint Regression

  • Matúš MaciakEmail author
Conference paper
Part of the Springer Proceedings in Mathematics & Statistics book series (PROMS, volume 193)


Joinpoint regression models are very popular in some practical areas mainly due to a very simple interpretation which they offer. In some situations, moreover, it turns out to be also useful to require some additional qualitative properties for the final model to be satisfied. Especially properties related to the monotonicity of the fit are of the main interest in this paper. We propose a LASSO regularized approach to estimate these types of models where the optional shape constraints can be implemented in a straightforward way as a set of linear inequalities and they are considered simultaneously within the estimation process itself. As the main result we derive a testing approach which can be effectively used to statistically verify the validity of the imposed shape restrictions in piecewise linear continuous models. We also investigate some finite sample properties via a simulation study.


Joinpoint regression Regularization Shape constraints Post-selection inference 



We thank Ivan Mizera, Sen Bodhisattva and the referee for their comments and remarks. This work was partially supported by the PRVOUK grant 300-04/130.


  1. 1.
    Bosetti, C., Bertuccio, P., Levi, F., Lucchini, F., Negri, E., La Vecchia, C.: Cancer mortality in the European Union, 1970–2003, with a joinpoint analysis. Ann. Oncol. 16, 631–640 (2008)Google Scholar
  2. 2.
    Carlin, B.P., Gelfand, A.E., Smith, A.F.M.: Hierarchical Bayesian analysis of changepoint problems. Appl. Stat. 41, 389–405 (1992)CrossRefzbMATHGoogle Scholar
  3. 3.
    Efron, B., Hastie, T., Tibshirani, R.: Least angle regression. Ann. Stat. 32, 407–499 (2004)MathSciNetCrossRefzbMATHGoogle Scholar
  4. 4.
    Feder, P.: The log likelihood ratio in segmented regression. Ann. Stat. 3, 84–97 (1975)MathSciNetCrossRefzbMATHGoogle Scholar
  5. 5.
    Friedman, J., Hastie, T., Tibshirani, R.: Regularization paths for generalized linear models via coordinate descent. J. Stat. Softw. 33, 1–22 (2010)CrossRefGoogle Scholar
  6. 6.
    Gareth, M.J., Paulson, C., Rusmevichientong, P.: The Constrained Lasso. (working paper)Google Scholar
  7. 7.
    Harchaoui, Z., Lévy-Leduc, C.: Multiple change-point estimation with a total variation penalty. J. Am. Stat. Assoc. 105(492), 1480–1493 (2010)MathSciNetCrossRefzbMATHGoogle Scholar
  8. 8.
    Hinkley, D.V.: Inference in two-phase regression. J. Am. Stat. Assoc. 66(336), 736–743 (1971)CrossRefzbMATHGoogle Scholar
  9. 9.
    Holm, S.: A simple sequentially rejective multiple test procedure. Scand. J. Stat. 6(2), 65–70 (1979)MathSciNetzbMATHGoogle Scholar
  10. 10.
    Kim, H.J., Yu, B., Feuer, E.J.: Selecting the number of change-poins in segmented line regression. Stat. Sin. 19, 597–609 (2009)zbMATHGoogle Scholar
  11. 11.
    Kim, H.J., Fay, M.P., Feuer, E.J., Midthune, D.N.: Permutation tests for joinpoint regression with application to cancer rates. Stat. Med. 19, 335–351 (2000)CrossRefGoogle Scholar
  12. 12.
    Lee, J.D., Sun, D.,L., Sun, Y., Taylor, J.,E.: Exact post-selection inference with application to the lasso. Ann. Stat. 44(3), 907–927 (2016)Google Scholar
  13. 13.
    Lockhart, R., Taylor, J., Tibshirani, R.J., Tibshirani, R.: A significance test for LASSO. Ann. Stat. 42(2), 413–468 (2014)MathSciNetCrossRefzbMATHGoogle Scholar
  14. 14.
    Maciak, M., Mizera, I.: Regularization techniques in joinpoint regression. Statistical Papers (in revision) (2016)Google Scholar
  15. 15.
    Martinez-Beneito, M., García-Donato, G., Salmerón, D.: A bayesian joinpoint regression model with an unknown number of break-points. Ann. Appl. Stat. 5(3), 2150–2168 (2011)MathSciNetCrossRefzbMATHGoogle Scholar
  16. 16.
    Meinshausen, N., Bühlmann, P.: Stability selection. J. R. Stat. Soc. B 72(4), 417–473 (2010)MathSciNetCrossRefGoogle Scholar
  17. 17.
    Miller, R.: Simultaneous Statistical Inference, 2nd edn. Springer, New York (1981)CrossRefzbMATHGoogle Scholar
  18. 18.
    Pesarin, F.: Multivariate Permutations Tests with Application in Biostatistics. Wiley, New York (2001)Google Scholar
  19. 19.
    Qui, D., Katanoda, K., Tomomi, M., Tomotaka, S.: A joinpoint regression analysis of long-term trends in cancer mortality in Japan (1958–2004). Int. J. Cancer 24, 443–448 (2009)Google Scholar
  20. 20.
    Tibshirani, R.: Regression shrinkage and selection via the LASSO. J. R. Stat. Soc. Ser. B 58(1), 267–288 (1996)MathSciNetzbMATHGoogle Scholar
  21. 21.
    Tibshirani, R., Taylor, J., Lockhart, R., Tibshirani. R.: Exact post-selection inference for sequential regression procedures. J. Am. Stat. Assoc. (to appear)Google Scholar
  22. 22.
    van de Geer, S., Bühlman, P., Ritov, Y., Dezeure, R.: On asymptotically optimal confidence regions and tests for high-dimensional models. Ann. Stat. 42(3), 1166–1201 (2014)MathSciNetCrossRefzbMATHGoogle Scholar
  23. 23.
    Zhang, C.H., Zhang, S.: Confidence intervals for low dimensional parameters in high dimensional linear models. J. R. Stat. Soc.: Ser. B 76(1), 217–242 (2014)MathSciNetCrossRefGoogle Scholar

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  1. 1.Department of Probability and Mathematical StatisticsCharles UniversityPragueCzech Republic

Personalised recommendations