Multivariate Curve Resolution with Elastic Net Regularization

Conference paper
Part of the Lecture Notes in Electrical Engineering book series (LNEE, volume 107)


The purpose of Multivariate Curve Resolution (MCR) is to recover the concentration profile and the source spectra without any prior knowledge. We hypothesis that each source is characterized by a linear superposition of Gaussian peaks of fixed spread. Multivariate curve resolution–alternating least squares (MCR-ALS) is a Conventional MCR method. MCR-ALS has some disadvantages. We proposed a solver with L1 regularizer and L2 regularizer to obtain a sparse solution within MCR-ALS. L1-norm involves a sparse but non-smooth solution, L2-norm will keep all the information and bring the smoothness, but it will lead non-sparse solutions. So we combined the L1-norm and the squared L2-norm to seek the optimal solutions. This is accomplished via Elastic Net Regularization algorithem which is LARS (least-angle regression). We named this method MCR-LARS. This paper applies MCR-LARS to resolve the hard overlapped spectroscopic signals belonging to the three aromatic amino acids (phenylalanine, tyrosine and tryptophan) in their mixtures. MCR–LARS was compared with MCR-ALS. The results show the effectiveness and efficiency of MCR–LARS and the results show that MCR-LARS provides more nicely resolved concentration profiles and spectra than pure MCR-ALS solution.


MCR MCR-ALS Elastic Net L1-norm L2-norm MCR-LARS 



This work is supported by the Jiangsu Key Laboratory of Environmental Material and Engineering (K08021), National Natural Science Foundation of China (No.61070133), the Natural Science and Technology Foundation of Jiangsu Province of China (No.BK210311) and the Natural Science Foundation of Jiangsu Province of China (No. BK2009697).


  1. 1.
    Cichoki A, Zdunek R, Phan A, Amari S (2009) Nonnegative matrix and tensor factorizations: applications to exploratory multi-way data analysis and blind source separation. Wiley, ChichesterGoogle Scholar
  2. 2.
    Juan AD, VanderHeyden Y, Tauler R, Massart DL (1997) Assessment of new constraints applied to the alternating least squares method. Anal Chim Acta 346:307–318CrossRefGoogle Scholar
  3. 3.
    Juan A, Casassas E, Tauler R (2000) Soft-modelling of analytical data. In: Encyclopedia of analytical chemistry:instrumentation and applications. Wiley, New YorkGoogle Scholar
  4. 4.
    Juan Ad, Maeder M, Martinez M, Tauler R (2000) Combining hard and soft modelling to solve kinetic problems. Chemometr Intell Lab Sys 54:123–141CrossRefGoogle Scholar
  5. 5.
    Zou H, Hastie T (2005) Regularization and variable selection via the elastic net. J Royal Stat Soc: Ser B:301–320Google Scholar
  6. 6.
    Jolliffe IT (1991) Principal component analysis. Springer series in statistics New York 2002. Interactive self-modeling mixture analysis. Analy Chem 63:1425–1432Google Scholar
  7. 7.
    Windig W, Guilment J (1991) Interactive self-modeling mixture analysis. Anal Chem 63:1425–1432CrossRefGoogle Scholar
  8. 8.
    Hyvärinen E, Oja (2000) Independent component analysis: algorithms and applications. Neural Netw 13:411–430CrossRefGoogle Scholar
  9. 9.
    Young G (2005) Independent component analysis, Encyclopedia of statistics in behavioral science. Wiley, Chichester, pp 907–912Google Scholar
  10. 10.
    Vigário R, Jousmäki V, Hämäläinen M, Hari R, Oja E (1998) Independent componentan alysis for identification of artifacts in magnetoencephalographic recordings. Adv Neural Inf Process Sys 10:229–235Google Scholar
  11. 11.
    Vigário R (1997) Extraction of ocular artifacts from EEG using independent component analysis. Electroencephalogr Clin Neurophysiol 103:395–404CrossRefGoogle Scholar
  12. 12.
    Hyvärinen A (1999) Sparse code shrinkage: denoising of nongaussian data by maximum likelihood estimation. Neural Comput 11:1739–1768CrossRefGoogle Scholar
  13. 13.
    Back D, Weigend AS (1997) A first application of independent component analysis to extracting structure from stock returns. Int J Neural Syst 8:473–484CrossRefGoogle Scholar
  14. 14.
    Tauler R (1995) Multivariate curve resolution applied to second order data. Chemometr Intell Lab Sys 30:133–146CrossRefGoogle Scholar
  15. 15.
    Maeder M (1987) Evolving factor-analysis for the resolution of overlapping chromatographic peaks. Anal Chem 59:527–530CrossRefGoogle Scholar
  16. 16.
    Eldén L (1977) Algorithms for the regularization of ill-conditioned least squares problems. BIT Numerical Math 17:134–145CrossRefMATHGoogle Scholar
  17. 17.
    Golub G (1965) Numerical methods for solving linear least squares problems. Numer Math 7:206–216CrossRefMATHMathSciNetGoogle Scholar
  18. 18.
    Wang J-H, Hopke PK, Hancewicz TM, Zhang SL (2003) Application of modified alternating least squares regression to spectroscopic image analysis. Anal Chim Acta 476:93–109CrossRefGoogle Scholar
  19. 19.
    Hastie T, Tibshirani R, Friedman J (2009) Linear methods for regression”, The elements of statistical learning: Data mining, inference, and prediction, springer series in statistics. pp 43–100Google Scholar
  20. 20.
    Fan J, Li R (2001) Variable selection via nonconcave penalized likelihood and its oracle properties. J Am Stat Assoc 96:1348–1360CrossRefMATHMathSciNetGoogle Scholar
  21. 21.
    Bro R, Jong S (1997) A fast non-negativity-constrained least squares algorithm. J Chemometr 11:393–401CrossRefGoogle Scholar
  22. 22.
    Tauler R, Juan Ad (2005), In: multivariate curve resolution homepage
  23. 23.
    Windig W, Gallagher NB, Shaver J, Wise B (2005) A new approach for interactive self-modeling mixture analysis. Chemometr Intell Lab Sys 77:85–96CrossRefGoogle Scholar
  24. 24.
    Gourvénec S, Massart DL, Rutledge DN (2002) Determination of the number of components during mixture analysis using the Durbin–Watson criterion in the orthogonal projection approach and in the SIMPLe-to-use interactive selfmodelling mixture analysis approach. Chemometr Intell Lab Sys 61: Google Scholar
  25. 25.
    Pomareda V, Calvo D, Marco S (2010) Hard modeling multivariate curve resolution using LASSO: application to ion mobility spectra. Chemometr Intell Lab Sys 104:318–332CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media B.V. 2012

Authors and Affiliations

  1. 1.College of Information TechnologyYangzhou UniversityYangzhouChina
  2. 2.College of Computer Science and TechnologyNanjing University of Aeronautics and AstronauticsNanjingChina

Personalised recommendations