Improved Parameter Estimation in Kinetic Models: Selection and Tuning of Regularization Methods
Kinetic models are being increasingly used as a systematic framework to understand function in biological systems. Calibration of these nonlinear dynamic models remains challenging due to the nonconvexity and ill-conditioning of the associated inverse problems. Nonconvexity can be dealt with suitable global optimization. Here, we focus on simultaneously dealing with ill-conditioning by making use of proper regularization methods. Regularized calibrations ensure the best trade-offs between bias and variance, thus reducing over-fitting. We present a critical comparison of several methods, and guidelines for properly tuning them. The performance of this procedure and its advantages are illustrated with a well known benchmark problem considering several scenarios of data availability and measurement noise.
KeywordsDynamic models parameter estimation Tikhonov regularization regularization tuning
Unable to display preview. Download preview PDF.
- 1.Almquist, J., Cvijovic, M., Hatzimanikatis, V., Nielsen, J., Jirstrand, M.: Kinetic models in industrial biotechnology - Improving cell factory performance. Metabolic Engineering 1–22 (April 2014)Google Scholar
- 9.Engl, H.W., Hanke, M., Neubauer, A.: Regularization of Inverse Problems. Kluwer Academic Publishers (1996)Google Scholar
- 13.Kitano, H. (ed.): Foundations of Systems Biology. The MIT Press (2001)Google Scholar
- 14.Kravaris, C., Hahn, J., Chu, Y.: Advances and selected recent developments in state and parameter estimation. Computers & Chemical Engineering 51, 111–123 (2013), http://linkinghub.elsevier.com/retrieve/pii/S0098135412001779 CrossRefGoogle Scholar
- 17.Ljung, L., Chen, T.: What can regularization offer for estimation of dynamical systems? In: 11th IFAC International Workshop on Adaptation and Learning in Control and Signal Processing. IFAC, vol. 5 (2013)Google Scholar
- 20.Morozov, V.A.: Methods for Solving Incorrectly Posed Problems. Springer (1984)Google Scholar
- 21.Palm, R.: Numerical Comparison of Regularization Algorithms for Solving Ill-Posed Problems. Ph.D. thesis, University of Tartu, EstoniaGoogle Scholar
- 27.Schmidt, M., Fung, G., Rosaless, R.: Optimization Methods for l1-Regularization. Tech. rep. (2009), http://www.cs.ubc.ca/cgi-bin/tr/2009/TR-2009-19.pdf
- 28.Stanford, N.J., Lubitz, T., Smallbone, K., Klipp, E., Mendes, P., Liebermeister, W.: Systematic construction of kinetic models from genome-scale metabolic networks. PloS one 8(11), e79195 (2012)Google Scholar
- 30.Walter, E., Prorizato, L.: Identification of Parametric Models from experimental data. Springer (1997)Google Scholar
- 32.Zou, H., Hastie, T.: Regularization and variable selection via the elastic net. Journal of the Royal Statistical Society: Series B (Statistical Methodology) 67(2), 301–320 (2005), http://doi.wiley.com/10.1111/j.1467-9868.2005.00503.x MathSciNetCrossRefMATHGoogle Scholar