Skip to main content
SpringerLink
Log in

Variational Data Assimilation: Optimization and Optimal Control

  • Chapter
  • First Online:
Data Assimilation for Atmospheric, Oceanic and Hydrologic Applications (Vol. III)

Abstract

In the last few years due to a constant increase in the need for more precise forecasting and nowcasting.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Akella S, Navon IM (2009) Different approaches to model error formulation in 4D-Var: a study with high-resolution advection schemes. Tellus A 61(1):112–128

    Article  Google Scholar 

  • Arian E, Fahl M, Sachs EW (2000) Trust-region proper orthogonal decomposition for flow control. Technical report, DTIC Document

    Google Scholar 

  • Barrett R, Berry M, Chan TF, Demmel J, Donato J, Dongarra J, Eijkhout V, Pozo R, Romine C, Van der Vorst H (1994) Templates for the solution of linear systems: building blocks for iterative methods, 2nd edn. SIAM, Philadelphia, PA

    Book  Google Scholar 

  • Bertsekas DP (1982) Constrained optimization and Lagrange multiplier methods. Academic Press, New York

    Google Scholar 

  • Bishop CH, Satterfield EA (2013) Hidden error variance theory. Part I: exposition and analytic model. Monthly Weather Rev 141(5):1454–1468

    Google Scholar 

  • Bishop CH, Satterfield EA, Shanley KT (2013) Hidden error variance theory. Part II: an instrument that reveals hidden error variance distributions from ensemble forecasts and observations. Monthly Weather Rev 141(5):1469–1483

    Google Scholar 

  • Bonavita M, Isaksen L, Hólm E (2012) On the use of EDA background error variances in the ECMWF 4D-Var. Q J Royal Meteorol Soc 138(667):1540–1559

    Article  Google Scholar 

  • Bouttier F, Kelly G (2001) Observing-system experiments in the ecmwf 4d-var data assimilation system. Q J Royal Meteorol Soc 127(574):1469–1488

    Article  Google Scholar 

  • Buehner M, Houtekamer PL, Charette C, Mitchell HL, He B (2010a) Intercomparison of variational data assimilation and the ensemble Kalman filter for global deterministic NWP. Part I: description and single-observation experiments. Monthly Weather Rev 138(5):1550–1566

    Google Scholar 

  • Buehner M, Houtekamer PL, Charette C, Mitchell HL, He B (2010b) Intercomparison of variational data assimilation and the ensemble Kalman filter for global deterministic NWP. Part II: one-month experiments with real observations. Monthly Weather Rev 138(5):1567–1586

    Google Scholar 

  • Buizza R, Leutbecher M, Isaksen L (2008) Potential use of an ensemble of analyses in the ECMWF ensemble prediction system. Q J Royal Meteorol Soc 134(637):2051–2066

    Article  Google Scholar 

  • Burgers JM (1948) A mathematical model illustrating the theory of turbulence. Adv Appl Mech 1:171–199

    Article  Google Scholar 

  • Cacuci DG, Hall MCG (1984) Efficient estimation of feedback effects with application to climate models. J Atmos Sci 41(13):2063–2068

    Article  Google Scholar 

  • Chapelle D, Fragu M, Mallet V, Moireau P (2013) Fundamental principles of data assimilation underlying the Verdandi library: applications to biophysical model personalization within euHeart. Med Biol Eng Comput 51(11):1221–1233

    Article  CAS  Google Scholar 

  • Charney JG, Fjörtoft R, Von Neumann J (1950) Numerical integration of the barotropic vorticity equation. Tellus A 2(4):

    Google Scholar 

  • Clayton AM, Lorenc AC, Barker DM (2013) Operational implementation of a hybrid ensemble/4D-Var global data assimilation system at the Met Office. Q J Royal Meteorol Soc 139(675):1445–1461

    Article  Google Scholar 

  • Courtier P, Thépaut J-N, Hollingsworth A (1994) A strategy for operational implementation of 4d-var, using an incremental approach. Q J Royal Meteorol Soc 120(519):1367–1387

    Article  Google Scholar 

  • Daescu DN, Langland RH (2013) Error covariance sensitivity and impact estimation with adjoint 4d-var: theoretical aspects and first applications to navdas-ar. Q J Royal Meteorol Soc 139(670):226–241

    Article  Google Scholar 

  • Daescu DN, Todling R (2010) Adjoint sensitivity of the model forecast to data assimilation system error covariance parameters. Q J Royal Meteorol Soc 136(653):2000–2012

    Article  Google Scholar 

  • Derber JC (1989) A variational continuous assimilation technique. Monthly Weather Rev 117(11):2437–2446

    Article  Google Scholar 

  • Desroziers G, Hello G, Thepaut J-N (2003) A 4d-var re-analysis of fastex. Q J Royal Meteorol Soc 129(589):1301–1315

    Article  Google Scholar 

  • Euler L (1766) Elementa calculi variationum. Originally published in Novi Commentarii academiae scientiarum Petropolitanae 10:51–93

    Google Scholar 

  • Euler L (1744) Methodus inveniendi lineas curvas maximi minimive proprietate gaudentes sive solutio problematis isoperimetrici latissimo sensu accepti. Bousquet, Lausannae e Genevae, E65A. OO Ser. I, 24, 1952

    Google Scholar 

  • Fairweather G, Navon IM (1980) A linear ADI method for the shallow water equations. J Comput Phys 37:1–18

    Article  Google Scholar 

  • Fisher M (2003) Background error covariance modelling. In: Seminar on recent development in data assimilation for atmosphere and ocean, pp 45–63

    Google Scholar 

  • Fletcher R (2013) Practical methods of optimization. Wiley

    Google Scholar 

  • Galerkin BG (1915) Series occurring in various questions concerning the elastic equilibrium of rods and plates. Vestnik Inzhenerov Tech 19:897–908

    Google Scholar 

  • Gauthier P, Thepaut J-N (2001) Impact of the digital filter as a weak constraint in the preoperational 4dvar assimilation system of météo-france. Monthly Weather Rev 129(8):2089–2102

    Article  Google Scholar 

  • Ghil M, Cohn S, Tavantzis J, Bube K, Isaacson E (1981) Applications of estimation theory to numerical weather prediction. In: Dynamic meteorology: data assimilation methods. Springer, pp 139–224

    Google Scholar 

  • Gill PE, Murray W, Wright MH (1981) Practical optimization

    Google Scholar 

  • Grammeltvedt A (1969) A survey of finite difference schemes for the primitive equations for a barotropic fluid. Monthly Weather Rev 97(5):384–404

    Article  Google Scholar 

  • Gratton S, Lawless AS, Nichols NK (2007) Approximate gauss-newton methods for nonlinear least squares problems. SIAM J Optim 18(1):106–132

    Article  Google Scholar 

  • Griewank A, Walther A (2008) Evaluating derivatives: principles and techniques of algorithmic differentiation. SIAM

    Google Scholar 

  • Gustafsson B (1971) An alternating direction implicit method for solving the shallow water equations. J Comput Phys 7:239–254

    Article  Google Scholar 

  • Hall MCG, Cacuci DG, Schlesinger ME (1982) Sensitivity analysis of a radiative-convective model by the adjoint method. J Atmos Sci 39(9):2038–2050

    Article  CAS  Google Scholar 

  • Hollingsworth A, Uppala S, Klinker E, Burridge D, Vitart F, Onvlee J, De Vries JW, De Roo AD, Pfrang C (2005) The transformation of earth-system observations into information of socio-economic value in geoss. Q J Royal Meteorol Soc 131(613):3493–3512

    Article  Google Scholar 

  • Ingleby NB (2001) The statistical structure of forecast errors and its representation in the met office global 3-d variational data assimilation scheme. Q J Royal Meteorol Soc 127(571):209–231

    Article  Google Scholar 

  • Isaksen L, Bonavita M, Buizza R, Fisher M, Haseler J, Leutbecher M, Raynaud L (2010) Ensemble of data assimilations at ECMWF. European Centre for Medium-Range Weather Forecasts

    Google Scholar 

  • Janisková M, Thépaut J-N, Geleyn J-F (1999) Simplified and regular physical parameterizations for incremental four-dimensional variational assimilation. Monthly Weather Rev 127(1):26–45

    Article  Google Scholar 

  • Kelley CT (1995) Iterative methods for linear and nonlinear equations. Number 16 in Frontiers in applied mathematics. SIAM

    Google Scholar 

  • Klinker E, Rabier F, Kelly G, Mahfouf J-F (2000) The ECMWF operational implementation of four-dimensional variational assimilation. III: experimental results and diagnostics with operational configuration. Q J Royal Meteorol Soc 126(564):1191–1215

    Google Scholar 

  • Lagrange JL (1762) Application de la méthode exposée dans le mémoire précédent à la solution des problèmes de dynamique différents. Œuvres de Lagrange (1867–1892) 1:151–316

    Google Scholar 

  • Lagrange JL (1761) Essai d’une nouvelle methode pour de’terminer les maxima, et les minima des formules integrales indefinies

    Google Scholar 

  • Lauvernet C, Baret F, Hascoët L, Buis S, Le Dimet F-X (2008) Multitemporal-patch ensemble inversion of coupled surface-atmosphere radiative transfer models for land surface characterization. Remote Sens Environ 112(3):851–861

    Article  Google Scholar 

  • Lawless AS (2010) A note on the analysis error associated with 3d-fgat. Q J Royal Meteorol Soc 136(649):1094–1098

    Article  Google Scholar 

  • Le Dimet F-X, Souopgui I, Titaud O, Shutyaev V (2014) Toward the assimilation of images. Nonlinear Proces Geophys Discuss 1:1381–1430

    Article  Google Scholar 

  • Le Dimet F-X, Navon IM, Daescu DN (2002) Second-order information in data assimilation. Monthly Weather Rev 130(3):629–648

    Article  Google Scholar 

  • Le Dimet F-X, Ngodock HE, Luong B, Verron J (1997) Sensitivity analysis in variational data assimilation. J Meteorol Soc Jpn Ser 2(75):135–145

    Google Scholar 

  • Le Dimet F-X, Talagrand O (1986) Variational algorithms for analysis and assimilation of meteorological observations: theoretical aspects. Tellus A 38(2):97–110

    Article  Google Scholar 

  • Li Z, Navon IM, Zhu Y (2000) Performance of 4D-Var with different strategies for the use of adjoint physics with the FSU global spectral model. Monthly Weather Rev 128(3):668–688

    Article  Google Scholar 

  • Lions JL (1968) Contrôle optimal de systemes gouvernés par des équations aux dérivées partielles. Gauthier-Villars, Paris

    Google Scholar 

  • Lions JL (1971) Optimal control of systems governed by partial differential equations, vol 170. Springer

    Google Scholar 

  • Liu DC, Nocedal J (1989) On the limited memory BFGS method for large scale optimization. Math Progr 45(1–3):503–528

    Article  Google Scholar 

  • Lorenc AC (1986) Analysis methods for numerical weather prediction. Royal Meteorol Soc Q J 112:1177–1194

    Article  Google Scholar 

  • Lorenc AC (2003) The potential of the ensemble Kalman filter for NWP-a comparison with 4D-Var. QJR Meteorol Soc 129:3183–3203

    Article  Google Scholar 

  • Lugenberger DG (1984) Linear and nonlinear programming. Addison-Wesley, New York

    Google Scholar 

  • Lupu C, Cardinali C, McNally T (2014) Evaluation of observation impact and observation error covariance retuning. Presented at The World Weather Open Science Conference, Montreal Canada

    Google Scholar 

  • Marchuk GI (1982) Mathematical issues of industrial effluent optimization. J Meteorol Soc Jpn 60(1):481–485

    CAS  Google Scholar 

  • McLaughlin D, O’Neill A, Derber J, Kamachi M (2005) Opportunities for enhanced collaboration within the data assimilation community. Q J Royal Meteorol Soc 131(613):3683–3694

    Article  Google Scholar 

  • Navon IM, De Villiers R (1986) GUSTAF: a Quasi-Newton nonlinear ADI FORTRAN IV program for solving the Shallow-Water equations with augmented Lagrangians. Comput Geosci 12(2):151–173

    Article  Google Scholar 

  • Navon IM, Zou X, Derber J, Sela J (1992) Variational data assimilation with an adiabatic version of the nmc spectral model. Monthly Weather Rev 120(7):1433–1446

    Article  Google Scholar 

  • Navon IM (1981) Implementation of a posteriori methods for enforcing conservation of potential enstrophy and mass in discretized shallow-water equations models. Monthly Weather Rev 109(5):946–958

    Article  Google Scholar 

  • Navon IM, De Villiers R (1983) Combined penalty multiplier optimization methods to enforce integral invariants conservation. Monthly Weather Rev 111(6):1228–1243

    Article  Google Scholar 

  • Navon IM, Legler DM (1987) Conjugate-gradient methods for large-scale minimization in meteorology. Monthly Weather Rev 115(8):1479–1502

    Article  Google Scholar 

  • Park SK, Županski D (2003) Four-dimensional variational data assimilation for mesoscale and storm-scale applications. Meteorol Atmos Phys 82(1–4):173–208

    Google Scholar 

  • Parrish DF, Derber JC (1992) The National Meteorological Center’s spectral statistical-interpolation analysis system. Monthly Weather Rev 120(8):1747–1763

    Article  Google Scholar 

  • Pontryagin LS, Boltyanskii VG, Gamkrelidze RV, Mishchenko E (1962) The mathematical theory of optimal processes (international series of monographs in pure and applied mathematics). Interscience, New York

    Google Scholar 

  • Powell MJD (1982) Nonlinear optimization. In: Powell MJD (ed) NATO conference series. Series II: systems science, proceedings of the NATO Advanced Research Institute, held at Cambridge (UK), vol 1. Academic Press, London

    Google Scholar 

  • Rabier F (2005) Overview of global data assimilation developments in numerical weather-prediction centres. Q J Royal Meteorol Soc 131(613):3215–3233

    Article  Google Scholar 

  • Rabier F, Järvinen H, Klinker E, J-F Mahfouf J-F, Simmons A (2007) The ecmwf operational implementation of four-dimensional variational assimilation. I: experimental results with simplified physics. Q J Royal Meteorol Soc 126(564):1143–1170

    Google Scholar 

  • Ritz W (1908) Über eine neue Methode zur Lösung gewisser Variationsprobleme der mathematischen Physik. J Reine Phys Math 135:1–61

    Google Scholar 

  • Saad Y (1994) Sparsekit: a basic tool kit for sparse matrix computations. Technical Report, Computer Science Department, University of Minnesota

    Google Scholar 

  • Saad Y (2003) Iterative methods for sparse linear systems, 2nd edn. Society for Industrial and Applied Mathematics, Philadelphia, PA, USA

    Book  Google Scholar 

  • Sasaki Y (1958) An objective analysis based on the variational method. J Meteorol Soc Jpn 36(3):77–88

    Google Scholar 

  • Sasaki Y (1969) Proposed inclusion of time variation terms, observational and theoretical, in numerical variational objective analysis. J Meteorol Soc Jpn 47(2):ll5–124

    Google Scholar 

  • Sasaki Y (1970a) Numerical variational analysis formulated under the constraints as determined by longwave equations and a low-pass filter. Monthly Weather Rev 98(12):884–898

    Article  Google Scholar 

  • Sasaki Y (1970b) Some basic formalisms in numerical variational analysis. Monthly Weather Rev 98(12):875–883

    Article  Google Scholar 

  • Sasaki Y (1976) Variational design of finite-difference schemes for initial value problems with an integral invariant. J Comput Phys 21(3):270–278

    Article  Google Scholar 

  • Sasaki Y, Gu P, Yan L (1955) A fundamental study of the numerical prediction based on the variational principle. J Meteorol Soc Jpn 33(6):262–275

    Google Scholar 

  • Shanno DF, Phua KH (1980) Remark on algorithm 500-a variable method subroutine for unconstrained nonlinear minimization. ACM Trans Math Softw 6:618–622

    Article  Google Scholar 

  • Shutyaev V, Gejadze I, Copeland GJM, Le Dimet F-X (2012) Optimal solution error covariance in highly nonlinear problems of variational data assimilation. Nonlinear Process Geophys 19(2):177–184

    Article  Google Scholar 

  • Simmons AJ, Hollingsworth A (2002) Some aspects of the improvement in skill of numerical weather prediction. Q J Royal Meteorol Soc 128(580):647–677

    Article  Google Scholar 

  • Ştefănescu R, Navon IM (2013) POD/DEIM Nonlinear model order reduction of an ADI implicit shallow water equations model. J Comput Phys 237:95–114

    Article  Google Scholar 

  • Ştefănescu R, Sandu A, Navon IM (2015) POD/DEIM reduced-order strategies for efficient four dimensional variational data assimilation. J Comput Phys 295:569–595

    Article  Google Scholar 

  • Stephens JJ (1966) A variational approach to numerical weather analysis and prediction. PhD thesis, Texas A & M University, College-Station, TX, 77863

    Google Scholar 

  • Stephens JJ (1968) Variational resolution of wind components. Monthly Weather Rev 96:229–231

    Article  Google Scholar 

  • Trémolet Y (2007) Incremental 4d-var convergence study. Tellus A 59(5):706–718

    Article  Google Scholar 

  • Trémolet Y (2008) Computation of observation sensitivity and observation impact in incremental variational data assimilation. Tellus A 60(5):964–978

    Article  Google Scholar 

  • Tsuyuki T (1997) Variational data assimilation in the Tropics using precipitation data. Part III: assimilation of SSM/I precipitation rates. Monthly Weather Rev 125(7):1447–1464

    Google Scholar 

  • Veersé F, Thepaut J-N (1998) Multiple-truncation incremental approach for four-dimensional variational data assimilation. Q J Royal Meteorol Soc 124(550):1889–1908

    Article  Google Scholar 

  • Vieux BE, LeDimet F, Armand D (1998) Inverse problem formulation for spatially distributed river basin model calibration using the adjoint method. EGS, Annales Geophysicae, Part II, Hydrology, Oceans and Atmosphere, Supplement II to 16:C501

    Google Scholar 

  • Wahba G (1975) Smoothing noisy data with spline functions. Numerische Mathematik 24(5):383–393

    Article  Google Scholar 

  • Wahba G (1981a) Some new techniques for variational objective analysis on the sphere using splines. hough-functions, and sample spectral data. In: Proceedings of 7th conference on probability and statistics in the atmospheric sciences, Monterey, California, pp 213–216

    Google Scholar 

  • Wahba G (1981b) Spline interpolation and smoothing on the sphere. SIAM J Sci Stat Comput 2(1):5–16

    Article  Google Scholar 

  • Wahba G, Wendelberger J (1980) Some new mathematical methods for variational objective analysis using splines and cross validation. Monthly Weather Rev 108(8):1122–1143

    Article  Google Scholar 

  • Washington WM, Duquet RJ (1963) An objective analysis of stratospheric data by Sasaki’s method. Department of Meteorology, Penn. State University, University Park, PA, 16802:23

    Google Scholar 

  • Whitaker JS, Hamill TM (2002) Ensemble data assimilation without perturbed observations. Monthly Weather Rev 130(7):1913–1924

    Article  Google Scholar 

  • Wu L, Le Dimet F-X, De Reffye P, Hu B-G, Cournède P-H, Kang M-Z (2012) An optimal control methodology for plant growth-case study of a water supply problem of sunflower. Math Comput Simul 82(5):909–923

    Article  Google Scholar 

  • Županski D, Mesinger F (1995) Four-dimensional variational assimilation of precipitation data. Monthly Weather Rev 123(4):1112–1127

    Google Scholar 

  • Županski D, Županski M, Rogers E, Parrish DF, DiMego GJ (2002) Fine-resolution 4DVAR data assimilation for the Great Plains tornado outbreak of 3 May 1999. Weather Forecast 17(3):506–525

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Lab.Jean-Kuntzman, Université Grenoble-Alpes, BP 53, 38041, GRENOBLE Cedex 9, France

    François-Xavier Le Dimet

  2. Department of Scientific Computing, Florida State University, 483 Dirac Science Library, Tallahassee, FL, USA

    Ionel M. Navon

  3. Department of Mathematics, North Carolina State University, Box 8205, Raleigh, NC, USA

    Răzvan Ştefănescu

Authors
  1. François-Xavier Le Dimet
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ionel M. Navon
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Răzvan Ştefănescu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to François-Xavier Le Dimet .

Editor information

Editors and Affiliations

  1. Environmental Science and Engineering, Ewha Womans University, Seoul, Korea (Republic of)

    Seon Ki Park

  2. Marine Meteorology Division, Naval Research Laboratory, Monterey, California, USA

    Liang Xu

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing Switzerland

About this chapter

Cite this chapter

Le Dimet, FX., Navon, I.M., Ştefănescu, R. (2017). Variational Data Assimilation: Optimization and Optimal Control. In: Park, S., Xu, L. (eds) Data Assimilation for Atmospheric, Oceanic and Hydrologic Applications (Vol. III). Springer, Cham. https://doi.org/10.1007/978-3-319-43415-5_1

Download citation

Publish with us

Policies and ethics

Search

Navigation