Abstract
A general framework is proposed for what we call the sensitivity derivative Monte Carlo (SDMC) solution of optimal control problems with a stochastic parameter. This method employs the residual in the first-order Taylor series expansion of the cost functional in terms of the stochastic parameter rather than the cost functional itself. A rigorous estimate is derived for the variance of the residual, and it is verified by numerical experiments involving the generalized steady-state Burgers equation with a stochastic coefficient of viscosity. Specifically, the numerical results show that for a given number of samples, the present method yields an order of magnitude higher accuracy than a conventional Monte Carlo method. In other words, the proposed variance reduction method based on sensitivity derivatives is shown to accelerate convergence of the Monte Carlo method. As the sensitivity derivatives are computed only at the mean values of the relevant parameters, the related extra cost of the proposed method is a fraction of the total time of the Monte Carlo method.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
J. Borggaard, D. Pelletier, and E. Turgeon, “Parametric uncertainty analysis for thermal fluid calculations,” Journal of Nonlinear Analysis: Series A Theory and Methods, vol. 47, no. 7, pp. 4533-4543, 2001.
Y. Cao and M.Y. Hussaini, “On convergence of optimal control problem to exact control problem for systems governed by Navier-Stokes equations,” in Proceedings of ICNPPA-2000, 2001, vol. 1, pp. 117-126.
Y. Cao and D. Stanescu, “Shape optimization for noise radiation problems,” Comp. & Math. Appl., vol. 44, no. 12, pp. 1539-1556, 2002.
B. DeVolder, J. Glimm, J. Grove, Y. Kang, Y. Lee, K. Pao, D. Sharp, and K. Ye, “Uncertainty quantification for multiscale simulations,” J. Fluids Eng., vol. 124, pp. 29-41, 2002.
X. Du and W. Chen, “Towards a better understanding of modeling feasibility robustness in engineering design,” Amer. Soc. Mech. Eng., DAC-8565, Sept. 1999.
D. Gay, “Algorithm 611, subroutines for unconstrained minimization using a model/trust region approach,” ACM Transactions on Mathematical Software, vol. 9, no. 4, pp. 503-524, 1983.
J. Glimm and H. Sharp, “Prediction and the quantification of uncertainty,” Physica D, vol. 133, pp. 152-170, 1999.
M. Gunzburger, “Sensitivites, adjoints, and flow optimization,” Inter. J. Num. Meth. Fluids., vol. 31, pp. 53-78, 1999.
L. Huyse, “Solving problems of optimization under uncertainty as statistical decision problem,” AIAA Paper, 2001-1519, 2001.
L. Huyse and R. Walters, “Random field solutions including boundary condition uncertainty for the steady state generalized Burgers equation,” ICASE Report, 2001-35, 2001.
R. Joslin, M. Gunzburger, R. Nicolaides, G. Erlebacher, and M.Y. Hussaini, “A self contained, automated methodology for optimal flow control validated for transition delay,” AIAA Journal, vol. 35, pp. 816-824, 1997.
A. Parkinson, C. Sorenson, and N. Pourhassan, “A general approach for robust design,” J. Mech. Design, vol. 115, no. 1, pp. 74-80, 1993.
M. Putko, P. Newman, A. Taylor III, and L. Green, “Approach for uncertainty propagation and robust design in CFD using sensitivity derivatives,” AIAA Paper, 2001-2528, 2001.
P. Thandedar and S. Kodiyalam, “Structural optimization using probabilistic constraints,” Structure Opt., vol. 4, pp. 236-240, 1991.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Cao, Y., Hussaini, M. & Zang, T. An Efficient Monte Carlo Method for Optimal Control Problems with Uncertainty. Computational Optimization and Applications 26, 219–230 (2003). https://doi.org/10.1023/A:1026079021836
Issue Date:
DOI: https://doi.org/10.1023/A:1026079021836