Journal of Global Optimization

, Volume 27, Issue 2, pp 177–192

Numerical Solution of Hamilton-Jacobi-Bellman Equations by an Upwind Finite Volume Method

  • S. Wang
  • L.S. Jennings
  • K.L. Teo
Article

DOI: 10.1023/A:1024980623095

Cite this article as:
Wang, S., Jennings, L. & Teo, K. Journal of Global Optimization (2003) 27: 177. doi:10.1023/A:1024980623095

Abstract

In this paper we present a finite volume method for solving Hamilton-Jacobi-Bellman(HJB) equations governing a class of optimal feedback control problems. This method is based on a finite volume discretization in state space coupled with an upwind finite difference technique, and on an implicit backward Euler finite differencing in time, which is absolutely stable. It is shown that the system matrix of the resulting discrete equation is an M-matrix. To show the effectiveness of this approach, numerical experiments on test problems with up to three states and two control variables were performed. The numerical results show that the method yields accurate approximate solutions to both the control and the state variables.

Optimal feedback controlHamilton-Jacobi-Bellman equationfinite volume methodViscosity solutionupwind finite difference

Copyright information

© Kluwer Academic Publishers 2003

Authors and Affiliations

  • S. Wang
    • 1
  • L.S. Jennings
    • 1
  • K.L. Teo
    • 2
  1. 1.Centre for Applied Dynamics and Optimization, Department of Mathematics and StatisticsThe University of Western AustraliaCrawleyAustralia
  2. 2.Department of Applied MathematicsHong Kong Polytechnic UniversityHung Hom, KowloonHong Kong