Mathematical Programming

, Volume 63, Issue 1, pp 129–156

Representations of quasi-Newton matrices and their use in limited memory methods

  • Richard H. Byrd
  • Jorge Nocedal
  • Robert B. Schnabel
Article

DOI: 10.1007/BF01582063

Cite this article as:
Byrd, R.H., Nocedal, J. & Schnabel, R.B. Mathematical Programming (1994) 63: 129. doi:10.1007/BF01582063

Abstract

We derive compact representations of BFGS and symmetric rank-one matrices for optimization. These representations allow us to efficiently implement limited memory methods for large constrained optimization problems. In particular, we discuss how to compute projections of limited memory matrices onto subspaces. We also present a compact representation of the matrices generated by Broyden's update for solving systems of nonlinear equations.

Key words

Quasi-Newton methodconstrained optimizationlimited memory methodlarge-scale optimization

Copyright information

© The Mathematical Programming Society, Inc. 1994

Authors and Affiliations

  • Richard H. Byrd
    • 1
  • Jorge Nocedal
    • 2
  • Robert B. Schnabel
    • 1
  1. 1.Computer Science DepartmentUniversity of ColoradoBoulderUSA
  2. 2.Department of Electrical Engineering and Computer ScienceNorthwestern UniversityEvanstonUSA