Chapter

Pattern Recognition

Volume 662 of the series Communications in Computer and Information Science pp 742-751

Date:

The Necessary and Sufficient Conditions for the Existence of the Optimal Solution of Trace Ratio Problems

  • Guoqiang ZhongAffiliated withDepartment of Computer Science and Technology, Ocean University of China Email author 
  • , Xiao LingAffiliated withDepartment of Computer Science and Technology, Ocean University of China

* Final gross prices may vary according to local VAT.

Get Access

Abstract

Many dimensionality reduction problems can be formulated as a trace ratio form, i.e. \(\hbox {argmax}_\mathbf{W}Tr(\mathbf{W}^T \mathbf{S}_p \mathbf{W}) / Tr(\mathbf{W}^T \mathbf{S}_t \mathbf{W})\), where \(\mathbf{S}_p\) and \(\mathbf{S}_t\) represent the (dis)similarity between data, \(\mathbf{W}\) is the projection matrix, and \(Tr(\cdot )\) is the trace of a matrix. Some representative algorithms of this category include principal component analysis (PCA), linear discriminant analysis (LDA) and marginal Fisher analysis (MFA). Previous research focuses on how to solve the trace ratio problems with either (generalized) eigenvalue decomposition or iterative algorithms. In this paper, we analyze an algorithm that transforms the trace ratio problems into a series of trace difference problems, i.e. \(\hbox {argmax}_\mathbf{W}Tr[(\mathbf{W}^T (\mathbf{S}_p - \lambda \mathbf{S}_t )\mathbf{W}]\), and propose the necessary and sufficient conditions for the existence of the optimal solution of trace ratio problems. The correctness of this theoretical result is proved. To evaluate the applied algorithm, we tested it on three face recognition applications. Experimental results demonstrate its convergence and effectiveness.

Keywords

Trace ratio problems Dimensionality reduction Convergence Necessary and sufficient conditions