Abstract
In this paper, a discriminative structured dictionary learning algorithm is presented. To enhance the dictionary’s discriminative power, the reconstruction error, classification error and inhomogeneous representation error are integrated into the objective function. The proposed approach learns a single structured dictionary and a linear classifier jointly. The learned dictionary encourages the samples from the same class to have similar sparse codes, and the samples from different classes to have dissimilar sparse codes. The solution to the objective function is achieved by employing a feature-sign search algorithm and Lagrange dual method. Experimental results on three public databases demonstrate that the proposed approach outperforms several recently proposed dictionary learning techniques for classification.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Aharon M, Elad M, Bruckstein A. K-SVD: An algorithm for designing overcomplete dictionaries for sparse representation[J]. IEEE Transactions on Signal Processing, 2006, 54(11):4311–4322.
Elad M, Aharon M. Image denoising via sparse and redundant representations over learned dictionaries[J]. IEEE Transactions on Image Processing, 2006, 15(12):3736–3745.
Wright J, Yang A Y, Ganesh A et al. Robust face recognition via sparse representation[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2009, 31(2):210–227.
Wang J, Yang J, Yu K et al. Locality-constrained linear coding for image classification[C]. In: IEEE Conference on Computer Vision and Pattern Recognition(CVPR). San Francisco, USA, 2010.
Wright J, Ma Y, Mairal J et al. Sparse representation for computer vision and pattern recognition[J]. Proceedings of the IEEE, 2010, 98(6):1031–1044.
Engan K, Aase S O, Hakon-Husoy J. Method of optimal directions for frame designs[C]. In: Proceedings of the International Conference on Acoustics, Speech and Signal Processing. Phoenix, USA, 1999.
Marial J, Bach F, Ponce J et al. Online learning for matrix factorization and sparse coding[J]. Journal of Machine Learning Research, 2010, 11: 19–60.
Lu C, Shi J, Jia J. Online robust dictionary learning[C]. In: IEEE Conference on Computer Vision and Pattern Recognition(CVPR). Portland, USA, 2013.
Mairal J, Bach F, Ponce J et al. Discriminative learned dictionaries for local image analysis[C]. In: IEEE Conference on Computer Vision and Pattern Recognition(CVPR). Anchorage, USA, 2008.
Mairal J, Bach F, Ponce J et al. Supervised dictionary learning[C]. In: Advances in Neural Information Processing Systems(NIPS). Vancouver and Whistler, Canada, 2008.
Yang M, Zhang L, Feng X et al. Fisher discrimination dictionary learning for sparse representation[C]. In: IEEE International Conference on Computer Vision(ICCV). Barcelona, Spain, 2011.
Ramirez I, Sprechmann P, Sapiro G. Classification and clustering via dictionary learning with structured incoherence and shared features[C]. In: IEEE Conference on Computer Vision and Pattern Recognition(CVPR). San Francisco, USA, 2010.
Yang J, Yu K, Gong Y et al. Linear spatial pyramid matching using sparse coding for image classification[C]. In: IEEE Conference on Computer Vision and Pattern Recognition(CVPR). Miami, SA, 2009.
Cai S, Zuo W, Zhang L et al. Support vector guided dictionary learning[C]. In: 13th European Conference on Computer Vision(ECCV). Zurich, witzerland, 2014.
Zhang Q, Li B. Discriminative K-SVD for dictionary learning in face recognition[C]. In: IEEE Conference on Computer Vision and Pattern Recognition(CVPR). San Francisco, USA, 2010.
Jiang Z, Lin Z, Davis L S. Learning a discriminative dictionary for sparse coding via label consistent K-SVD[C]. In: IEEE Conference on Computer Vision and Pattern Recognition(CVPR). Providence, USA, 2011.
Guo H, Jiang Z, Davis L S. Discriminative dictionary learning with pairwise constraints[C]. In: 11th Asian Conference on Computer Vision. Daejeon, Korea, 2012.
Zhang G, Jiang Z, Davis L S. Online semi-supervised discriminative dictionary learning for sparse representation[C]. In: 11th Asian Conference on Computer Vision. Daejeon, Korea, 2012.
Yang J, Wang J, Huang T. Learning the sparse representation for classification[C]. In: IEEE International Conference on Multimedia and Expo(ICME). Spain, 2011.
Olshausen B, Field D J. Sparse coding with an overcomplete basis set: A strategy employed by V1?[J]. Vision Research, 1997, 37(23):3311–3325.
Donoho D L. For most large underdetermined systems of linear equations the minimal l1-norm solution is also the sparsest solution[J]. Communications on Pure and Applied Mathematics, 2006, 59(6):797–829.
Lee H, Battle A, Raina K et al. Efficient sparse coding algorithms[C]. In: Advances in Neural Information Processing Systems(NIPS). Vancouver, Canada, 2006.
Georghiades A S, Belhumeur P N, Kriegman D J. From few to many: Illumination cone models for face recognition under variable lighting and pose[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2001, 23(6):643–660.
Martinez A, Benavente R. The AR Face Database[R]. Purdue University, USA, 1998.
Li F F, Fergus R, Perona P. Learning genetative visual models from few training examples: An incremental Bayesian approach tested on 101 object categories[C]. In: Conference on Computer Vision and Pattern Recognition Workshop. Washington DC, USA, 2004.
Author information
Authors and Affiliations
Corresponding author
Additional information
Supported by the National Natural Science Foundation of China(No. 61379014).
Wang Ping, born in 1967, female, Dr, Prof.
Rights and permissions
About this article
Cite this article
Wang, P., Lan, J., Zang, Y. et al. Discriminative structured dictionary learning for image classification. Trans. Tianjin Univ. 22, 158–163 (2016). https://doi.org/10.1007/s12209-016-2624-z
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12209-016-2624-z