Non-negative Locality-Constrained Linear Coding for Image Classification

  • GuoJun LiuEmail author
  • Yang Liu
  • MaoZu Guo
  • PeiNa Liu
  • ChunYu Wang
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9242)


The most important issue of image classification algorithm based on feature extraction is how to efficiently encode features. Locality-constrained linear coding (LLC) has achieved the state of the art performance on several benchmarks, due to its underlying properties of better construction and local smooth sparsity. However, the negative code may make LLC more unstable. In this paper, a novel coding scheme is proposed by adding an extra non-negative constraint based on LLC. Generally, the new model can be solved by iterative optimization methods. Moreover, to reduce the encoding time, an approximated method called NNLLC is proposed, more importantly, its computational complexity is similar to LLC. On several widely used image datasets, compared with LLC, the experimental results demonstrate that NNLLC not only can improve the classification accuracy by about 1–4 percent, but also can run as fast as LLC.


Locality-constrained Linear Coding (LLC) Non-negative constraint Spatial Pyramid Matching (SPM) Image classification 



This work was supported by the Fundamental Research Funds for the Central Universities (Grant No. HIT.NSRIF.2014069), Heilongjiang Province Science Foundation for Youths (Grant No. QC2014C071), National Natural Science Foundation of China (Grant No. 61173087, 61171185, 61271346), and Specialized Research Fund for the Doctoral Program of Higher Education of China (Grant No. 20112302110040).


  1. 1.
    Sivic, J., Zisserman, A.: Video google: a text retrieval approach to object matching in videos. In: Ninth IEEE International Conference on Computer Vision, Nice, France, October 2003Google Scholar
  2. 2.
    Csurka, G., Dance, C.R., Fan, L., Willamowski, J., Bray, C.: Visual categorization with bags of keypoints. In: Workshop on Statistical Learning in Computer Vision, ECCV, Prague, Czech Republic, pp. 1–22, May 2004Google Scholar
  3. 3.
    Zhao, Z.Q., Ji, H.F., Gao, J., Hu, D.H., Wu, X.D.: Image classification of multi-scale space latent semantic analysis based on sparse coding. Chin. J. Comput. 37(6), 1251–1260 (2014)Google Scholar
  4. 4.
    Lazebnik, S., Schmid, C., Ponce, J.: Beyond bags of features: spatial pyramid matching for recognizing natural scene categories. In: IEEE Conference on Computer Vision and Pattern Recognition. vol. 2, pp. 2169–2178, New York, USA, June 2006Google Scholar
  5. 5.
    Li, Q.: Image classification research of improved non-negative sparse coding. Master’s thesis, Nanjing University of Science and Technology (2014)Google Scholar
  6. 6.
    Yang, J., Yu, K., Gong, Y., Huang, T.: Linear spatial pyramid matching using sparse coding for image classification. In: IEEE Conference on Computer Vision and Pattern Recognition, Miami, USA, 1794–1801, June 2009Google Scholar
  7. 7.
    Yang, J., Wang, J., Huang, T.: Learning the sparse representation for classification. In: IEEE International Conference on Multimedia and Expo, Barcelona, Spanish, pp. 1–6 (2011)Google Scholar
  8. 8.
    Wang, J., Yang, J., Yu, K., Lv, F., Huang, T., Gong, Y.: Locality-constrained linear coding for image classification. In: IEEE Conference on Computer Vision and Pattern Recognition, San Francisco, USA, pp. 3360–3367, June 2010Google Scholar
  9. 9.
    Yu, K., Zhang, T., Gong, Y.: Nonlinear learning using local coordinate coding. In: Advances in Neural Information Processing Systems, Vancouver, Canada, pp. 2223–2231, December 2009Google Scholar
  10. 10.
    Hoyer, P.O.: Non-negative sparse coding. In: IEEE Workshop on Neural Networks for Signal Processing, pp. 557–565 (2002)Google Scholar
  11. 11.
    Lin, T.H., Kung, H.T.: Stable and efficient representation learning with non-negativity constraints. In: Proceedings of the 31st International Conference on Machine Learning, Beijing, China, pp. 1323–1331 (2014)Google Scholar
  12. 12.
    Zhang, C., Liu, J., Tian, Q., Xu, C., Lu, H., Ma, S.: Image classification by non-negative sparse coding, low-rank and sparse decomposition. In: IEEE Conference on Computer Vision and Pattern Recognition, Colorado Springs, USA, pp. 1673–1680, June 2011Google Scholar
  13. 13.
    Li, F.F., Fergus, R., Perona, P.: Learning generative visual models from few training examples: an incremental Bayesian approach tested on 101 object categories. Comput. Vis. Image Underst. 106(1), 59–70 (2007)CrossRefGoogle Scholar
  14. 14.
    Griffin, G., Holub, A., Perona, P.: Caltech-256 object category dataset. Technical report CNS-TR-2007-001, California Institute of Technology (2007)Google Scholar
  15. 15.
    Gao, S., Tsang, I., Chia, L.T., Zhao, P.: Local features are not lonely-laplacian sparse coding for image classification. In: IEEE Conference on Computer Vision and Pattern Recognition, San Francisco, USA, pp. 3555–3561, June 2010Google Scholar
  16. 16.
    Fan, R.E., Chang, K.W., Hsieh, C.J., Wang, X.R., Lin, C.J.: Liblinear: a library for large linear classification. J. Mach. Learn. Res. 9, 1871–1874 (2008)zbMATHGoogle Scholar
  17. 17.
    van Gemert, J.C., Geusebroek, J.-M., Veenman, C.J., Smeulders, A.W.M.: Kernel codebooks for scene categorization. In: Forsyth, D., Torr, P., Zisserman, A. (eds.) ECCV 2008, Part III. LNCS, vol. 5304, pp. 696–709. Springer, Heidelberg (2008) CrossRefGoogle Scholar
  18. 18.
    Zhang, H., Berg, A., Maire, M., Malik, J.: Svm-knn: discriminative nearest neighbor classification for visual category recognition. In: IEEE Conference on Computer Vision and Pattern Recognition, vol. 2, pp. 2126–2136, New York, USA, June 2006Google Scholar
  19. 19.
    Boiman, O., Shechtman, E., Irani, M.: In defense of nearest-neighbor based image classification. In: IEEE Conference on Computer Vision and Pattern Recognition, Anchorage, Alaska, USA, pp. 1–8, June 2008Google Scholar
  20. 20.
    Kulis, B., Jain, P., Grauman, K.: Fast similarity search for learned metrics. IEEE Trans. Pattern Anal. Mach. Intell. 31(12), 2143–2157 (2009)CrossRefGoogle Scholar
  21. 21.
    Yuan, X.T., Yan, S.: Visual classification with multi-task joint sparse representation. In: IEEE Conference on Computer Vision and Pattern Recognition, San Francisco, USA, pp. 3493–3500, June 2010Google Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  • GuoJun Liu
    • 1
    Email author
  • Yang Liu
    • 1
  • MaoZu Guo
    • 1
  • PeiNa Liu
    • 1
  • ChunYu Wang
    • 1
  1. 1.School of Computer Science and TechnologyHarbin Institute of TechnologyHarbinChina

Personalised recommendations