Large margin deep embedding for aesthetic image classification


We present an LMDE method with a novel network structure and an effective joint loss function, which takes advantage of both the triplet loss function and the hinge loss function. The minimization of the joint loss function ensures that the intra-class variability of the features belonging to the same class is reduced and the inter-class separability of the features from different classes is increased. As shown in the experiments, the proposed LMDE method significantly outperforms several other state-of-the-art aesthetic classification methods in terms of classification accuracy.

This is a preview of subscription content, access via your institution.


  1. 1

    Tang X O, Luo W, Wang X G. Content-based photo quality assessment. IEEE Trans Multimedia, 2013, 15: 1930–1943

    Article  Google Scholar 

  2. 2

    Datta R, Joshi D, Li J, et al. Studying aesthetics in photographic images using a computational approach. In: Proceedings of European Conference on Computer Vision, 2006. 288–301

  3. 3

    Guo G J, Wang H Z, Shen C H, et al. Automatic image cropping for visual aesthetic enhancement using deep neural networks and cascaded regression. IEEE Trans Multimedia, 2018, 20: 2073–2085

    Article  Google Scholar 

  4. 4

    Pang Y W, Wang S, Yuan Y. Learning regularized LDA by clustering. IEEE Trans Neural Netw Learn Syst, 2014, 25: 2191–2201

    Article  Google Scholar 

  5. 5

    Krizhevsky A, Sutskever I, Hinton G H. ImageNet classification with deep convolutional neural networks. In: Proceedings of the 25th International Conference on Neural Information Processing Systems, 2012. 1097–1105

  6. 6

    Jiang X H, Pang Y W, Sun M L, et al. Cascaded subpatch networks for effective CNNs. IEEE Trans Neural Netw Learn Syst, 2018, 29: 2684–2694

    MathSciNet  Google Scholar 

  7. 7

    Schroff F, Kalenichenko D, Philbin J. Facenet: a unified embedding for face recognition and clustering. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, 2015. 815–823

  8. 8

    Rojas R. Neural Networks: A Systematic Introduction. Berlin: Springer, 1996

    Google Scholar 

  9. 9

    Duchi J, Hazan E, Singer Y. Adaptive subgradient methods for online learning and stochastic optimization. J Mach Learn Res, 2011, 12: 2121–2159

    MathSciNet  MATH  Google Scholar 

Download references


This work was supported by National Natural Science Foundation of China (Grant Nos. U1605252, 61872307, 61472334, 61571379), National Key R&D Program of China (Grant No. 2017YFB1302400), and UM Multi-Year Research (Grant No. MYRG2017-00218-FST).

Author information



Corresponding author

Correspondence to Hanzi Wang.

Supplementary File

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Guo, G., Wang, H., Yan, Y. et al. Large margin deep embedding for aesthetic image classification. Sci. China Inf. Sci. 63, 119101 (2020).

Download citation