Artistic Image Classification: An Analysis on the PRINTART Database

  • Gustavo Carneiro
  • Nuno Pinho da Silva
  • Alessio Del Bue
  • João Paulo Costeira
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7575)


Artistic image understanding is an interdisciplinary research field of increasing importance for the computer vision and the art history communities. For computer vision scientists, this problem offers challenges where new techniques can be developed; and for the art history community new automatic art analysis tools can be developed. On the positive side, artistic images are generally constrained by compositional rules and artistic themes. However, the low-level texture and color features exploited for photographic image analysis are not as effective because of inconsistent color and texture patterns describing the visual classes in artistic images. In this work, we present a new database of monochromatic artistic images containing 988 images with a global semantic annotation, a local compositional annotation, and a pose annotation of human subjects and animal types. In total, 75 visual classes are annotated, from which 27 are related to the theme of the art image, and 48 are visual classes that can be localized in the image with bounding boxes. Out of these 48 classes, 40 have pose annotation, with 37 denoting human subjects and 3 representing animal types. We also provide a complete evaluation of several algorithms recently proposed for image annotation and retrieval. We then present an algorithm achieving remarkable performance over the most successful algorithm hitherto proposed for this problem. Our main goal with this paper is to make this database, the evaluation process, and the benchmark results available for the computer vision community.


Training Image Mean Average Precision Image Annotation Matrix Completion Retrieval Problem 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Graham, D., Friedenberg, J., Rockmore, D., Field, D.: Mapping the similarity space of paintings: image statistics and visual perception. Visual Cognition 18, 559–573 (2010)CrossRefGoogle Scholar
  2. 2.
    Li, J., Yao, L., Hendriks, E., Wang, J.: Rhythmic brushstrokes distinguish van gogh from his contemporaries: Findings via automated brushstroke extraction. IEEE TPAMI (accepted for publication in 2012)Google Scholar
  3. 3.
    Baumann, F., et al.: Degas Portraits. Merrell Holberton, London (1994)Google Scholar
  4. 4.
    Csurka, G., Dance, C., Fan, L., Willamowski, J., Bray, C.: Visual categorization with bags of keypoints. In: Workshop on Statistical Learning in Computer Vision, ECCV, pp. 1–22 (2004)Google Scholar
  5. 5.
    Zhou, D., Bousquet, O., Lal, T., Weston, J., Scholkopf, B.: Learning with local and global consistency. In: NIPS, pp. 321–328 (2004)Google Scholar
  6. 6.
    Carneiro, G.: Graph-based methods for the automatic annotation and retrieval of art prints. In: Proceedings of the ACM ICMR (2011)Google Scholar
  7. 7.
    Goldberg, A.B., Zhu, X., Recht, B., Xu, J., Nowak, R.D.: Transduction with matrix completion: Three birds with one stone. In: NIPS, pp. 757–765 (2010)Google Scholar
  8. 8.
    Tsochantaridis, I., Joachims, T., Hofmann, T., Altun, Y.: Large margin methods for structured and interdependent output variables. JMLR 6, 1453–1484 (2005)MathSciNetzbMATHGoogle Scholar
  9. 9.
  10. 10.
    Johnson, C., Hendriks, E., Berezhnoy, I., Brevdo, E., Hughes, S., Daubechies, I., Li, J., Postma, E., Wang, J.: Image processing for artistic identification: Computerized analysis of Vincent Van Goghs brushstrokes. IEEE Sig. Proc. Ma., 37–48 (2008)Google Scholar
  11. 11.
    Li, J., Wang, J.: Studying digital imagery of ancient paintings by mixtures of stochastic models. IEEE Trans. Image Processing 13, 340–353 (2004)CrossRefGoogle Scholar
  12. 12.
    Yelizaveta, M., Tat-Seng, C., Jain, R.: Semi-supervised annotation of brushwork in paintings domain using serial combinations of multiple experts. In: ACM Multimedia, pp. 529–538 (2006)Google Scholar
  13. 13.
  14. 14.
    Nowak, S., Lukashevich, H., Dunker, P., Rüger, S.: Performance measures for multilabel evaluation: a case study in the area of image classification. In: Multimedia Information Retrieval, pp. 35–44 (2010)Google Scholar
  15. 15.
    Everingham, M., Van Gool, L.J., Williams, C., Winn, J., Zisserman, A.: The pascal visual object classes (voc) challenge. IJCV 88, 303–338 (2010)CrossRefGoogle Scholar
  16. 16.
    Lazebnik, S., Schmid, C., Ponce, J.: Beyond bags of features, spatial pyramid matching for recognizing natural scene categories. In: CVPR (2006)Google Scholar
  17. 17.
    Lowe, D.: Distinctive image features from scale-invariant keypoints. IJCV 60, 91–110 (2004)CrossRefGoogle Scholar
  18. 18.
    Nistér, D., Stewénius, H.: Scalable recognition with a vocabulary tree. In: CVPR, pp. 2161–2168 (2006)Google Scholar
  19. 19.
  20. 20.
    de Sande, K.V., Gevers, T., Smeulders, A.: The university of amsterdams concept detection system at imageclef 2009. In: CLEF Working Notes 2009 (2009)Google Scholar
  21. 21.
    Wang, H., Huang, H., Ding, C.: Image annotation using multi-label correlated green’s function. In: ICCV, pp. 2029–2034 (2009)Google Scholar
  22. 22.
    Zha, Z., Mei, T., Wang, J., Wang, Z., Hua, X.: Graph-based semi-supervised learning with multi-label. In: ICME, pp. 1321–1324 (2008)Google Scholar
  23. 23.
    Zhu, X., Ghahramani, Z., Lafferty, J.: Semi-supervised learning using gaussian fields and harmonic functions. In: ICML, pp. 912–919 (2003)Google Scholar
  24. 24.
    Grady, L.: Random walks for image segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 28, 1768–1783 (2006)CrossRefGoogle Scholar
  25. 25.
    Vedaldi, A., Fulkerson, B.: VLFeat: An open and portable library of computer vision algorithms (2008)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Gustavo Carneiro
    • 1
  • Nuno Pinho da Silva
    • 2
  • Alessio Del Bue
    • 3
  • João Paulo Costeira
    • 2
  1. 1.Australian Centre for Visual TechnologiesThe University of AdelaideAustralia
  2. 2.Instituto de Sistemas e RobóticaInstituto Superior TécnicoPortugal
  3. 3.PAVISIstituto Italiano di Tecnologia (IIT)Italy

Personalised recommendations