Studying Aesthetics in Photographic Images Using a Computational Approach

  • Ritendra Datta
  • Dhiraj Joshi
  • Jia Li
  • James Z. Wang
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3953)


Aesthetics, in the world of art and photography, refers to the principles of the nature and appreciation of beauty. Judging beauty and other aesthetic qualities of photographs is a highly subjective task. Hence, there is no unanimously agreed standard for measuring aesthetic value. In spite of the lack of firm rules, certain features in photographic images are believed, by many, to please humans more than certain others. In this paper, we treat the challenge of automatically inferring aesthetic quality of pictures using their visual content as a machine learning problem, with a peer-rated online photo sharing Website as data source. We extract certain visual features based on the intuition that they can discriminate between aesthetically pleasing and displeasing images. Automated classifiers are built using support vector machines and classification trees. Linear regression on polynomial terms of the features is also applied to infer numerical aesthetics ratings. The work attempts to explore the relationship between emotions which pictures arouse in people, and their low-level content. Potential applications include content-based image retrieval and digital photography.


Support Vector Machine Visual Feature Image Retrieval Photographic Image Aesthetic Quality 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
  2. 2.
    Arnheim, R.: Art and Visual Perception: A Psychology of the Creative Eye. University of California Press, Berkeley (1974)Google Scholar
  3. 3.
  4. 4.
    Barnard, K., Duygulu, P., Forsyth, D., de. Freitas, N., Blei, D.M., Jordan, M.I.: Matching Words and Pictures. J. Machine Learning Research 3, 1107–1135 (2003)zbMATHCrossRefGoogle Scholar
  5. 5.
    Blum, A.L., Langley, P.: Selection of Relevant Features and Examples in Machine Learning. Artificial Intelligence 97(1-2), 245–271 (1997)zbMATHCrossRefMathSciNetGoogle Scholar
  6. 6.
    Carson, C., Belongie, S., Greenspan, H., Malik, J.: Blobworld: Color and Texture-Based Image Segmentation using EM and its Application to Image Querying and Classification. IEEE Trans. on Pattern Analysis and Machine Intelli. 24(8), 1026–1038 (2002)CrossRefGoogle Scholar
  7. 7.
    Chen, C.-c., Wactlar, H., Wang, J.Z., Kiernan, K.: Digital Imagery for Significant Cultural and Historical Materials - An Emerging Research Field Bridging People, Culture, and Technologies. Int’l J. on Digital Libraries 5(4), 275–286 (2005)CrossRefGoogle Scholar
  8. 8.
    Breiman, L., Friedman, J.H., Olshen, R.A., Stone, C.J.: Classification and Regression Trees, Wadsworth, Belmont, CA (1983)Google Scholar
  9. 9.
    Chang, C.-c., Lin, C.-j.: LIBSVM: A Library for SVM (2001),
  10. 10.
    Daubechies, I.: Ten Lectures on Wavelets. SIAM, Philadelphia (1992)zbMATHGoogle Scholar
  11. 11.
  12. 12.
    Li, J., Wang, J.Z.: Automatic Linguistic Indexing of Pictures by a Statistical Modeling Approach. IEEE Trans. on Pattern Analysis and Machine Intelli. 25(9), 1075–1088 (2003)CrossRefGoogle Scholar
  13. 13.
    Ma, W.Y., Manjunath, B.S.: NeTra: A Toolbox for Navigating Large Image Databases. Multimedia Systems 7(3), 184–198 (1999)CrossRefGoogle Scholar
  14. 14.
    Manjunath, B.S., Ma, W.Y.: Texture Features for Browsing and Retrieval of Image Data. IEEE Trans. on Pattern Analysis and Machine Intelli. 18(8), 837–842 (1996)CrossRefGoogle Scholar
  15. 15.
  16. 16.
  17. 17.
    Rubner, Y., Tomasi, C., Guibas, L.J.: The Earth Mover’s Distance as a Metric for Image Retrieval. Int’l. J. Computer Vision 4(2), 99–121 (2000)CrossRefGoogle Scholar
  18. 18.
    Smeulders, A.W., Worring, M., Santini, S., Gupta, A., Jain, R.: Content-Based Image Retrieval at the End of the Early Years. IEEE Trans. on Pattern Analysis and Machine Intelli. 22(12), 1349–1380 (2000)CrossRefGoogle Scholar
  19. 19.
    Therneau, T.M., Atkinson, E.J.: An Introduction to Recursive Partitioning Using RPART Routines. Technical Report, Mayo Foundation (1997)Google Scholar
  20. 20.
    Vapnik, V.: The Nature of Statistical Learning Theory. Springer, Heidelberg (1995)zbMATHGoogle Scholar
  21. 21.
    Wang, J.Z., Li, J., Wiederhold, G.: SIMPLIcity: Semantics-Sensitive Integrated Matching for Picture Libraries. IEEE Trans. on Pattern Analysis and Machine Intelli. 23(9), 947–963 (2001)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Ritendra Datta
    • 1
  • Dhiraj Joshi
    • 1
  • Jia Li
    • 1
  • James Z. Wang
    • 1
  1. 1.The Pennsylvania State UniversityUniversity ParkUSA

Personalised recommendations