An Open Access Platform for Analyzing Artistic Style Using Semantic Workflows
- 673 Downloads
We have created an open access online platform for using semantic workflows to analyze artistic style in paintings. We have implemented workflows for both standard computer vision image processing techniques and state-of-the-art methods such as convolutional neural networks to analyze images. These workflows can be used online by non-experts without needing any technical knowledge other than being able to use a browser.
We designed three artistically-relevant features to aid in the quantification of artistic style: the Discrete Tonal Measure, Discrete Variational Measure, and Convolutional Style Measure. These quantitative features can provide clues to the artistic elements that enable art scholars to categorize works as belonging to different artistic styles. We also created two new datasets of manually curated artworks selected especially for evaluating artistic style: one based on the school of art to which artists belong (Impressionism vs Hudson River) and one based on the medium used by a specific artist (tempera vs watercolors). Finally, we present an initial evaluation of these datasets and features for classifying paintings and also show results of a user study workshop for conducting such analyses online by humanities researchers, students, and professionals.
KeywordsArtistic style Visual stylometry Semantic workflows
This research was supported in part by the US National Science Foundation (NSF) under grant #1019343 to the Computing Research Association for the CIFellows Project, the National Endowment for the Humanities (NEH) Grant under Award HD-248360-16, and the Amazon AWS Research Grant program (AMZN).
- 1.Bonnar, L., Gosselin, F., Schyns, P.G.: Understanding Dali’s slave market with the disappearing bust of voltaire: a case study in the scale information driving perception. Perception (2002). https://doi.org/10.1068/p3276
- 2.Folego, G., Gomes, O., Rocha, A.: From impressionism to expressionism: automatically identifying van Gogh’s paintings. In: ICIP (2016)Google Scholar
- 3.Gatys, L.A., Ecker, A.S., Bethge, M.: A neural algorithm of artistic style. arXiv (2015)Google Scholar
- 4.Gil, Y.: Teaching big data analytics skills with intelligent workflow systems. In: Proceedings of the Sixth Symposium on Educational Advances in Artificial Intelligence (EAAI) (2016)Google Scholar
- 7.Hauder, M., Gil, Y., Sethi, R.J., Liu, Y., Jo, H.: Making data analysis expertise broadly accessible through workflows. In: SC Works (2011)Google Scholar
- 9.Parker, D., Deregowski, J.: Perception and Artistic Style. Elsevier, New York City (1991). ISBN 9780444887023Google Scholar
- 11.Sethi, R.J., Gil, Y., Jo, H., Philpot, A.: Large-scale multimedia content analysis using scientific workflows. In: ACM International Conference on Multimedia (MM). ACM (2013)Google Scholar
- 15.Zujovic, J., Gandy, L., Friedman, S., Pardo, B., Pappas, T.N.: Classifying paintings by artistic genre: an analysis of features & classifiers. In: IEEE International Workshop on Multimedia Signal Processing (2009)Google Scholar