Abstract
Recent multimedia applications commonly use text and imagery from Social Media for tasks related to sentiment research. As such, there are various image datasets for sentiment research for popular classification tasks. However, there has been little research regarding the relationship between the sentiment of images and its annotations from a multi-modal standpoint. In this demonstration, we built a tool to visualize psycholinguistic groundings for a sentiment dataset. For each image, individual psycholinguistic ratings are computed from the image’s metadata. A sentiment-psycholinguistic spatial embedding is computed to show a clustering of images across different classes close to human perception. Our interactive browsing tool can visualize the data in various ways, highlighting different psycholinguistic groundings with heatmaps.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Jindal, S., Singh, S.: Image sentiment analysis using deep convolutional neural networks with domain specific fine tuning. In: 2015 International Conference on Information Processing (ICIP), pp. 447–451, December 2015. https://doi.org/10.1109/INFOP.2015.7489424
Jou, B., Chen, T., Pappas, N., Redi, M., Topkara, M., Chang, S.: Visual affect around the world: A large-scale multilingual visual sentiment ontology. ArXiv e-prints 1508.03868 (2015)
Kastner, M.A., Ide, I., Kawanishi, Y., Hirayama, T., Deguchi, D., Murase, H.: Estimating the visual variety of concepts by referring to web popularity. Multimed. Tools Appl. 78(7), 9463–9488 (2019). https://doi.org/10.1007/s11042-018-6528-x
Kim, E., Klinger, R.: A survey on sentiment and emotion analysis for computational literary studies. ArXiv e-prints 1808.03137 (2018)
McInnes, L., Healy, J.: UMAP: Uniform Manifold Approximation and Projection for dimension reduction. ArXiv e-prints 1802.03426. February 2018
Paivio, A., Yuille, J.C., Madigan, S.A.: Concreteness, imagery, and meaningfulness values for 925 nouns. J. Exp. Psychol. 76(1), 1–25 (1968)
Scott, G.G., Keitel, A., Becirspahic, M., Yao, B., Sereno, S.C.: The Glasgow norms: ratings of 5,500 words on nine scales. Behav. Res. Methods 51(3), 1258–1270 (2019). https://doi.org/10.3758/s13428-018-1099-3
Acknowledgments
Parts of this research were supported by the MEXT, JSPS KAKENHI 16H02846, and a joint research project with NII, Japan.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Kastner, M.A., Ide, I., Kawanishi, Y., Hirayama, T., Deguchi, D., Murase, H. (2020). Browsing Visual Sentiment Datasets Using Psycholinguistic Groundings. In: Ro, Y., et al. MultiMedia Modeling. MMM 2020. Lecture Notes in Computer Science(), vol 11962. Springer, Cham. https://doi.org/10.1007/978-3-030-37734-2_56
Download citation
DOI: https://doi.org/10.1007/978-3-030-37734-2_56
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-37733-5
Online ISBN: 978-3-030-37734-2
eBook Packages: Computer ScienceComputer Science (R0)