Abstract
Image tagging is an essential step for developing automatic image annotation methods that are based on the learning by example paradigm. However, manual image annotation, even for creating training sets for machine learning algorithms, requires hard effort and contains human judgment errors and subjectivity. Thus, alternative ways for automatically creating training examples, i.e., pairs of images and tags, are pursued. In this work we investigate whether tags accompanying photos in social media and especially the Instagram hashtags, provide a form of image annotation. If such a claim is proved then Instagram could be a very rich source of training data, easily collectable automatically, for the development of automatic image annotation techniques. Our hypothesis is that Instagram hashtags, and especially those provided by the photo owner / creator, express more accurately the content of a photo compared to the tags assigned to a photo during explicit image annotation processes like crowdsourcing. In this context, we explore the descriptive power of hashtags by examining whether other users would use the same, with the owner, hashtags to annotate an image. For this purpose a set of 30 randomly chosen, from Instagram, images were used as a dataset for our research. Then, one to four hashtags, considered as the most descriptive ones for the image in question, were selected among the hashtags used by the image owner. Three online questionnaires with ten images each were distributed to experiment participants in order to choose the best suitable hashtag for every image according to their interpretation. Results show that an average of 55% of the participants hashtag choices coincide with those suggested by the photo owners; thus, an initial evidence towards our hypothesis confirmation can be claimed.
Chapter PDF
Similar content being viewed by others
References
Baranovic, M.: What #hashtags mean to mobile photography (2013). http://connect.dpreview.com/post/1256293279/hastag-photography
Bennett, S.: The history of hashtags in social media marketing (2014). http://www.adweek.com/socialtimes/history-hashtag-social-marketing/501237
Carmean, D.M., Morris, M.E.: Selfie examinations?: applying computer vision, hashtag scraping and sentiment analysis to finding and interpreting selfies. http://nebula.wsimg.com/27bab6eda0e75b69fcab8a5cdc4e22af?AccessKeyId=A6A4DAF733A0F616E396&disposition=0
Daer, A.R., Hoffman, R., Goodman, S.: Rhetorical Functions of Hashtag Forms Across Social Media Applications. Communication Design Quarterly Review 3(1), 12–16 (2014)
Duggan, M., Ellison, N.B., Lampe, C., Lenhart, A., Madden, M.: Social Media Update (2014). http://www.pewinternet.org/2015/01/09/social-media-update-2014/
Hanbury, A.: A survey of methods for image annotation. Journal of Visual Languages & Computing 19(5), 617–627 (2008)
Hersh, W.: Information Retrieval: A Health and Biomedical Perspective. Springer, New York (2009)
Ionescu, B., Popescu, A., Radu, A.-L., Mller, H.: Result diversification in social image retrieval: a benchmarking framework. Multimedia Tools and Applications, November 2014. doi:10.1007/s11042-014-2369-4
Internet.org: A Focus on Efficiency. A white paper from Facebook, Ericsson and Qualcomm (2013). https://fbcdn-dragon-a.akamaihd.net/hphotos-ak-prn1/851575_520797877991079_393255490_n.pdf
Intsagram: Introducing Layout from Instagram (2015). http://blog.instagram.com/post/114416360957/layout-from-instagram
Jin, C., Jin, S.-W.: Automatic image annotation using feature selection based on improving quantum particle swarm optimization. Signal Processing 109, 172–181 (2015)
Kara, Y.E., Genc, G., Aran, O., Akarun, L.: Modeling annotator behaviors for crowd labeling. Neurocomputing 160, 141–156 (2015)
Kulshrestha, A.: On the Hamming Distance Between Base-N Representations of Whole Numbers. Canadian Young Scientist Journal, 14–17 (2012)
Nowak, S., Ruger, S.: How reliable are annotations via crowdsourcing? A study about inter-annotator agreement for multi-label image annotation. In: Proceedings of the International conference on Multimedia Information Retrieval, pp. 557–566 (2010)
Ntalianis, K., Tsapatsoulis, N., Doulamis, A., Matsatsinis, N.: Automatic annotation of image databases based on implicit crowdsourcing, visual concept modeling and evolution. Multimedia Tools and Applications 69(2), 397–421 (2014)
Snoek, C.G., Worring, M.: Concept-based video retrieval. Foundations and Trends in Information Retrieval 2(4), 215–322 (2009)
Theodosiou, Z., Tsapatsoulis, N.: Crowdsourcing annotation: Modelling keywords using low level features. In: Proceedings of the 5th International Conference on Internet Multimedia Systems Architecture and Application (IEEE IMSAA 2011), Bangalore, India, p. 14 (2011)
Theodosiou, Z., Georgiou, O., Tsapatsoulis, N.: Evaluating Annotators Consistency with the Aid of an Innovative Database Schema. In: Proceedings of the 6th International Workshop on Semantic Media Adaptation and Personalization (SMAP 2011), Luxenbourg, December 2011, pp. 74–78 (2011)
Theodosiou, Z., Tsapatsoulis, N.: Image retrieval using keywords: The machine learning perspective. In: Spyrou, E., Iakovides, D., Mylonas, P. (eds.) Semantic Multimedia Analysis and Processing. CRC Press / Taylor & Francis (2014)
Tsikrika, T., Diou, C., de Vries, A.P., Delopoulos, A.: Reliability and effectiveness of clickthrough data for automatic image annotation. Multimedia Tools and Applications 55(1), 27–52 (2011)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 IFIP International Federation for Information Processing
About this paper
Cite this paper
Giannoulakis, S., Tsapatsoulis, N. (2015). Instagram Hashtags as Image Annotation Metadata. In: Chbeir, R., Manolopoulos, Y., Maglogiannis, I., Alhajj, R. (eds) Artificial Intelligence Applications and Innovations. AIAI 2015. IFIP Advances in Information and Communication Technology, vol 458. Springer, Cham. https://doi.org/10.1007/978-3-319-23868-5_15
Download citation
DOI: https://doi.org/10.1007/978-3-319-23868-5_15
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-23867-8
Online ISBN: 978-3-319-23868-5
eBook Packages: Computer ScienceComputer Science (R0)