Abstract
One of the reasons sentiment lexicons do not reach human-level performance is that they lack the contexts that define the polarities of words. While obtaining this knowledge through machine learning would require huge amounts of data, context is commonsense knowledge for people, so human computation is a better choice. We identify context using a game with a purpose that increases the workers’ engagement in this complex task. With the contextual knowledge we obtain from only a small set of answers, we already halve the sentiment lexicons’ performance gap relative to human performance.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Pang, B., Lee, L., Vaithyanathan, S.: Thumbs up?: Sentiment classification using machine learning techniques. In: Proceedings of the ACL Conference on Empirical Methods in Natural Language Processing, pp. 79–86 (2002)
Turney, P.D.: Thumbs up or thumbs down?: Semantic orientation applied to unsupervised classification of reviews. In: Proceedings of the 40th Annual Meeting on Association for Computational Linguistics, pp. 417–424 (2002)
Hatzivassiloglou, V., McKeown, K.R.: Predicting the semantic orientation of adjectives. In: Proceedings of the 35th Annual Meeting of the Association for Computational Linguistics, pp. 174–181 (1997)
Stone, P.J., Dunphy, D.C., Smith, M.S., Ogilvie, D.M.: The General Inquirer: A Computer Approach to Content Analysis. MIT Press (1966)
Whissell, C.M.: The dictionary of affect in language, vol. 4, pp. 113–131. Academic Press (1989)
Wilson, T., Hoffmann, P., Somasundaran, S., Kessler, J., Wiebe, J., Choi, Y., Cardie, C., Riloff, E., Patwardhan, S.: OpinionFinder: A system for subjectivity analysis. In: Proceedings of HLT/EMNLP on Interactive Demonstrations, pp. 34–35 (2005)
Loureiro, D., Marreiros, G., Neves, J.: Sentiment analysis of news titles the role of entities and a new affective lexicon. In: Antunes, L., Pinto, H.S. (eds.) EPIA 2011. LNCS (LNAI), vol. 7026, pp. 1–14. Springer, Heidelberg (2011)
Tan, C., Lee, L., Tang, J., Jiang, L., Zhou, M., Li, P.: User-level sentiment analysis incorporating social networks. In: Proceedings of the 17th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD 2011, pp. 1397–1405. ACM (2011)
Musat, C.C., Faltings, B.: A novel human computation game for critique aggregation. In: AAAI (2013)
von Ahn, L., Dabbish, L.: Labeling images with a computer game. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 319–326 (2004)
Esuli, A., Sebastiani, F.: SentiWordNet: A publicly available lexical resource for opinion mining. In: Proceedings of the 5th Conference on Language Resources and Evaluation, pp. 417–422 (2006)
Bradley, M.M., Lang, P.J.: Affective norms for english words (ANEW): Instruction manual and affective ratings. Technical Report C1 The Center for Research in Psychophysiology (1999)
Miller, G.A.: WordNet: a lexical database for english. Commun. ACM 38, 39–41 (1995)
Maks, I., Vossen, P.: A lexicon model for deep sentiment analysis and opinion mining applications. Decision Support Systems 53, 680–688 (2012)
Ding, X., Liu, B., Yu, P.S.: A holistic lexicon-based approach to opinion mining. In: Proceedings of the International Conference on Web Search and Web Data Mining, pp. 231–240 (2008)
Lau, R.Y.K., Lai, C.C.L., Ma, J., Li, Y.: Automatic domain ontology extraction for context-sensitive opinion mining. In: Proceedings of the 30th International Conference on Information Systems, pp. 35–53 (2009)
Lu, Y., Castellanos, M., Dayal, U., Zhai, C.: Automatic construction of a context-aware sentiment lexicon: An optimization approach. In: Proceedings of the 20th International Conference on World Wide Web, pp. 347–356 (2011)
Brew, A., Greene, D., Cunningham, P.: Using crowdsourcing and active learning to track sentiment in online media. In: Proceedings of the 19th European Conference on Artificial Intelligence, pp. 145–150 (2010)
Hong, Y., Kwak, H., Baek, Y., Moon, S.: Tower of Babel: A crowdsourcing game building sentiment lexicons for resource-scarce languages. In: Proceedings of the 22nd International Conference on World Wide Web Companion, pp. 549–556 (2013)
Al-Subaihin, A., Al-Khalifa, H., Al-Salman, A.: A proposed sentiment analysis tool for modern arabic using human-based computing. In: Proceedings of the 13th International Conference on Information Integration and Web-Based Applications and Services, pp. 543–546 (2011)
Musat, C.C., Ghasemi, A., Faltings, B.: Sentiment analysis using a novel human computation game. In: Proceedings of the 3rd Workshop on the People’s Web Meets Natural Language Processing, pp. 1–9 (2012)
Ipeirotis, P.G., Provost, F., Wang, J.: Quality management on Amazon Mechanical Turk. In: Proceedings of the ACM SIGKDD Workshop on Human Computation, pp. 64–67 (2010)
Sintsova, V., Musat, C.C., Pu, P.: Fine-grained emotion rrecognition in olympic tweets based on human computation. In: Proceedings of the 4th Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis, pp. 12–20 (2013)
Gupta, A.K.: Beta distribution. In: Lovric, M. (ed.) International Encyclopedia of Statistical Science, pp. 144–145. Springer, Heidelberg (2011)
Hu, M., Liu, B.: Mining and summarizing customer reviews. In: Proceedings of the 10th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 168–177 (2004)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Boia, M., Musat, C.C., Faltings, B. (2014). Constructing Context-Aware Sentiment Lexicons with an Asynchronous Game with a Purpose. In: Gelbukh, A. (eds) Computational Linguistics and Intelligent Text Processing. CICLing 2014. Lecture Notes in Computer Science, vol 8404. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-54903-8_3
Download citation
DOI: https://doi.org/10.1007/978-3-642-54903-8_3
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-54902-1
Online ISBN: 978-3-642-54903-8
eBook Packages: Computer ScienceComputer Science (R0)