Advertisement

Language Resources and Evaluation

, Volume 47, Issue 3, pp 743–755 | Cite as

SemEval-2010 task 18: disambiguating sentiment ambiguous adjectives

  • Yunfang WuEmail author
  • Peng Jin
Original Paper

Abstract

Sentiment ambiguous adjectives, which have been neglected by most previous researches, pose a challenging task in sentiment analysis. We present an evaluation task at SemEval-2010, designed to provide a framework for comparing different approaches on this problem. The task focuses on 14 Chinese sentiment ambiguous adjectives, and provides manually labeled test data. There are 8 teams submitting 16 systems in this task. In this paper, we define the task, describe the data creation, list the participating systems, and discuss different approaches.

Keywords

Sentiment ambiguous adjectives Sentiment analysis Word sense disambiguation SemEval 

Notes

Acknowledgments

This work was supported by National High Technology Research and Development Program of China (863 Program) (No. 2012AA011101) and 2009 Chiang Ching-kuo Foundation for International Scholarly Exchange (No. RG013-D-09).

References

  1. Andreevskaia, A., & Bergler, S. (2006). Sentiment tagging of adjectives at the meaning level. In The 19th Canadian conference on artificial intelligence.Google Scholar
  2. Balahur, A., & Montoyo, A. (2010). The OpAL participation in the SemEval-2010 Task 18: Disambiguation of sentiment ambiguous adjectives. In Proceedings of 5th international workshop on semantic evaluation. Google Scholar
  3. Ding, X., Liu, B., & Yu, P. (2008). A holistic lexicon-based approach to opinion mining. In Proceedings of WSDM-2006.Google Scholar
  4. Esuli, A., & Sebastiani, F. (2006). SentiWordNet: A publicly available lexical resource for opinion mining. In Proceedings of LREC-2006. Google Scholar
  5. Hatzivassiloglou, V., & McKeown, K. (1997). Predicting the semantic orientation of adjectives. In Proceedings of ACL-1997. Google Scholar
  6. Jin, W., & Ho, H. (2009). A novel lexicalized HMM-based learning framework for web opinion mining. In Proceedings of the 26th annual international conference on machine learning (ICML-09).Google Scholar
  7. Justeson, J., & Kats, S. (1995). Principled disambiguation: Discriminating adjective senses with modified nouns. Computational Lingustics, 21(1), 1–27.Google Scholar
  8. Kim, S., & Hovy, E. (2004). Determining the sentiment of opinions. In Proceedings of COLING-2004.Google Scholar
  9. Li, F., Han, C., Huang, M., Zhu, X., Xia, Y., Zhang, S., & Yu, H. (2010). Structure-aware review mining and summarization. In Proceedings of COLING-2010.Google Scholar
  10. Lu, B., & Tsou, B. (2010). CityU-DAC: Disambiguating sentiment-ambiguous adjectives within context. In Proceedings of 5th international workshop on semantic evaluation.Google Scholar
  11. McCarthy, D., & Carroll, J. (2003). Disambiguating nouns, verbs and adjectives using automatically acquired selectional preferences. Computational Linguistics, 29(4), 639–654.Google Scholar
  12. Meng, X., & Wang, H. (2010). Bootstrapping word dictionary based on random walking on biparty graph. In Proceedings of 5th international workshop on semantic evaluation.Google Scholar
  13. Pak, A., & Paroubek, P. (2010). Using Twitter for disambiguating sentiment ambiguous adjectives. In Proceedings of 5th international workshop on semantic evaluation.Google Scholar
  14. Pang, B., & Lee, L. (2008). Opinion mining and sentiment analysis. Foundations and Trends in Information Retrieval.Google Scholar
  15. Qiu, L., Zhang, W., Hu, C., & Zhao, K. (2009). SELC: A self-supervised model for sentiment analysis. In Proceedings of CIKM-2009.Google Scholar
  16. Su, F., & Markert, K. (2008). From words to senses: A case study of subjectivity recognition. In Proceedings of COLING-2008.Google Scholar
  17. Takamura, H., Inui, T., & Okumura, M. (2006). Latent variable models for semantic orientations of phrases. In Proceedings of EACL-2006.Google Scholar
  18. Takamura, H., Inui, T., & Okumura, M. (2007). Extracting semantic orientations of phrases from dictionary. In Proceedings of NAACL HLT-2007.Google Scholar
  19. Turney, P., & Littman, M. (2003). Measuring praise and criticism: Inference of semantic orientation from association. ACM Transaction on Information Systems, 21(4), 315–346.Google Scholar
  20. Wen, M., & Wu, Y. (2011). Predicting expectation of nouns using bootstrapping method. In Proceedings of IJCNLP-2011.Google Scholar
  21. Wiebe, J., & Mihalcea, R. (2006). Word sense and subjectivity. In Proceedings of ACL-2006.Google Scholar
  22. Wilson, T., Wiebe, J., & Hoffmann, P. (2005). Recognizing contextual polarity in phrase-level sentiment analysis. In Proceedings of HLT/EMNLP-2005.Google Scholar
  23. Wu, Y., & Wen, M. (2010). Disambiguating dynamic sentiment ambiguous adjectives. In Proceedings of COLING-2010.Google Scholar
  24. Xu, R., Xu, J., & Kit, C. (2010). HITSZ_CITYU: Combine collocation, context words and neighboring sentence sentiment in sentiment adjectives disambiguation. In Proceedings of 5th international workshop on semantic evaluation.Google Scholar
  25. Yang, S., & Liu, M. (2010). YSC-DSAA: An approach to disambiguate sentiment ambiguous adjectives based on SAAOL. In Proceedings of 5th international workshop on semantic evaluation. Google Scholar
  26. Yarowsky, D. (1993). One sense per collocation. In Proceedings of ARPA human language technology workshop.Google Scholar

Copyright information

© Springer Science+Business Media Dordrecht 2012

Authors and Affiliations

  1. 1.Key Laboratory of Computational Linguistics (Peking University), Ministry of EducationBeijingChina
  2. 2.Laboratory of Intelligent Information Processing and ApplicationLeshan Normal UniversityLeshanChina

Personalised recommendations