Semantic Sentiment Analysis Challenge at ESWC2018
Sentiment Analysis is a widely studied research field in both research and industry, and there are different approaches for addressing sentiment analysis related tasks. Sentiment Analysis engines implement approaches spanning from lexicon-based techniques, to machine learning, or involving syntactical rules analysis. Such systems are already evaluated in international research challenges. However, Semantic Sentiment Analysis approaches, which take into account or rely also on large semantic knowledge bases and implement Semantic Web best practices, are not under specific experimental evaluation and comparison by other international challenges. Such approaches may potentially deliver higher performance, since they are also able to analyze the implicit, semantics features associated with natural language concepts. In this paper, we present the fifth edition of the Semantic Sentiment Analysis Challenge, in which systems implementing or relying on semantic features are evaluated in a competition involving large test sets, and on different sentiment tasks. Systems merely based on syntax/word-count or just lexicon-based approaches have been excluded by the evaluation. Then, we present the results of the evaluation for each task.
Challenge Organizers want to thank Springer for supporting the provided awards also for this year edition. Moreover, the research leading to these results has received funding from the European Union Horizon 2020 the Framework Programme for Research and Innovation (2014–2020) under grant agreement 643808 Project MARIO Managing active and healthy aging with use of caring service robots.
- 2.Consoli, S., Gangemi, A., Nuzzolese, A.G., Recupero, D.R., Spampinato, D.: Extraction of topics-events semantic relationships for opinion propagation in sentiment analysis. In: Proceedings of Extended Semantic Web Conference (ESWC), Crete, GR (2014)Google Scholar
- 6.Gangemi, A., et al.: Joint proceedings of the 1th workshop on semantic sentiment analysis (ssa2014), and the workshop on social media and linked data for emergency response (smile 2014), co-located with 11th european semantic web conference (eswc 2014), crete, greece, 25 May 2014. http://ceur-ws.org/Vol-1329/
- 7.Blitzer J., Dredze M., Pereira F.: Biographies, bollywood, boom-boxes and blenders: domain adaptation for sentiment classification. In: Association of Computational Linguistics (ACL) (2007)Google Scholar
- 9.Recupero, D.R., Cambria, E.: ESWC2014 challenge: concept-level sentiment analysis. In: SemWebEval@ESWC 2014, pp. 3–20, May 2014. http://challenges.2014.eswc-conferences.org/index.php/SemSA
- 13.Recupero, D.R., Presutti, V., Consoli, S., Gangemi, A., Nuzzolese, A.: Sentilo: frame-based sentiment analysis. Cogn. Comput. 7(2), 211–225 (2014)Google Scholar