Semantic Sentiment Analysis Challenge at ESWC2018

Conference paper
Part of the Communications in Computer and Information Science book series (CCIS, volume 927)


Sentiment Analysis is a widely studied research field in both research and industry, and there are different approaches for addressing sentiment analysis related tasks. Sentiment Analysis engines implement approaches spanning from lexicon-based techniques, to machine learning, or involving syntactical rules analysis. Such systems are already evaluated in international research challenges. However, Semantic Sentiment Analysis approaches, which take into account or rely also on large semantic knowledge bases and implement Semantic Web best practices, are not under specific experimental evaluation and comparison by other international challenges. Such approaches may potentially deliver higher performance, since they are also able to analyze the implicit, semantics features associated with natural language concepts. In this paper, we present the fifth edition of the Semantic Sentiment Analysis Challenge, in which systems implementing or relying on semantic features are evaluated in a competition involving large test sets, and on different sentiment tasks. Systems merely based on syntax/word-count or just lexicon-based approaches have been excluded by the evaluation. Then, we present the results of the evaluation for each task.



Challenge Organizers want to thank Springer for supporting the provided awards also for this year edition. Moreover, the research leading to these results has received funding from the European Union Horizon 2020 the Framework Programme for Research and Innovation (2014–2020) under grant agreement 643808 Project MARIO Managing active and healthy aging with use of caring service robots.


  1. 1.
    Cambria, E., Das, D., Bandyopadhyay, S., Feraco, A.: A Practical Guide to Sentiment Analysis, 1st edn. Springer, Cham (2017). Scholar
  2. 2.
    Consoli, S., Gangemi, A., Nuzzolese, A.G., Recupero, D.R., Spampinato, D.: Extraction of topics-events semantic relationships for opinion propagation in sentiment analysis. In: Proceedings of Extended Semantic Web Conference (ESWC), Crete, GR (2014)Google Scholar
  3. 3.
    Dragoni, M., Solanki, M., Blomqvist, E. (eds.): SemWebEval 2017. CCIS, vol. 769. Springer, Cham (2017). Scholar
  4. 4.
    Gandon, F., Cabrio, E., Stankovic, M., Zimmermann, A. (eds.): SemWebEval 2015. CCIS, vol. 548. Springer, Cham (2015). Scholar
  5. 5.
    Gangemi, A., Presutti, V., Recupero, D.R.: Frame-based detection of opinion holders and topics: a model and a tool. IEEE Comput. Intell. Magaz. 9(1), 20–30 (2014)CrossRefGoogle Scholar
  6. 6.
    Gangemi, A., et al.: Joint proceedings of the 1th workshop on semantic sentiment analysis (ssa2014), and the workshop on social media and linked data for emergency response (smile 2014), co-located with 11th european semantic web conference (eswc 2014), crete, greece, 25 May 2014.
  7. 7.
    Blitzer J., Dredze M., Pereira F.: Biographies, bollywood, boom-boxes and blenders: domain adaptation for sentiment classification. In: Association of Computational Linguistics (ACL) (2007)Google Scholar
  8. 8.
    Presutti, V., et al. (eds.): SemWebEval 2014. CCIS, vol. 475. Springer, Cham (2014). Scholar
  9. 9.
    Recupero, D.R., Cambria, E.: ESWC2014 challenge: concept-level sentiment analysis. In: SemWebEval@ESWC 2014, pp. 3–20, May 2014.
  10. 10.
    Recupero, D.R., Cambria, E., Di Rosa, E.: Semantic sentiment analysis challenge at ESWC2017. In: Dragoni, M., Solanki, M., Blomqvist, E. (eds.) SemWebEval 2017. CCIS, vol. 769, pp. 109–123. Springer, Cham (2017). Scholar
  11. 11.
    Recupero, D.R., Dragoni, M., Presutti, V.: ESWC 15 challenge on concept-level sentiment analysis. In: Gandon, F., Cabrio, E., Stankovic, M., Zimmermann, A. (eds.) SemWebEval 2015. CCIS, vol. 548, pp. 211–222. Springer, Cham (2015). Scholar
  12. 12.
    Dragoni, M., Recupero, D.R.: Challenge on fine-grained sentiment analysis within ESWC2016. In: Sack, H., Dietze, S., Tordai, A., Lange, C. (eds.) SemWebEval 2016. CCIS, vol. 641, pp. 79–94. Springer, Cham (2016). Scholar
  13. 13.
    Recupero, D.R., Presutti, V., Consoli, S., Gangemi, A., Nuzzolese, A.: Sentilo: frame-based sentiment analysis. Cogn. Comput. 7(2), 211–225 (2014)Google Scholar
  14. 14.
    Sack, H., Dietze, S., Tordai, A., Lange, C. (eds.): SemWebEval 2016. CCIS, vol. 641. Springer, Cham (2016). Scholar

Copyright information

© Springer Nature Switzerland AG 2018

Authors and Affiliations

  1. 1.Fondazione Bruno KesslerTrentoItaly
  2. 2.Nanyang Technological UniversitySingaporeSingapore

Personalised recommendations