Abstract
Sentiment Analysis is a widely studied research field in both research and industry, and there are different approaches for addressing sentiment analysis related tasks. Sentiment Analysis engines implement approaches spanning from lexicon-based techniques, to machine learning, or involving syntactical rules analysis. Such systems are already evaluated in international research challenges. However, Semantic Sentiment Analysis approaches, which take into account or rely also on large semantic knowledge bases and implement Semantic Web best practices, are not under specific experimental evaluation and comparison by other international challenges. Such approaches may potentially deliver higher performance, since they are also able to analyze the implicit, semantics features associated with natural language concepts. In this paper, we present the fourth edition of the Semantic Sentiment Analysis Challenge, in which systems implementing or relying on semantic features are evaluated in a competition involving large test sets, and on different sentiment tasks. Systems merely based on syntax/word-count or just lexicon-based approaches have been excluded by the evaluation. Then, we present the results of the evaluation for each task and show the winner of the most innovative approach award, that combines several knowledge bases for addressing the sentiment analysis task.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
- 1.
Computer World, 25 October 2004, Vol. 38, NO 43.
- 2.
- 3.
- 4.
Publicly accessible at https://groups.google.com/forum/#!forum/semantic-sentiment-analysis.
- 5.
- 6.
- 7.
- 8.
- 9.
- 10.
- 11.
References
Atzeni, M., Dridi, A., Recupero, D.R.: Fine-grained sentiment analysis on financial microblogs and news headlines. In: Solanki and Dragoni [20]
Cambria, E., Das, D., Bandyopadhyay, S., Feraco, A.: A Practical Guide to Sentiment Analysis, 1st edn. Springer Publishing Company, Incorporated, Heidelberg (2017). https://doi.org/10.1007/978-3-319-55394-8
Consoli, S., Gangemi, A., Nuzzolese, A.G., Reforgiato Recupero, D., Spampinato, D.: Extraction of topics-events semantic relationships for opinion propagation in sentiment analysis. In: Proceedings of Extended Semantic Web Conference (ESWC), Crete, GR (2014)
Federici, M.: A knowledge-based approach for aspect-based opinion mining. In: Solanki and Dragoni [20]
Gandon, F., Cabrio, E., Stankovic, M., Zimmermann, A. (eds.): SemWebEval 2015. CCIS, vol. 548. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-25518-7
Gangemi, A., Presutti, V., Reforgiato-Recupero, D.: Frame-based detection of opinion holders and topics: a model and a tool. IEEE Comput. Intell. Mag. 9(1), 20–30 (2014)
Gangemi, A., Alani, H., Nissim, M., Cambria, E., Reforgiato Recupero, D., Lanfranchi, V., Kauppinen, T.: Joint Proceedings of the 1st Workshop on Semantic Sentiment Analysis (SSA 2014), and the Workshop on Social Media and Linked Data for Emergency Response (smile 2014) Co-located with 11th European Semantic web Conference (eswc 2014), Crete, Greece, May 25th, 2014 (2014). http://ceur-ws.org/Vol-1329/
Iguider, W., Reforgiato Recupero, D.: Language independent sentiment analysis of the shukran social network using apache spark. In: Solanki and Dragoni [20]
Blitzer, J., Dredze, M., Pereira, F.: Biographies, bollywood, boom-boxes and blenders: domain adaptation for sentiment classification. In: Association of Computational Linguistics (ACL) (2007)
Liu, B.: Sentiment Analysis and Opinion Mining. Synthesis Lectures on Human Language Technologies. Morgan & Claypool Publishers, San Rafael (2012)
Petrucci, G.: The irmudosa system at eswc-2017 challenge on semantic sentiment analysis. In: Solanki and Dragoni [20]
Petrucci, G., Dragoni, M.: An information retrieval-based system for multi-domain sentiment analysis. In: Solanki and Dragoni [20]
Presutti, V., et al. (eds.): SemWebEval 2014. CCIS, vol. 475. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-12024-9
Reforgiato Recupero, D., Cambria, E.: ESWC’14 challenge on concept-level sentiment analysis. In: Presutti, V., et al. (eds.) SemWebEval 2014. CCIS, vol. 475, pp. 3–20. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-12024-9_1
Recupero, D.R., Dragoni, M., Presutti, V.: ESWC 15 challenge on concept-level sentiment analysis. In: Gandon, F., Cabrio, E., Stankovic, M., Zimmermann, A. (eds.) SemWebEval 2015. CCIS, vol. 548, pp. 211–222. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-25518-7_18
Dragoni, M., Reforgiato Recupero, D.: Challenge on fine-grained sentiment analysis within ESWC2016. In: Sack, H., Dietze, S., Tordai, A., Lange, C. (eds.) SemWebEval 2016. CCIS, vol. 641, pp. 79–94. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46565-4_6
Recupero, D.R., Presutti, V., Consoli, S., Gangemi, A., Nuzzolese, A.: Sentilo: frame-based sentiment analysis. Cognit. Comput. 7(2), 211–225 (2014)
Rexha, A.: Exploiting propositions for opinion mining. In: Solanki and Dragoni [20]
Sack, H., Dietze, S., Tordai, A., Lange, C. (eds.): SemWebEval 2016. CCIS, vol. 641. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46565-4
Solanki, M., Dragoni, M. (eds.): The Semantic Web: ESWC 2017 Challenges. Communications in Computer and Information Science. Springer, Heidelberg (2017). https://doi.org/10.1007/978-3-319-58451-5
Acknowledgement
Challenge Organizers want to thank Springer for supporting the provided awards also for this year edition.
Moreover, The authors gratefully acknowledge Sardinia Regional Government for the financial support (Convenzione triennale tra la Fondazione di Sardegna e gli Atenei Sardi Regione Sardegna - L.R. 7/2007 annualit 2016 - DGR 28/21 del 17.05.201, CUP: F72F16003030002).
Moreover, the research leading to these results has received funding from the European Union Horizon 2020 the Framework Programme for Research and Innovation (2014-2020) under grant agreement 643808 Project MARIO Managing active and healthy aging with use of caring service robots.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Reforgiato Recupero, D., Cambria, E., Di Rosa, E. (2017). Semantic Sentiment Analysis Challenge at ESWC2017. In: Dragoni, M., Solanki, M., Blomqvist, E. (eds) Semantic Web Challenges. SemWebEval 2017. Communications in Computer and Information Science, vol 769. Springer, Cham. https://doi.org/10.1007/978-3-319-69146-6_10
Download citation
DOI: https://doi.org/10.1007/978-3-319-69146-6_10
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-69145-9
Online ISBN: 978-3-319-69146-6
eBook Packages: Computer ScienceComputer Science (R0)