Abstract
EmotiBlog is a corpus labelled with the homonymous annotation schema designed for detecting subjectivity in the new textual genres. Preliminary research demonstrated its relevance as a Machine Learning resource to detect opinionated data. In this paper we compare EmotiBlog with the JRC corpus in order to check the EmotiBlog robustness of annotation. For this research we concentrate on its coarse-grained labels. We carry out a deep ML experimentation also with the inclusion of lexical resources. The results obtained show a similarity with the ones obtained with the JRC demonstrating the EmotiBlog validity as a resource for the SA task.
This work has been partially founded by the TEXTMESS 2.0 (TIN2009-13391-C04-01) and Prometeo (PROMETEO/2009/199) projects and also by the complimentary action from the Generalitat valenciana (ACOMP/2011/001).
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Agirre, E., Lopez de Lacalle, O., Fellbaum, C., Hsieh, S., Tesconi, M., Monachini, M., Vossen, P., Segers, R.: SemEval-2010 Task 17: All-words Word Sense Disambiguation on a Specific Domain (2010)
Balahur, A., Boldrini, E., Montoyo, A., MartÃnez-Barco, P.: Opinion and Generic Question Answering systems: a performance analysis. In: Proceedings of ACL, Singapore (2009c)
- Balahur, A., Boldrini, E., Montoyo, A., MartÃnez-Barco, P.: A Unified Proposal for Factoid and Opinionated Question Answering. In: Proceedings of the COLING Conference (2010a)
- Balahur, A., Boldrini, E., Montoyo, A., MartÃnez-Barco, P.: Opinion Question Answering: Towards a Unified Approach. In: Proceedings of the ECAI Conference (2010b)
Balahur A., Lloret E., Boldrini E., Montoyo A., Palomar M., MartÃnez-Barco P.: Summarizing Threads in Blogs Using Opinion Polarity. In: Proceedings of ETTS Workshop. RANLP (2009a)
Balahur A., Montoyo A.: Applying a Culture Dependent Emotion Triggers Database for Text Valence and Emotion Classification. In: Proceedings of the AISB 2008 Symposium on Affective Language in Human and Machine, Aberdeen, Scotland (2008)
- Boldrini, E., Balahur, A., MartÃnez-Barco, P., Montoyo, A.: EmotiBlog: a finer-grained and more precise learning of subjectivity expression models. In: Proceedings of LAW IV, ACL (2010)
- Boldrini, E., Balahur, A., MartÃnez-Barco, P., Montoyo, A.: EmotiBlog: an Annotation Scheme for Emotion Detection and Analysis in Non-traditional Textual Genres. In: Proceedings of DMIN, Las Vegas (2009a)
Cerini, S., Compagnoni, V., Demontis, A., Formentelli, M., Gandini, G.: Micro-WNOp: A gold standard for the evaluation of automatically compiled lexical resources for opinion mining. In: Angeli, F. (ed.) Language Resources and Linguistic Theory: Typology, Second Language Acquisition, English Linguistics, Milano, IT (2007) (forthcoming)
Dave, K., Lawrence, S., Pennock, D.: Mining the Peanut Gallery: Opinion Extraction and Semantic Classification of Product Reviews. In: Proceedings of WWW 2003 (2003)
Esuli, A., Sebastiani, F.: SentiWordNet: A Publicly Available Resource for Opinion Mining. In: Proceedings of the 6th International Conference on Language Resources and Evaluation, LREC 2006, Genoa, Italy (2006)
Gamon, M., Aue, S., Corston-Oliver, S., Ringger, E.: Mining Customer Opinions from Free Text. In: Famili, A.F., et al. (eds) IDA 2005. LNCS, vol. 3646, pp. 121–132. Springer, Heidelberg (2005)
Hatzivassiloglou, V., Wiebe, J.: Effects of adjective orientation and gradability on sentence subjectivity. In: Proceedings of COLING (2000)
Kim, S.M., Hovy, E.: Determining the Sentiment of Opinions. In: Proceedings of COLING 2004 (2004)
Liu, B.: Web Data Mining book. Ch. 11 (2006)
Liu, B.: Web Data Mining. In: Exploring Hyperlinks, Contents and Usage Data, 1st edn. Springer, Heidelberg (2007)
McDonald, R., Hannan, K., Neylon, T., Wells, M., Reynar, J.: Structured Models for Fine-to-Coarse Sentiment Analysis. In: Proceedings of the 45th Annual Meeting of the Association of Computational Linguistics (2007)
Miller, G.A.: WordNet: A Lexical Database for English (1995)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Fernández, J., Boldrini, E., Gómez, J.M., Martínez-Barco, P. (2011). Evaluating EmotiBlog Robustness for Sentiment Analysis Tasks. In: Muñoz, R., Montoyo, A., Métais, E. (eds) Natural Language Processing and Information Systems. NLDB 2011. Lecture Notes in Computer Science, vol 6716. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-22327-3_41
Download citation
DOI: https://doi.org/10.1007/978-3-642-22327-3_41
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-22326-6
Online ISBN: 978-3-642-22327-3
eBook Packages: Computer ScienceComputer Science (R0)