Biographies or Blenders: Which Resource Is Best for Cross-Domain Sentiment Analysis?

  • Natalia Ponomareva
  • Mike Thelwall
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7181)

Abstract

Domain adaptation is usually discussed from the point of view of new algorithms that minimise performance loss when applying a classifier trained on one domain to another. However, finding pertinent data similar to the test domain is equally important for achieving high accuracy in a cross-domain task. This study proposes an algorithm for automatic estimation of performance loss in the context of cross-domain sentiment classification. We present and validate several measures of domain similarity specially designed for the sentiment classification task. We also introduce a new characteristic, called domain complexity, as another independent factor influencing performance loss, and propose various functions for its approximation. Finally, a linear regression for modeling accuracy loss is built and tested in different evaluation settings. As a result, we are able to predict the accuracy loss with an average error of 1.5% and a maximum error of 3.4%.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Asch, V.V., Daelemans, W.: Using domain similarity for performance estimation. In: Proceedings of the 2010 Workshop on Domain Adaptation for NLP, ACL 2010, pp. 31–36 (2010)Google Scholar
  2. 2.
    Aue, A., Gamon, M.: Customizing sentiment classifiers to new domains: A case study. In: Proceedings of RANLP 2005 (2005)Google Scholar
  3. 3.
    Ben-David, S., Blitzer, J., Crammer, K., Pereira, F.: Analysis of representations for domain adaptation. In: Advances in Neural Information Processing Systems, NIPS (2006)Google Scholar
  4. 4.
    Blitzer, J., Dredze, M., Pereira, F.: Biographies, bollywood, boom-boxes and blenders: Domain adaptation for sentiment classification. In: Proceedings of ACL 2007, pp. 440–447 (2007)Google Scholar
  5. 5.
    Blitzer, J., McDonald, R., Pereira, F.: Domain adaptation with structural correspondence learning. In: Proceedings of EMNLP 2006, pp. 120–128 (2006)Google Scholar
  6. 6.
    Daume III, H., Marcu, D.: Domain adaptation for statistical classifiers. Artificial Intelligence Research 26, 101–126 (2006)MathSciNetMATHGoogle Scholar
  7. 7.
    Glorot, X., Bordes, A., Bengio, Y.: Domain adaptation for large-scale sentiment classification: A deep learning approach. In: Proceedings of ICML 2011 (2011)Google Scholar
  8. 8.
    Kilgarriff, A.: Comparing corpora. International Journal of Corpus Linguistics 6(1), 97–133 (2001)CrossRefGoogle Scholar
  9. 9.
    Pan, S.J., Niz, X., Sunz, J.T., Yangy, Q., Chen, Z.: Cross-domain sentiment classification via spectral feature alignment. In: Proceedings of WWW 2010 (2010)Google Scholar
  10. 10.
    Pang, B., Lee, L.: Opinion mining and sentiment analysis. Foundations and Trends in Information Retrieval 2(1-2), 1–135 (2008)CrossRefGoogle Scholar
  11. 11.
    Plank, B., van Noord, G.: Effective measures of domain similarity for parsing. In: Proceedings of ACL 2011, pp. 1566–1576 (2011)Google Scholar
  12. 12.
    Read, J.: Using emoticons to reduce dependency in machine learning techniques for sentiment classification. In: Proceedings of the ACL Student Research Workshop, pp. 43–48 (2005)Google Scholar
  13. 13.
    Wu, Q., Tan, S., Cheng, X.: Graph ranking for sentiment transfer. In: Proceedings of ACL-IJCNLP 2009, pp. 317–320 (2009)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Natalia Ponomareva
    • 1
  • Mike Thelwall
    • 1
  1. 1.Statistical Cybermetrics Research groupUniversity of WolverhamptonUK

Personalised recommendations