Analyzing Slavic Textual Sentiment Using Deep Convolutional Neural Networks

Part of the Studies in Computational Intelligence book series (SCI, volume 705)


In this paper we deploy a deep architecture for convolutional neural networks for understanding of Croatian. We follow the same approach as in [34], and we use deep learning on character inputs on a sentiment analysis dataset in Croatian. Although we have archived considerable results (without any complex parsing or background knowledge), the result was inferior to that reported in the abovementioned paper. As Croatian is one of the low-resource languages, there are considerable links between using such an approach (that maximizes the role of data) and sustainability. The main objective of this chapter is to give a clear understanding of the position of low-resource languages and propose a direction for sustainable development of language technologies illustrated using convolutional neural networks for textual sentiment analysis . Impact of this research to scientific but also business community is significant due to fact that every method with acceptable ratio of simplicity and effectiveness can be included inside more complex logic environment focusing on specific language or appliance in specific area. Since language structure is generally not easy to manage, there is constant need for improvement of tools used to score text data especially while majority of unstructured data analysis tools often transfer various data to text and create further analysis paths form there.


Deep convolutional neural networks Sentiment analysis Slavic languages Sustainable techniques 


  1. 1.
    A. Abbasi, H. Chen, A. Salem, sentiment analysis in multiple languages: feature selection for opinion classification in web forums. ACM Trans. Inf. Syst. (TOIS) 26(3) (2008)Google Scholar
  2. 2.
    M. Abhijit, K. Diptesh, N. Seema N., Kuntal, B. Pushpak, Leveraging cognitive features for sentiment analysis, in Proceedings of The 20th SIGNLL Conference on Computational Natural Language Learning (2016)Google Scholar
  3. 3.
    D.H. Ackley, G.E. Hinton, T.J. Sejnowski, A learning algorithm for boltzmann machines. Cogn. Sci. 9, 147–169 (1985)CrossRefGoogle Scholar
  4. 4.
    A. Anton, J. Earp, Q. He, D. Bolchini Stufflebeam, C. Jensen, Financial privacy policies and the need for standardization. Secur. Priv. IEEE 2(2), 36–45 (2004)Google Scholar
  5. 5.
    C. Banea, R. Mihalcea, J. Wiebe, S. Hassan, Multilingual subjectivity analysis using machine translation, in Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP-2008) (2008)Google Scholar
  6. 6.
    P. Blackburn, J. Bos, Representation and Inference for Natural Language: A First Course in Computational Semantics (Center for the Study of Language and Information, Amsterdam, 2005)Google Scholar
  7. 7.
    B. Dropuljic, S. Skansi, R. Kopal, Analyzing affective elements using acoustic and linguistic features, in Proceedings of the Central European Conference on Information and Intelligent Systems (CECIIS 2016) (2016), pp. 201–206Google Scholar
  8. 8.
    B. Franks, Timing the Big Data Tidal Wave: Finding Opportunities in Huge Dana Streams with Advanced Analytics (Wiley and SAS Business Series, New York, 2012)CrossRefGoogle Scholar
  9. 9.
    A. Frome, G. Corrado, J. Shlens, J. Dean, T. Mikolov, Devise: A deep visual-semantic embedding model, in Advances in Neural Information Processing Systems (2013), pp. 2121–2129Google Scholar
  10. 10.
    D.J. Gunkel, A vindication of the rights of machines. Philos. Technol. 27(1), 113–132 (2014)CrossRefGoogle Scholar
  11. 11.
    J. Haiman, Talk Is Cheap: Sarcasm, Alienation, and the Evolution of Language (Oxford University Press, Oxford, 1998)Google Scholar
  12. 12.
    M. Hassoun, Fundamentals of Artificial Neural Networks (MIT Press, Cambridge, 2003)zbMATHGoogle Scholar
  13. 13.
    D. Hebb, The Organization of Behavior (Wiley, New York, 1949)Google Scholar
  14. 14.
    G.E. Hinton, Learning distributed representations of concepts, in Proceedings of the Ninth Conference of the Cognitive Science Society, Amherst, MA (1986), pp. 1–12Google Scholar
  15. 15.
    J.R. Kalyvas, M.R. Overly, Big Data: A Business and Legal Guide (Taylor and Francis Group, New York, 2015)Google Scholar
  16. 16.
    Q. Le, T. Mikolov, Distributed Representations of Sentences (2014). arXiv:1405.4053
  17. 17.
    Y. LeCun, L. Bottou, Y. Bengio, P. Haffner, Gradient-based learning applied to document recognition. Proc. IEEE 86(11), 2278–2324 (1998)CrossRefGoogle Scholar
  18. 18.
    Y. LeCun, Une procédure d’apprentissage pour réseau a seuil asymmetrique. Proc. Cogn. 85, 599–604 (1985)Google Scholar
  19. 19.
    V. Lyovin, An Introduction to the Languages of the World (Oxford University Press, New York, 1997)Google Scholar
  20. 20.
    F. Magdoff, J.B. Foster, What Every Environmentalist Needs to Know About Capitalism: A Citizen’s Guide to Capitalism and the Environment (Monthly Review Press, New York, 2011)Google Scholar
  21. 21.
    W. McCulloch, W. Pitts, A logical calculus of ideas immanent in nervous activity. Bull. Math. Biophys. 5(4), 115–133 (1943)Google Scholar
  22. 22.
    M. Minsky, S. Papert, An Introduction to Computational Geometry (MIT Press, Cambridge, 1969)Google Scholar
  23. 23.
    D.B. Parker, Learning-logic. Technical report-47, MIT Center for Computational Economics, Cambridge (1985)Google Scholar
  24. 24.
    F. Rosenblatt, The perceptron: a probabilistic model for information storage and organization in the brain. Psychol. Rev. 65(6), 386–408 (1958)Google Scholar
  25. 25.
    I. Rubenstein, Regulating privacy by design. Berkeley Technol. Law J. 26, 1409 (2012)Google Scholar
  26. 26.
    S. Russell, P. Norvig, Artificial Intelligence: A Modern Approach (Pearsons, Harlow, 2009)zbMATHGoogle Scholar
  27. 27.
    R. Schiller, Irrational Exhuberance (Princeton University Press, New York, 2000)Google Scholar
  28. 28.
    V.M. Schonberger, K. Cukier, Big Data: A Revolution That Will Transform How We Live, Work and Think (Houghton Mifflin Harcourt Publishing Company, New York, 2013)Google Scholar
  29. 29.
    P. Singer, Animal Liberation: A New Ethics for Our Treatment of Animals (New York Review of Books, New York, 1975)Google Scholar
  30. 30.
    M.W. Vail, J.B. Earp, A.I. Anton, An empirical study of consumer perceptions and comprehension of web-site privacy policies. IEEE Trans. Eng. Manage. 55(3), 442–454 (2008)CrossRefGoogle Scholar
  31. 31.
    P.J. Werbos, Beyond Regression: New Tools for Prediction and Analysis in the Behavioral Sciences (Harvard University, Cambridge, 1975)Google Scholar
  32. 32.
    T. Wilson, J. Wiebe, P. Hoffman, Recognizing contextual polarity in phrase-level sentiment analysis, in Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP-2005) (2005)Google Scholar
  33. 33.
    J.D. Young, Commitment analysis to operationalize software requirements from privacy notices. Requirement Eng. 16(1), 33–46 (2010)CrossRefGoogle Scholar
  34. 34.
    X. Zhang, Y. LeCun, Text Understanding from Scratch (2016). arXiv:1502.01710

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  1. 1.University College AlgebraZagrebCroatia

Personalised recommendations