Linguistic and Multilingual Issues in 3D3C Worlds

  • Samuel Cruz-Lara
  • Alexandre Denis
  • Nadia Bellalem
  • Lotfi Bellalem
Part of the Progress in IS book series (PROIS)


Within a globalized world, the need for linguistic support is increasing every day. Linguistic information, and in particular multilingual textual information, plays a significant role for describing digital content: information describing pictures or video sequences, general information presented to the user graphically or via a text-to-speech processor, menus in interactive multimedia or TV, subtitles, dialogue prompts, or implicit data appearing on an image such as captions, or tags. It is obviously crucial to associate digital content to linguistic information in a non-intrusive way: the user must decide, whether or not, he wants to display the linguistic information related to the digital content he is dealing with in any particular language.

In this paper we will present a general review on linguistic and multilingual issues related to virtual worlds and serious games. The expression “linguistic and multilingual issues” will consider not only any kind of linguistic support (such as syntactic and semantic analysis) based on textual information, but also any kind of multilingual and monolingual topics (such as localization or automatic translation), and their association to virtual worlds and serious games. We will focus on our ongoing research activities, particularly in the framework of sentiment analysis and emotion detection. Note that we will also dedicate special attention to standardization issues because they grant interoperability, stability, and durability.

The review will essentially be based on our own experience but some interesting international research projects and applications will be also mentioned, in particular, research projects and applications related to sentiment analysis and emotion detection.


  1. Alm, C., Roth, D., & Sproat, R. (2005). Emotions from text: Machine learning for text-based emotion prediction. In Proceedings of human language technologies conference/conference on empirical methods in natural language processing (HLT/EMNLP 2005), Vancouver, Canada.Google Scholar
  2. Amoia, M. (2011). I-FLEG: A 3D-game for learning French. In Proceedings of the 9th international conference on education and information systems, technologies and applications (EISTA 2011), Orlando, FL, USA.Google Scholar
  3. Amoia, M., Gardent, C., & Perez-Beltrachini, L. (2011). A serious game for second language acquisition. In Proceedings of the third international conference on computer aided education (CSEDU 2011), Noordwijkerout, The Netherlands.Google Scholar
  4. Baker, R., D’Mello, S., Rodrigo, M. M., & Graesser, A. C. (2010). Better to be frustrated than bored: The incidence, persistence, and impact of learner’s cognitive-affective states during interactions with three different computer-based learning environments. International Journal of Human-Computer Studies, 68(4), 223–241.CrossRefGoogle Scholar
  5. Banea, C., Mihalcea, R., Wiebe, J., & Hassan, S. (2008). Multilingual subjectivity analysis using machine translation. In Proceedings of the conference on empirical methods in natural language processing (EMNLP-2008).Google Scholar
  6. Banea, C., Mihalcea, R., & Wiebe, J. (2010). Multilingual subjectivity: Are more languages better? In Proceedings of the 23rd international conference on computational linguistics (COLING-2010).Google Scholar
  7. Banea, C., Mihalcea, R., & Wiebe, J. (2011). Multilingual sentiment and subjectivity analysis. In I. Zitouni & D. Bikel (Eds.), Multilingual natural language processing (pp. 259–277). Upper Saddle River, NJ: Prentice Hall.Google Scholar
  8. Bretaudière, T., Cruz-Lara, S., & Rojas Barahona, L. (2011). Associating automatic natural language processing to serious games and virtual worlds. The Journal of Virtual Worlds Research, 4(3). Google Scholar
  9. Calvo, R. A., & D’Mello, S. (2010). Affect detection: An interdisciplinary review of models, methods, and their applications. IEEE Transactions on Affective Computing, 1(1), 18–37.CrossRefGoogle Scholar
  10. Cassell, J., Bickmore, T., Billinghurst, M., Campbell, L., Chang, K., & Vilhjálmsson, H., et al. (1999). Embodiment in conversational interfaces: Rea. In ACM CHI 99 conference proceedings, Pittsburgh, PA.Google Scholar
  11. Chaumartin, F. R. (2007). UPAR7: A knowledge-based system for headline sentiment tagging. In Proceedings of the 4th international workshop on semantic evaluations (SemEval 2007) (pp. 422–425). Google Scholar
  12. Cruz-Lara, S. (2011). Mundos virtuales: Una infraestructura global para facilitar las interacciones sociales multilingües y el aprendizaje de idiomas. In Proceedings of the VII International Conference on Engineering and Computer Education. Workshop “New Trends in Engineering Education” (pp. 55–59), Guimarães, Portugal.Google Scholar
  13. Cruz-Lara, S., Bellalem, N., Bellalem, L., & Osswald, T. (2009). Immersive 3D environments and multilinguality: Some non-intrusive and dynamic e-learning-oriented scenarios based on textual information. The Journal of Virtual Worlds Research, 2(3).Google Scholar
  14. Cruz-Lara, S., Francopoulo, G, Romary, L., & Semar, N. (2010). MLIF: A metamodel to represent and exchange multilingual textual information. In Proceedings of the Language Resources and Evaluation Conference (LREC), Valletta, Malta.Google Scholar
  15. Cruz-Lara, S., Osswald, T., Guinaud, J., Bellalem, N., & Bellalem, L. (2011). A Chat interface using standards for communication and e-learning in virtual worlds. Lecture Notes in Business Information Processing, 73(6), 541–554.CrossRefGoogle Scholar
  16. Denecke, K. (2008). Using SentiWordNet for multilingual sentiment analysis. In Proceedings of the IEEE 24th International Conference on Data Engineering Workshop (ICDEW 2008).Google Scholar
  17. Denis, A., Cruz-Lara S., Bellalem, N., & Bellalem L. (2014, June 25). Visualization of affect in movie scripts. In Proceedings of the 1st international workshop on empathic television experiences, Newcastle-upon-Tyne, UK.Google Scholar
  18. Eggink, J., & Bland, D. (2012). A large scale experiment for mood-based classification of tv programmes. In Proceedings of the IEEE international conference on multimedia and expo (pp. 140–145).Google Scholar
  19. Ekman, P. (1972). Universals and cultural differences in facial expressions of emotions. In J. Cole (Ed.), Nebraska symposium on motivation, 1971 (pp. 207–283). Lincoln, NE: University of Nebraska Press.Google Scholar
  20. Frantova, E., & Bergler, S. (2009). Automatic emotion annotation of dream diaries. In Proceedings of the analyzing social media to represent collective knowledge workshop at K-CAP 2009, The fifth international conference on knowledge capture.Google Scholar
  21. Hu, M., & Liu, B. (2004). Mining opinion features in customer reviews. In Proceedings of AAAI 2004 (pp. 755–760). Google Scholar
  22. Kamada, M., Ambe, M., Hata, K., Yamada, E., & Fujimura, Y. (2005). The effect of the emotion-related channel in 3D virtual communication environments. Psychology Journal, 3(3), 312–327.Google Scholar
  23. Kim, S. & Hovy, E. (2006). Identifying and analyzing judgment opinions. In Proceedings of the Human Language Technology/North American Association of Computational Linguistics conference (HLT-NAACL 2006), New York, NY.Google Scholar
  24. Kort, B., Reilly, R., & Picard, R. W. (2001, August 6–8). An affective model of interplay between emotions and learning: Reengineering educational pedagogy-building a learning companion. In Proceedings of the IEEE international conference on advanced learning technologies, Madison, USA.Google Scholar
  25. Liu, B. (2012, May). Sentiment analysis and opinion mining. In G. Hirst (Series Ed.), Synthesis lectures on human language technologies. San Rafael, CA: Morgan and Claypool Publishers.Google Scholar
  26. Liu, Y., Huang, X., An, A., & Yu, X. (2007). ARSA: A sentiment-aware model for predicting sales performance using blogs. In Proceedings of ACM SIGIR, 2007.Google Scholar
  27. Metaxas, P. T., Mustafaraj, E., & Gayo-Avello, D. (2011). How (not) to predict elections. In Proceedings of Privacy, Security, Risk and Trust (PASSAT), 2011 IEEE Third International Conference on Social Computing (socialcom).Google Scholar
  28. Mihalcea, R., Banea, C., & Wiebe, J. (2007, June). Learning multilingual subjective language via cross-lingual projections. In Proceedings of the 45th annual meeting of the association of computational linguistics, Prague, Czech Republic.Google Scholar
  29. Mishne, G. (2005). Experiments with mood classification in blog posts. In Proceedings of the first workshop on stylistic analysis of text for information access.Google Scholar
  30. Mishne, G., & Glance, N. (2006). Predicting movie sales from blogger sentiment. In Proceedings of AAAI 2006 Spring Symposium on Computational Approaches to Analysing Weblogs (AAAI-CAAW 2006).Google Scholar
  31. Ochs, M., Sadek, D., & Pelachaud, C. (2012). A formal model of emotions for an empathic rational dialog agent. Autonomous Agents and Multi-Agent Systems, 24(3), 410–440.CrossRefGoogle Scholar
  32. Oliveira, E., Martins, P., & Chambel, T. (2013). Accessing movies based on emotional impact. Multimedia Systems, 19(6), 559–576.CrossRefGoogle Scholar
  33. Pang, B., Lee, L., & Vaithyanathan, S. (2002). Thumbs up? Sentiment classification using machine learning techniques. In Proceedings of EMNLP-02 (pp. 79–86).Google Scholar
  34. Pestian, J. P., Matykiewicz, P., Linn-Gust, M., South, B., Uzuner, O., Wiebe, J., et al. (2012). Sentiment analysis of suicide notes: A shared task. Biomedical Informatics Insights, 5(Suppl. 1), 3–16.PubMedCentralCrossRefPubMedGoogle Scholar
  35. Plutchik, R. (2001). The nature of emotions. American Scientist, 89(4).Google Scholar
  36. Reis, F., & Malheiro, R. (2011, May). Umniversity virtual world platform for massive open online courses University platform. In IE challenges 2011 VII international conference on ICT in education, Braga, Portugal. Google Scholar
  37. Roque, A., & Traum, D. R. (2007). A model of compliance and emotion for potentially adversarial dialogue agents. In Proceedings of the 8th SIGdial workshop on discourse and dialogue.Google Scholar
  38. Sadikov, E., Parameswaran, A., & Venetis, P. (2009, May 17–20). Blogs as predictors of movie success. In Proceedings of the third international AAAI conference on weblogs and social media (poster papers), San Jose Mc Enery Convention Center, USA. Google Scholar
  39. SemEval (2013, June 14–15). SemEval-2013: Semantic evaluation exercises. In International workshop on semantic evaluation, Atlanta, USA.Google Scholar
  40. Spertus, E. (1997). Smokey: Automatic recognition of hostile messages. In Proceedings of the conference on innovative applications of artificial intelligence (pp. 1058–1065). Menlo Park, CA: AAAI Press.Google Scholar
  41. Strapparava, C., & Valitutti, A. (2004, May). WordNet-Affect: An affective extension of WordNet. In Proceedings of the Language Resources and Evaluation Conference (LREC 2004), Lisbon (pp. 1083–1086).Google Scholar
  42. Strapparava, C., & Mihalcea, R. (2007, June). SemEval-2007 Task 14: Affective text. In Proceedings of the 4th International Workshop on the Semantic Evaluations (SemEval 2007), Prague, Czech Republic.Google Scholar
  43. Tumasjan, A., Sprenger, T. O., Sandner, Ph. G., & Welpe, I. M. (2010, May 23–26). Predicting elections with twitter: What 140 characters reveal about political sentiment. In Proceedings of the fourth international AAAI conference on weblogs and social media, Washington D.C., USA. Google Scholar
  44. Turney, P. (2002). Thumbs up or thumbs down? Semantic orientation applied to unsupervised classification of reviews. In Proceedings of the 40th annual meeting on association for computational linguistics.Google Scholar

Copyright information

© Springer International Publishing Switzerland 2016

Authors and Affiliations

  • Samuel Cruz-Lara
    • 1
  • Alexandre Denis
    • 1
  • Nadia Bellalem
    • 1
  • Lotfi Bellalem
    • 1
  1. 1.LORIA (UMR 7503)/University of LorraineNancyFrance

Personalised recommendations