VEO-Engine: Interfacing and Reasoning with an Emotion Ontology for Device Visual Expression

  • Muhammad Amith
  • Rebecca Lin
  • Chen Liang
  • Yang Gong
  • Cui TaoEmail author
Conference paper
Part of the Communications in Computer and Information Science book series (CCIS, volume 851)


In order for machines to understand or express emotion to users, the specific emotions must be formally defined and the software coded to how those emotions are to be expressed. This is particularly important if devices or computer-based tools are utilized in clinical settings, which may be stressful for patients and where emotions can dominate their decision making. We have reported our development and feasibility results of an ontology, Visualized Emotion Ontology (VEO), that links abstract visualizations that express specific emotions. Here, we used VEO with the VEO-Engine, a software API package that interfaces with the VEO. The VEO-Engine was developed in Java using Apache Jena and OWL-API. The software package was tested on a Raspberry Pi machine with a small touchscreen display that linked each visualization to an emotion. The VEO-Engine stores input parameters of emotional situations and valences to reason and interpret users’ emotions using the ontology-based reasoner. With this software, devices can interfaced wirelessly, so smart devices with visual displays can interact with the ontology. By means of the VEO-Engine, we show the portability and usability of the VEO in human-computer interaction.


Ontology Emotions Semantic web mHealth Affective computing 



This research was supported by the UTHealth Innovation for Cancer Prevention Research Training Program (Cancer Prevention and Research Institute of Texas grant #RP160015), the National Library of Medicine of the National Institutes of Health award #R01LM011829, and the National Institute of Allergy and Infectious Diseases of the National Institutes of Health award #R01AI130460.


  1. 1.
    Allemang, D., Hendler, J.: Semantic Web for the Working Ontologist: Effective Modeling in RDFS and OWL. Elsevier, New York City (2011)Google Scholar
  2. 2.
    Apache Software Foundation: Apache Jena.
  3. 3.
    Beckett, D., Berners-Lee, T., Prudhommeaux, E.: Turtle-terse RDF triple language. W3C Team Submiss. 14, 7 (2008)Google Scholar
  4. 4.
    Ekman, P., Friesen, W.V., Ellsworth, P.: Emotion in the Human Face: Guide-lines for Research and an Integration of Findings: Guidelines for Research and an Integration of Findings. Pergamon, Oxford (1972)Google Scholar
  5. 5.
    Glimm, B., Horrocks, I., Motik, B., Stoilos, G., Wang, Z.: HermiT: an OWL 2 reasoner. J. Autom. Reason. 53(3), 245–269 (2014)CrossRefGoogle Scholar
  6. 6.
    Harris, S., Seaborne, A.: SPARQL (2013).
  7. 7.
    Hatfield, E., Cacioppo, J.T., Rapson, R.L.: Emotional contagion. Curr. Dir. Psychol. Sci. 2(3), 96–100 (1993)CrossRefGoogle Scholar
  8. 8.
    Horridge, M., Bechhofer, S.: The OWL API: a java API for OWL ontologies. Semant. Web 2(1), 11–21 (2011)Google Scholar
  9. 9.
    Lin, R., Amith, M., Liang, C., Duan, R., Chen, Y., Tao, C.: Visualized emotion ontology: a model for representing visual cues of emotions. BMC Medical Informatics and Decision Making (In Press)Google Scholar
  10. 10.
    Lin, R., Amith, M., Liang, C., Tao, C.: Designing an ontology for emotion-driven visual representations. In: 2017 IEEE International Conference on Bioinformatics and Biomedicine (BIBM), pp. 1280–1283. IEEE (2017)Google Scholar
  11. 11.
    Ortony, A., Clore, G.L., Collins, A.: The cognitive structure of emotions. Cambridge University Press, Cambridge (1990)Google Scholar
  12. 12.
    Steunebrink, B.R., Dastani, M., Meyer, J.J.C.: The OCC model revisited. In: Proceedings of the 4th Workshop on Emotion and Computing (2009)Google Scholar
  13. 13.
    W3C Owl Working Group and others: OWL 2 Web Ontology Language Document Overview (2nd edn) (2012).

Copyright information

© Springer International Publishing AG, part of Springer Nature 2018

Authors and Affiliations

  • Muhammad Amith
    • 1
  • Rebecca Lin
    • 2
  • Chen Liang
    • 3
  • Yang Gong
    • 1
  • Cui Tao
    • 1
    Email author
  1. 1.University of Texas Health Science CenterHoustonUSA
  2. 2.Johns Hopkins UniversityBaltimoreUSA
  3. 3.Lousiana Tech UniversityRustonUSA

Personalised recommendations