Hybrid Books for Interactive Digital Storytelling: Connecting Story Entities and Emotions to Smart Environments

  • Hajar Ghaem SigarchianEmail author
  • Ben De Meester
  • Frank Salliau
  • Wesley De Neve
  • Sara Logghe
  • Ruben Verborgh
  • Erik Mannens
  • Rik Van de Walle
  • Dimitri Schuurman
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9445)


Nowadays, many people use e-books, having high expectations regarding their reading experience. In the case of digital storytelling, enhanced e-books can connect story entities and emotions to real-world elements. In this paper, we present the novel concept of a Hybrid Book, a generic Interactive Digital Narrative (IDN) artifact that requires seamless collaboration between content and smart devices. To that end, we extract data from a story and broadcast these data in RDF as Linked Data. Smart devices can then receive and process these data in order to execute corresponding actions. By following open standards, a Hybrid Book can also be seen as an interoperable and sustainable IDN artifact. Furthermore, according to our user-based evaluation, a Hybrid Book makes it possible to provide human sensible feedback while flipping pages, enabling a more enjoyable reading experience. Finally, the participants positive willingness to pay makes it possible to generate more revenue for publishers.


e-Books EPUB 3 Interactive Digital Narrative Semantic Web Smart living environments 



The research described in this paper was funded by Ghent University, iMinds, the Institute for Promotion of Innovation by Science and Technology in Flanders (IWT), the FWO-Flanders, and the European Union.


  1. 1.
    Smith, T.F., Waterman, M.S.: Identification of common molecular subsequences. J. Mol. Biol. 147, 195–197 (1981)CrossRefGoogle Scholar
  2. 2.
    Anastasiades, S.P.: The future of the book, the book of the future. In: Proceedings of Advanced Learning Technologies, pp. 246–247 (2003)Google Scholar
  3. 3.
    Baggia, P., Pelachaud, C., Peter, C., Zovato, E.: Emotion Markup Language (EmotionML) 1.0Google Scholar
  4. 4.
    Bartneck, C., Hu, J., Salem, B., Cristescu, R., Rauterberg, M.: Applying virtual and augmented reality in cultural computing. IJVR 7(2), 11–18 (2008)Google Scholar
  5. 5.
    Beckett, D., Berners-Lee, T., Prud’hommeaux, E., Carothers, G.: RDF 1.1 Turtle Terse RDF Triple Language W3C Recommendation (2014)Google Scholar
  6. 6.
    De Marez, L.: Diffusie van ICT-Innovaties: Accurater Gebruikersinzicht voor BetereIntroductiestrategieën. Ph.D. thesis, Ghent University (2006)Google Scholar
  7. 7.
    De Marez, L., Verleye, G.: Innovation diffusion: the need for more accurate consumer insight. Illustration of the PSAP scale as a segmentation instrument. J. Target. Measur. Anal. Mark. 13(1), 32–49 (2004)CrossRefGoogle Scholar
  8. 8.
    De Meester, B., De Nies, T., Ghaem Sigarchian, H., Van der Sande, M., Van Campen, J., Van Impe, B., De Neve, W., Mannens, E., Van de Walle, R.: A digital-first authoring environment for enriched e-Books using EPUB 3. Inf. Serv. Use 34(3–4), 259–268 (2014)Google Scholar
  9. 9.
    Eckman, P.: Universal and cultural differences in facial expression of emotion. In: Nebraska Symposium on Motivation, vol. 19, pp. 207–284. University of Nebraska Press Lincoln (1972)Google Scholar
  10. 10.
    Ghaem Sigarchian, H., De Meester, B., De Nies, T., Verborgh, R., De Neve, W., Mannens, E., Van de Walle, R.: EPUB3 for integrated and customizable representation of a scientific publication and its associated resources. In: Proceedings of the 4th Workshop on Linked Science (2014)Google Scholar
  11. 11.
    Ghaem Sigarchian, H., De Meester, B., De Nies, T., Verborgh, R., Salliau, F., De Neve, W., Mannens, E., Van de Walle, R.: Towards making EPUB 3-based e-TextBooks a first-class mobile learning environment. In: Proceedings of the 10th International Conference in e-Learning (2015)Google Scholar
  12. 12.
    Herman, I., Adida, B., Sporny, M., Birbeck, M.: RDFa 1.1 Primer - Third Edition Rich Structured Data Markup for Web Documents. Technical report, W3C (2015)Google Scholar
  13. 13.
    Hickson, I.: HTML Microdata. Technical report, W3C (2013)Google Scholar
  14. 14.
    IDPF: Electronic Publication, Version 3 (2013).
  15. 15.
    Kjeldskov, J., Skov, M.B., Als, B.S., Høegh, R.T.: Is it worth the hassle? Exploring the added value of evaluating the usability of context-aware mobile systems in the field. In: Brewster, S., Dunlop, M.D. (eds.) Mobile HCI 2004. LNCS, vol. 3160, pp. 61–73. Springer, Heidelberg (2004) CrossRefGoogle Scholar
  16. 16.
    Klyne, G., Carroll, J., McBride, B.: RDF 1.1 Concepts and Abstract Syntax. Technical report, W3C (2014)Google Scholar
  17. 17.
    Koenitz, H.: Five theses for interactive digital narrative. In: Mitchell, A., Fernández-Vara, C., Thue, D. (eds.) ICIDS 2014. LNCS, vol. 8832, pp. 134–139. Springer, Heidelberg (2014) Google Scholar
  18. 18.
    Koenitz, H.: Towards a Specific Theory of Interactive Digital Narrative. Interactive Digital Narrative: History, Theory and Practice, p. 91 (2015)Google Scholar
  19. 19.
    Koenitz, H., Haahr, M., Ferri, G., Sezen, T.I., Sezen, D.: Mapping the evolving space of interactive digital narrative - from artifacts to categorizations. In: Koenitz, H., Sezen, T.I., Ferri, G., Haahr, M., Sezen, D., C̨atak, G. (eds.) ICIDS 2013. LNCS, vol. 8230, pp. 55–60. Springer, Heidelberg (2013) CrossRefGoogle Scholar
  20. 20.
    Liljedahl, M.: Sound for Fantasy and Freedom. Game Sound Technology and Player Interaction: Concepts and Developments, pp. 22–44 (2011)Google Scholar
  21. 21.
    Nakevska, M., Funk, M., Hu, J., Eggen, B., Rauterberg, M.: Interactive storytelling in a mixed reality environment: how does sound design and users’ preknowledge of the background story influence the user experience? In: Mitchell, A., Fernández-Vara, C., Thue, D. (eds.) ICIDS 2014. LNCS, vol. 8832, pp. 188–195. Springer, Heidelberg (2014) Google Scholar
  22. 22.
    Nijdam, A.N.: Mapping Emotion to Color (2009). at the University of Twente
  23. 23.
    Osondu, C., Wei, W.: Named Entity Classification. York University (2011)Google Scholar
  24. 24.
    Prud’Hommeaux, E., Seaborne, A.: SPARQL Query Language for RDF. W3C Recommendation (2008)Google Scholar
  25. 25.
    Gruber, T.R.: A translation approach to portable ontology specifications. Knowl. Acquisition 5(2), 199–220 (1993)CrossRefGoogle Scholar
  26. 26.
    Read, J.C., MacFarlane, S.: Using the fun toolkit and other survey methods to gather opinions in child computer interaction. In: Proceedings of the 2006 Conference on Interaction Design and Children, pp. 81–88. ACM (2006)Google Scholar
  27. 27.
    Sánchez-Rada, J.F., Iglesias, C.A.: Onyx: a linked data approach to emotion representation. Inf. Process. Manage. 51, 83–113 (2015)Google Scholar
  28. 28.
    Seadle, M., Vassiliou, M., Rowley, J.: Progressing the definition of e-book. Library Hi Tech 26(3), 355–368 (2008)CrossRefGoogle Scholar
  29. 29.
    Sekine, S., Sudo, K., Nobata, C.: Extended named entity hierarchy. In: LREC (2002)Google Scholar
  30. 30.
    Shaw, C., Ivens, J.: Building Great Customer Experiences. Palgrave Macmillan, Basingstoke (2002)CrossRefGoogle Scholar
  31. 31.
    Smith, M.K., Welty, C., L. McGuinness, D.: OWL Web Ontology Language Guide: W3c Recommendation (2004)Google Scholar
  32. 32.
    Thoma, G.R., Ford, G., Chung, M., Vasudevan, K., Antani, S.: Interactive publications: creation and usage. In: Electronic Imaging 2006, pp. 603–607. International Society for Optics and Photonics (2006)Google Scholar
  33. 33.
    Verborgh, R., et al.: Querying datasets on the web with high availability. In: Mika, P., et al. (eds.) ISWC 2014, Part I. LNCS, vol. 8796, pp. 180–196. Springer, Heidelberg (2014) Google Scholar
  34. 34.
    Vermeeren, A.P., Law, E.L.C., Roto, V., Obrist, M., Hoonhout, J., Väänänen-Vainio-Mattila, K.: User experience evaluation methods: current state and development needs. In: Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries, pp. 521–530. ACM (2010)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  • Hajar Ghaem Sigarchian
    • 1
    Email author
  • Ben De Meester
    • 1
  • Frank Salliau
    • 1
  • Wesley De Neve
    • 1
  • Sara Logghe
    • 1
  • Ruben Verborgh
    • 1
  • Erik Mannens
    • 1
  • Rik Van de Walle
    • 1
  • Dimitri Schuurman
    • 1
  1. 1.Ghent University – iMindsGentBelgium

Personalised recommendations