BalOnSe: Temporal Aspects of Dance Movement and Its Ontological Representation

  • Katerina El RahebEmail author
  • Theofilos Mailis
  • Vladislav Ryzhikov
  • Nicolas Papapetrou
  • Yannis Ioannidis
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10250)


In this paper, we propose an approach to describe the temporal aspects of ontological representation of dance movement. By nature, human movement consists of complex combinations of spatiotemporal events, a fact that creates a big challenge for representing, searching, and reasoning about movement-related content, such as movement annotations on video dances. We have defined MoveOnto, a movement ontology whose expressive power captures movements that range from body states and transitions based on the semantics of Labanotation, to generic actions or specialized vocabularies of specific dance genres, e.g., ballet or folk. We combine the ontology description with temporal reasoning in Datalog-MTL, based on temporal rules of the movement events. Finally, we present the specifications and requirements for dance exploration from a user’s perspective and describe the architecture of BalOnSe, a specific system that is currently under implementation on top of MoveOnto according to them. BalOnSe consists of a web-based application with semantic annotation, search, and browsing on the movements, as well as a backend with archival and query processing functionality based on temporal rules.


Dance Movement Dance Genres OBDA Approach Labanotation Score Query Formulation Tool 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.



This paper includes part of the research which is conducted in the framework of the WhoLoDancE H2020 EU funded project.


  1. 1.
    The eclap e-library of performing arts.
  2. 2.
    Itreasures, capturing the intangible.
  3. 3.
    Whole body interaction learning for dance education.
  4. 4.
    Abbes, S.B., Scheuermann, A., Meilender, T., d’Aquin, M.: Characterizing modular ontologies. In: 7th International Conference on Formal Ontologies in Information Systems (2012)Google Scholar
  5. 5.
    Allen, J.F., Hayes, P.J.: A common-sense theory of time. In: IJCAI, vol. 85 (1985)Google Scholar
  6. 6.
    Arenas, M., Grau, B.C., Kharlamov, E., Marciuska, S., Zheleznyakov, D., Jimenez-Ruiz, E.: Semfacet: semantic faceted search over yago. In: 23rd International Conference on World Wide Web (2014)Google Scholar
  7. 7.
    Bellini, P., Nesi, P.: Modeling performing arts metadata and relationships in content service for institutions. Multimedia Syst. 21, 427–449 (2015)CrossRefGoogle Scholar
  8. 8.
    Bertini, M., Del Bimbo, A., Serra, G.: Learning ontology rules for semantic video annotation. In: Proceedings of the 2nd ACM Workshop on Multimedia Semantics, pp. 1–8. ACM (2008)Google Scholar
  9. 9.
    Brandt, S., Kalayci, E.G., Kontchakov, R., Ryzhikov, V., Xiao, G., Zakharyaschev, M.: Ontology-based data access with a horn fragment of metric temporal logic. In: Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence, February 4–9, 2017, San Francisco, California, USA, pp. 1070–1076 (2017)Google Scholar
  10. 10.
    Cabral, D., Valente, J.G., Aragão, U., Fernandes, C., Correia, N.: Evaluation of a multimodal video annotator for contemporary dance. In: Proceedings of the International Working Conference on Advanced Visual Interfaces, pp. 572–579. ACM (2012)Google Scholar
  11. 11.
    Das, S., Sundara, S., Cyganiak, R.: R2RML: RDB to RDF Mapping Language (2012)Google Scholar
  12. 12.
    El Raheb, K., Ioannidis, Y.: A labanotation based ontology for representing dance movement. In: International Gesture Workshop (2011)Google Scholar
  13. 13.
    El Raheb, K., Ioannidis, Y.: From dance notation to conceptual models: a multilayer approach. In: International Workshop on Movement and Computing (2014)Google Scholar
  14. 14.
    El Raheb, K., Ioannidis, Y.: Modeling abstractions for dance digital libraries. In: Joint Conference on Digital Libraries (2014)Google Scholar
  15. 15.
    El Raheb, K., Papapetrou, N., Katifori, V., Ioannidis, Y.: Balonse: ballet ontology for annotating and searching video performances. In: 3rd International Symposium on Movement and Computing (2016)Google Scholar
  16. 16.
    Guest, A.H.: Labanotation: The System of Analyzing and Recording Movement. Routledge, New York (2014)Google Scholar
  17. 17.
    Kaeppler, A.L.: Dance structures: perspectives on the analysis of human movement. Akad. Kiadó (2007)Google Scholar
  18. 18.
    Kharlamov, E., et al.: How semantic technologies can enhance data access at siemens energy. In: Mika, P., et al. (eds.) ISWC 2014. LNCS, vol. 8796, pp. 601–619. Springer, Cham (2014). doi: 10.1007/978-3-319-11964-9_38CrossRefGoogle Scholar
  19. 19.
    Kipp, M., Neff, M., Albrecht, I.: An annotation scheme for conversational gestures: How to economically capture timing and form. Lang. Res. Eval. 41(3–4), 325–339 (2007)CrossRefGoogle Scholar
  20. 20.
    Miles, A., Grant, G.: The Gail Grant Dictionary of Classical ballet in Labanotation. Dance Notation Bureau, New York (1976)Google Scholar
  21. 21.
    Poggi, A., Lembo, D., Calvanese, D., De Giacomo, G., Lenzerini, M., Rosati, R.: Linking data to ontologies. J. Data Semant. 10, 133–173 (2008)zbMATHGoogle Scholar
  22. 22.
    Ramadoss, B., Rajkumar, K.: Semi-automated annotation and retrieval of dance media objects. Cyber. Syst. Int. J. 38(4), 349–379 (2007)CrossRefGoogle Scholar
  23. 23.
    Ribeiro, C., Kuffner, R., Fernandes, C., Pereira, J.: 3d annotation in contemporary dance: enhancing the creation-tool video annotator. In: Proceedings of the 3rd International Symposium on Movement and Computing, p. 41. ACM (2016)Google Scholar
  24. 24.
    Singh, V., Latulipe, C., Carroll, E., Lottridge, D.: The choreographer’s notebook: a video annotation system for dancers and choreographers. In: Proceedings of the 8th ACM Conference on Creativity and Cognition, pp. 197–206. ACM (2011)Google Scholar

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  • Katerina El Raheb
    • 1
    • 2
    Email author
  • Theofilos Mailis
    • 1
    • 2
  • Vladislav Ryzhikov
    • 3
  • Nicolas Papapetrou
    • 1
  • Yannis Ioannidis
    • 1
    • 2
  1. 1.University of AthensAthensGreece
  2. 2.Athena Research CenterAthensGreece
  3. 3.Free University of Bozen-BolzanoBolzanoItaly

Personalised recommendations