Subjective Interpretation of Complex Data: Requirements for Supporting Kansei Mining Process

  • Nadia Bianchi-Berthouze
  • Tomofumi Hayashi
Part of the Lecture Notes in Computer Science book series (LNCS, volume 2797)


Today’s technology makes it possible to easily access huge amounts of complex data. As a consequence, techniques are needed for accessing the semantics of such data and supporting the user in selecting relevant information. While meta-languages such as XML have been proposed, they are not suitable for complex data such as images, video, sounds or any other non-verbal channel of communication, because those data have very subjective semantics, i.e., whose interpretation varies over time and between subjects. Yet, providing access to subjective semantics is becoming critical with the significant increase in interactive systems such as web-based systems or socially interactive robots. In this work, we attempt to identify the requirements for providing access to the subjective semantics of complex data. In particular, we focus on how to support the analysis of those dimensions that give rise to multiple subjective interpretations of the data. We propose a data warehouse as a support for the mining process involved. A unique characteristic of the data warehouse lays in its ability to store multiple hierarchical descriptions of the multimedia data.


Image Retrieval Complex Data Relevance Feedback User Feedback Subjective Interpretation 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Ekman, P.: An Argument for Basic Emotions. Cognition and Emotion 6(3/4), 169–200 (1992)Google Scholar
  2. 2.
    von Laban, R.: The mastery of movement, Princeton (1988)Google Scholar
  3. 3.
    Arijon, D.: Grammar of the film language. Silman James (1991) Google Scholar
  4. 4.
    Bianchi, N., Bottoni, P., Mussio, P., Rezzonico, G., Strepparava, M.G.: Participatory Interface Design: From Naive Models to Systems. In: International Conference on Human Computer Interaction (1997) Google Scholar
  5. 5.
    Ekman, P., Friesen, W.V.: Facial Action Coding System. Consulting Psychologists Press, Palo Alto (1976)Google Scholar
  6. 6.
    Schiphorst, T., Fels, S.: Affect Space: Semantics of Caress. In: Communication of Art, Science, Technology (CAST 2001), pp. 285–287 (2001)Google Scholar
  7. 7.
    Canamero, L.D., Fredslund, J.: I Show You How I Like You: Human-Robot Interaction through Emotional Expression and Tactile Stimulation. Dept. of Computer Science Technical Report DAIMI PB 544, University of Aarhus, Denmark (2000)Google Scholar
  8. 8.
    Breazeal, C.: Early Experiments using Motivations to Regulate Human-Robot Interaction. In: Canamero, D. (ed.) Emotional and Intelligent: The Tangled Knot of Cognition. Papers from the 1998 AAAI Fall Symposium (1998); AAAI Technical Report FS-98-03. AAAI Press, Menlo Park (1998)Google Scholar
  9. 9.
    Tojo, T., Matsusaka, Y., Ishi, T., Kobayashi, T.: A Conversational Robot Using Facial and Body Expressions. In: Proceedings of IEEE International Conference of Systems, Man and Cybernetics, pp. 858–863 (2000)Google Scholar
  10. 10.
    Camurri, A., Hashimoto, S., Ricchetti, M., Ricci, A., Suzuki, K., Trocca, R., Volpe, G.: EyesWeb – Toward Gesture and Affect Recognition in Dance/Music Interactive Systems. Computer Music Journal 24(1), 57–69 (2000)CrossRefGoogle Scholar
  11. 11.
    Picard, R.W.: Affective Computing, MIT Press, Cambridge (1997) Google Scholar
  12. 12.
  13. 13.
    Inder, R., Bianchi-Berthouze, N., Kato, T.: K-DIME: A Software Framework for Kansei Filtering of Internet Material. In: Proceedings of IEEE International Conference on Systems, Man and Cybernetics, vol. 6, Tokyo, Japan, pp. 241–246 (1999)Google Scholar
  14. 14.
    Yoshida, K., Kato, T., Yanoru, T.: A Study of Database Systems with Kansei Information. In: IEEE International Conference on Systems Man and Cybernetics 1999, vol. 6, Tokyo, Japan, pp. 253–256 (1999)Google Scholar
  15. 15.
    Hattori, R., Fujiyoshi, M., Iida, M.: An Education System on WWW for Study Color Impression of Art Paintings Applied NetCatalog. In: IEEE International Conference on Systems Man and Cybernetics 1999, vol. 6, Tokyo, Japan, pp. 218–223 (1999)Google Scholar
  16. 16.
    Dorai, C., Venkatesh, S. (eds.): Media Computing: Computational Aesthetics. Kluwer Academic Publishers, Dordrecht (2002)Google Scholar
  17. 17.
    Imai, T., Yamauchi, K., Ishi, N.: Color Coordination System on Case Based Reasoning System using Neural Networks. In: IEEE International Conference on Systems Man and Cybernetics 1999, vol. 6, Tokyo, Japan, pp. 224–229 (1999)Google Scholar
  18. 18.
    Lee, S., Harada, A.: A Design Approach by Objective and Subjective Evaluation of Kansei Information. In: Proceedings of International Workshop on Robot and Human Communication, pp. 327–332. IEEE Press, Hamamatsu (1998)Google Scholar
  19. 19.
    Shibata, T., Kato, T.: ”Kansei” Image Retrieval System for Street Landscape. Discrimination and Graphical Parameters based on correlation of Two Images. In: IEEE International Conference on Systems Man and Cybernetics 1999, vol. 6, Tokyo, Japan, pp. 247–252 (1999)Google Scholar
  20. 20.
    Pashler, H.: Attention and Visual Perception: Analyzing Divided Attention. International Journal of Visual Cognition 2, 71–100 (1996)Google Scholar
  21. 21.
    Bianchi-Berthouze, N., Lisetti, C.: Modeling Multimodal Expression of Users’ Affective Subjective Experience. International Journal on User Modeling and User- Adapted Interaction 12(1), 49–84 (2002)zbMATHCrossRefGoogle Scholar
  22. 22.
    Nakata, T.: Generation of whole-body expressive movement based on somatic theories. In: Proceedings of the second international workshop on Epigenetic Robotics, pp. 105–114 (2002)Google Scholar
  23. 23.
    Rui, Y., Huang, T.S., Ortega, M., Mehrotra, S.: Relevance Feedback: A power tool in interactive content-based image retrieval. IEEE Transaction on Circuits and Systems for Video Technology 8(5), 644–655 (1998)CrossRefGoogle Scholar
  24. 24.
    Smeulders, A., Worring, M., Santini, S., Gupta, A., Jain, R.: Content-Based Image Retrieval at the end of the early Years. IEEE Transaction on Pattern Analysis and Machine Intelligence 22(12), 10–12 (2000)CrossRefGoogle Scholar
  25. 25.
    Bianchi-Berthouze, N.: Mining Multimedia Subjective Feedback. International Journal of Information Systems. Kluwer Academic Publishers (2002)Google Scholar
  26. 26.
    Jaimes, A., Chang, S.F.: A Conceptual Framework for Indexing Visual Information at Multiple Levels. In: Internet Imaging 2000, IS&T/SPIE. San Jose, CA (2000) Google Scholar
  27. 27.
    Timpf, S.: Abstraction, levels of detail, and hierarchies in map series. In: Freksa, C., Mark, D.M. (eds.) COSIT 1999. LNCS, vol. 1661, pp. 125–140. Springer, Heidelberg (1999)CrossRefGoogle Scholar
  28. 28.
    Bianchi-Berthouze, N., Berthouze, L.: Exploring Kansei in Multimedia Information. International Journal on Kansei Engineering 2(1), 1–10 (2001)Google Scholar
  29. 29.
    Agrawal, R., Gerhrke, J., Gunopulos, D., Raghavan, P.: Automatic Subspace Clustering of High Dimensional Data for Data Mining Applications. In: Proceedings of ACM SIGMOD International Conference on Management of Data, Seattle, Washington (1998) Google Scholar
  30. 30.
    PostgreSQL (2003),
  31. 31.
    Kobayashi, S.: Colorist: a practical handbook for personal and professional use. Kodansha Press (1998)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2003

Authors and Affiliations

  • Nadia Bianchi-Berthouze
    • 1
  • Tomofumi Hayashi
    • 2
  1. 1.Database Systems LabUniversity of AizuAizu WakamatsuJapan
  2. 2.Japan Advanced Institute of Science and TechnologyNomi Gun, Ishikawa-KenJapan

Personalised recommendations