Correlating Text and Images: Concept and Evaluation

  • Timo Götzelmann
  • Pere-Pau Vázquez
  • Knut Hartmann
  • Andreas Nürnberger
  • Thomas Strothotte
Conference paper

DOI: 10.1007/978-3-540-73214-3_9

Volume 4569 of the book series Lecture Notes in Computer Science (LNCS)
Cite this paper as:
Götzelmann T., Vázquez PP., Hartmann K., Nürnberger A., Strothotte T. (2007) Correlating Text and Images: Concept and Evaluation. In: Butz A., Fisher B., Krüger A., Olivier P., Owada S. (eds) Smart Graphics. SG 2007. Lecture Notes in Computer Science, vol 4569. Springer, Berlin, Heidelberg

Abstract

This paper presents the concept and an evaluation of a novel approach to support students to understand complex spatial relations and to learn unknown terms of a domain-specific terminology with coordinated textual descriptions and illustrations. Our approach transforms user interactions into queries to an information retrieval system. By selecting text segments or by adjusting the view to interesting domain objects, learners can request additional contextual information. Therefore, the system uses pre-computed multi-level representations of the content of explanatory text and of views on 3D models to suggest textual descriptions or views on 3D objects that might support the current learning task.

Our experimental application is evaluated by a user study that analyzes (i) similarity measures that are used by the information retrieval system to coordinate the content of descriptive texts and computer-generated illustrations and (ii) the impact of the individual components of these measures. Our study revealed that the retrieved results match the preferences of the users. Furthermore, the statistical analysis suggests a rough value to cut-off retrieval results according to their relevancy.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Springer-Verlag Berlin Heidelberg 2007

Authors and Affiliations

  • Timo Götzelmann
    • 1
  • Pere-Pau Vázquez
    • 3
  • Knut Hartmann
    • 1
  • Andreas Nürnberger
    • 2
  • Thomas Strothotte
    • 1
  1. 1.Graphics and Interactive Systems Group 
  2. 2.Information Retrieval Group, University of MagdeburgGermany
  3. 3.Modeling, Visualization, and Graphics Interaction Group, Technical University of CataloniaSpain