Text-Based Approaches for the Categorization of Images

  • Carl L. Sable
  • Vasileios Hatzivassiloglou
Conference paper

DOI: 10.1007/3-540-48155-9_4

Part of the Lecture Notes in Computer Science book series (LNCS, volume 1696)
Cite this paper as:
Sable C.L., Hatzivassiloglou V. (1999) Text-Based Approaches for the Categorization of Images. In: Abiteboul S., Vercoustre AM. (eds) Research and Advanced Technology for Digital Libraries. ECDL 1999. Lecture Notes in Computer Science, vol 1696. Springer, Berlin, Heidelberg

Abstract

The rapid expansion of multimedia digital collections brings to the fore the need for classifying not only text documents but their embedded non-textual parts as well. We propose a model for basing classification of multimedia on broad, non-topical features, and show how information on targeted nearby pieces of text can be used to effectively classify photographs on a first such feature, distinguishing between indoor and outdoor images. We examine several variations to a TF*IDF-based approach for this task, empirically analyze their effects, and evaluate our system on a large collection of images from current news newsgroups. In addition, we investigate alternative classification and evaluation methods, and the effect that a secondary feature can have on indoor/outdoor classification. We obtain a classification accuracy of 82%, a number that clearly outperforms baseline estimates and competing image-based approaches and nears the accuracy of humans who perform the same task with access to comparable information.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Springer-Verlag Berlin Heidelberg 1999

Authors and Affiliations

  • Carl L. Sable
    • 1
  • Vasileios Hatzivassiloglou
    • 1
  1. 1.Department of Computer Science, 450 Computer Science BuildingColumbia UniversityNew YorkUSA

Personalised recommendations