Information Theoretical Kernels for Generative Embeddings Based on Hidden Markov Models

  • André F. T. Martins
  • Manuele Bicego
  • Vittorio Murino
  • Pedro M. Q. Aguiar
  • Mário A. T. Figueiredo
Conference paper

DOI: 10.1007/978-3-642-14980-1_45

Part of the Lecture Notes in Computer Science book series (LNCS, volume 6218)
Cite this paper as:
Martins A.F.T., Bicego M., Murino V., Aguiar P.M.Q., Figueiredo M.A.T. (2010) Information Theoretical Kernels for Generative Embeddings Based on Hidden Markov Models. In: Hancock E.R., Wilson R.C., Windeatt T., Ulusoy I., Escolano F. (eds) Structural, Syntactic, and Statistical Pattern Recognition. SSPR /SPR 2010. Lecture Notes in Computer Science, vol 6218. Springer, Berlin, Heidelberg

Abstract

Many approaches to learning classifiers for structured objects (e.g., shapes) use generative models in a Bayesian framework. However, state-of-the-art classifiers for vectorial data (e.g., support vector machines) are learned discriminatively. A generative embedding is a mapping from the object space into a fixed dimensional feature space, induced by a generative model which is usually learned from data. The fixed dimensionality of these feature spaces permits the use of state of the art discriminative machines based on vectorial representations, thus bringing together the best of the discriminative and generative paradigms.

Using a generative embedding involves two steps: (i) defining and learning the generative model used to build the embedding; (ii) discriminatively learning a (maybe kernel) classifier on the adopted feature space. The literature on generative embeddings is essentially focused on step (i), usually adopting some standard off-the-shelf tool (e.g., an SVM with a linear or RBF kernel) for step (ii). In this paper, we follow a different route, by combining several Hidden Markov Models-based generative embeddings (including the classical Fisher score) with the recently proposed non-extensive information theoretic kernels. We test this methodology on a 2D shape recognition task, showing that the proposed method is competitive with the state-of-art.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Springer-Verlag Berlin Heidelberg 2010

Authors and Affiliations

  • André F. T. Martins
    • 3
  • Manuele Bicego
    • 1
    • 2
  • Vittorio Murino
    • 1
    • 2
  • Pedro M. Q. Aguiar
    • 4
  • Mário A. T. Figueiredo
    • 3
  1. 1.Computer Science DepartmentUniversity of VeronaVeronaItaly
  2. 2.Istituto Italiano di Tecnologia (IIT)GenovaItaly
  3. 3.Instituto de Telecomunicações, Instituto Superior TécnicoLisboaPortugal
  4. 4.Instituto de Sistemas e Robótica, Instituto Superior TécnicoLisboaPortugal

Personalised recommendations