An Efficient Algorithm for Modelling Duration in Hidden Markov Models, with a Dramatic Application

  • Søren HaubergEmail author
  • Jakob Sloth


For many years, the hidden Markov model (HMM) has been one of the most popular tools for analysing sequential data. One frequently used special case is the left-right model, in which the order of the hidden states is known. If knowledge of the duration of a state is available it is not possible to represent it explicitly with an HMM. Methods for modelling duration with HMM’s do exist (Rabiner in Proc. IEEE 77(2):257–286, [1989]), but they come at the price of increased computational complexity. Here we present an efficient and robust algorithm for modelling duration in HMM’s, and this algorithm is successfully used to control autonomous computer actors in a theatrical play.


Hidden Markov models Modelling duration Filtering Optimal particle filters Theatrical play 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Bishop, C.M.: Pattern Recognition and Machine Learning. Springer, Berlin (2006) zbMATHGoogle Scholar
  2. 2.
    Bobick, A.F., Davis, J.W.: The recognition of human movement using temporal templates. IEEE Trans. Pattern Anal. Mach. Intell. 23(3), 257–267 (2001) CrossRefGoogle Scholar
  3. 3.
    Cappé, O., Godsill, S.J., Moulines, E.: An overview of existing methods and recent advances in sequential Monte Carlo. Proc. IEEE 95, 899–924 (2007) CrossRefGoogle Scholar
  4. 4.
    Doucet, A., Godsill, S., Andrieu, C.: On sequential Monte Carlo sampling methods for Bayesian filtering. Stat. Comput. 10, 197–208 (2000) CrossRefGoogle Scholar
  5. 5.
    Johnson, M.T.: Capacity and complexity of hmm duration modeling techniques. IEEE Signal Process. Lett. 12, 407–410 (2005) CrossRefGoogle Scholar
  6. 6.
    Pinhanez, C.S., Bobick, A.F.: “It/I”: a theater play featuring an autonomous computer character. Presence 11(5), 536–548 (2002) CrossRefGoogle Scholar
  7. 7.
    Rabiner, L.R.: A tutorial on hidden Markov models and selected applications in speech recognition. Proc. IEEE 77(2), 257–286 (1989) CrossRefGoogle Scholar
  8. 8.
    Teh, C.H., Chin, R.T.: On image analysis by the methods of moments. IEEE Trans. Pattern Anal. Mach. Intell. 10(4), 496–513 (1988) CrossRefzbMATHGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC 2008

Authors and Affiliations

  1. 1.Department of Computer ScienceUniversity of CopenhagenCopenhagenDenmark

Personalised recommendations