Skip to main content

Hyper-parameter Optimization of Sticky HDP-HMM Through an Enhanced Particle Swarm Optimization

  • Conference paper
  • First Online:
Neural Information Processing (ICONIP 2016)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 9949))

Included in the following conference series:

  • 3142 Accesses

Abstract

Faced with the problem of uncertainties in object trajectory and pattern recognition in terms of the non-parametric Bayesian approach, we have derived that 2 major methods of optimizing hierarchical Dirichlet process hidden Markov model (HDP-HMM) for the task. HDP-HMM suffers from poor performance not only on moderate dimensional data, but also sensitivity to its parameter settings. For the purpose of optimizing HDP-HMM on dimensional data, test for optimized results will be carried on the Tum Kitchen dataset [7], which was provided for the purpose of research the motion and activity recognitions. The optimization techniques capture the best hyper-parameters which then produce optimal solution to the task given in a certain search space.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Bergstra, J., Bengio, Y.: Random search for hyper-parameter optimization. J. Mach. Learn. Res. 13, 281–305 (2012)

    MathSciNet  MATH  Google Scholar 

  2. Fox, E.B.: Bayesian nonparametric learning of complex dynamical phenomena. PhD thesis, Massachusetts Institute of Technology, September 2009

    Google Scholar 

  3. Fox, E.B., Sudderth, E.B., Jordan, M.I., Willsky, A.S.: The sticky HDP-HMM: Bayesian nonparametric hidden Markov models with persistent states. Arxiv preprint (2007)

    Google Scholar 

  4. Fox, E.B., Sudderth, E.B., Jordan, M.I., Willsky, A.S.: An HDP-HMM for systems with state persistence. In: Proceedings of the 25th International Conference on Machine Learning, pp. 312–319. ACM (2008)

    Google Scholar 

  5. Fox, E.B., Sudderth, E.B., Jordan, M.I., Willsky, A.S.: A sticky HDP-HMM with application to speaker diarization. ArXiv e-prints, May 2011

    Google Scholar 

  6. Kivinen, J.J., Sudderth, E.B., Jordan, M.I.: Learning multiscale representations of natural scenes using Dirichlet processes. In: IEEE 11th International Conference on Computer Vision, 2007. ICCV 2007, pp. 1–8. IEEE (2007)

    Google Scholar 

  7. Tenorth, M., Bandouch, J., Beetz, M.: The TUM kitchen data set of everyday manipulation activities for motion tracking and action recognition. In: IEEE International Workshop on Tracking Humans for the Evaluation of their Motion in Image Sequences (THEMIS), in conjunction with ICCV 2009 (2009)

    Google Scholar 

  8. Xing, E.P., Sohn, K.-A., et al.: Hidden Markov Dirichlet process: modeling genetic inference in open ancestral space. Bayesian Anal. 2(3), 501–527 (2007)

    Article  MathSciNet  MATH  Google Scholar 

  9. Xue, L., Yin, J., Ji, Z., Jiang, L.: A particle swarm optimization for hidden Markov model training. In: 8th International Conference on Signal Processing, vol. 1. IEEE (2006)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jiaxi Li .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing AG

About this paper

Cite this paper

Li, J., Yin, J., Chung, Y.Y., Sha, F. (2016). Hyper-parameter Optimization of Sticky HDP-HMM Through an Enhanced Particle Swarm Optimization. In: Hirose, A., Ozawa, S., Doya, K., Ikeda, K., Lee, M., Liu, D. (eds) Neural Information Processing. ICONIP 2016. Lecture Notes in Computer Science(), vol 9949. Springer, Cham. https://doi.org/10.1007/978-3-319-46675-0_11

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-46675-0_11

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-46674-3

  • Online ISBN: 978-3-319-46675-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics