Skip to main content
SpringerLink
Log in

The MSIIP System for Dialog State Tracking Challenge 4

  • Chapter
  • First Online:
Dialogues with Social Robots

Part of the book series: Lecture Notes in Electrical Engineering ((LNEE,volume 427))

Abstract

This article presents our approach for the Dialog State Tracking Challenge 4, which focuses on a dialog state tracking task on human-human dialogs. The system works in an turn-taking manner. A probabilistic enhanced frame structure is maintained to represent the dialog state during the conversation. The utterance of each turn is processed by discriminative classification models to generate a similar semantic structure to the dialog state. Then a rule-based strategy is used to update the dialog state based on the understanding results of current utterance. We also introduce a slot-based score averaging method to build an ensemble of four trackers. The DSTC4 results indicate that despite the simple feature set, the proposed method is competitive and outperforms the baseline on all evaluation metrics.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 149.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 199.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Williams, J., Raux, A., Ramachandran, D., Black, A.: The dialog state tracking challenge. In: Proceedings of the SIGDIAL 2013 Conference, pp. 404–413 (2013)

    Google Scholar 

  2. Henderson, J., Lemon, O.: Mixture model POMDPs for efficient handling of uncertainty in dialogue management. In: Proceedings of the 46th Annual Meeting of the Association for Computational Linguistics on Human Language Technologies: Short Papers, pp. 73–76. Association for Computational Linguistics (2008)

    Google Scholar 

  3. Williams, J.D., Young, S.: Partially observable Markov decision processes for spoken dialog systems. Comput. Speech Lang. 21(2), 393–422 (2007)

    Google Scholar 

  4. Thomson, B., Young, S.: Bayesian update of dialogue state: a POMDP framework for spoken dialogue systems. Comput. Speech Lang. 24(4), 562–588 (2010)

    Article  Google Scholar 

  5. Young, S., Gašić, M., Keizer, S., Mairesse, F., Schatzmann, J., Thomson, B., Kai, Y.: The hidden information state model: a practical framework for POMDP-based spoken dialogue management. Comput. Speech Lang. 24(2), 150–174 (2010)

    Google Scholar 

  6. Metallinou, A., Bohus, D., Williams, J.: Discriminative state tracking for spoken dialog systems. Proceedings of ACL 1, 466–475 (2013)

    Google Scholar 

  7. Lee, S.: Structured discriminative model for dialog state tracking. In: Proceedings of the SIGDIAL 2013 Conference, pp. 442–451 (2013)

    Google Scholar 

  8. Ren, H., Xu, W., Zhang, Y., Yan, Y.: Dialog state tracking using conditional random fields. In: Proceedings of the SIGDIAL 2013 Conference. Metz, France, August (2013)

    Google Scholar 

  9. Sun, K., Chen, L., Zhu, S., Yu, K.: The SJTU system for dialog state tracking challenge 2. In: Proceedings of the 15th Annual Meeting of the Special Interest Group on Discourse and Dialogue, pp. 318 (2014)

    Google Scholar 

  10. Henderson, M., Thomson, B., Young, S.: Word-based dialog state tracking with recurrent neural networks. In: Proceedings of the 15th Annual Meeting of the Special Interest Group on Discourse and Dialogue, p. 292 (2014)

    Google Scholar 

  11. Wang, Z., Lemon, O.: A simple and generic belief tracking mechanism for the dialog state tracking challenge: on the believability of observed information. In: Proceedings of the SIGDIAL 2013 Conference (2013)

    Google Scholar 

  12. Ji, W., Li, M., Lee, C.-H.: A probabilistic framework for representing dialog systems and entropy-based dialog management through dynamic stochastic state evolution. IEEE/ACM Trans. Audio Speech Lang. Process. 23(11), 2026–2035 (2015)

    Google Scholar 

  13. Kim, S., D’Haro, L.F., Banchs, R.E., Williams, J., Henderson, M.: Handbook Dialog State Tracking Challenge 4, vs 3.0 (2015)

    Google Scholar 

  14. Kim, S., D’Haro, L.F., Banchs, R.E., Williams, J., Henderson, M.: The fourth dialog state tracking challenge. In: Proceedings of the 7th International Workshop on Spoken Dialogue Systems (IWSDS) (2016)

    Google Scholar 

  15. Mairesse, F., Gašić, M., Jurčíček, F., Keizer, S., Thomson, B., Yu, K., Young, S.: Spoken language understanding from unaligned data using discriminative classification models. In: Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing, 2009. ICASSP 2009, pp. 4749–4752. IEEE (2009)

    Google Scholar 

  16. Chang, C.-C., Lin, C.-J.: Libsvm: a library for support vector machines. ACM Trans. Intell. Syst. Technol. 2(3), 27 (2011)

    Article  Google Scholar 

  17. Henderson, M., Thomson, B., Williams, J.: The second dialog state tracking challenge. In: Proceedings of the 15th Annual Meeting of the Special Interest Group on Discourse and Dialogue, p. 263 (2014)

    Google Scholar 

  18. Williams, J.D.: Web-style ranking and slu combination for dialog state tracking. In: Proceedings of the 15th Annual Meeting of the Special Interest Group on Discourse and Dialogue, p. 282 (2014)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Multimedia Signal and Intelligent Information Processing Laboratory, Department of Electronic Engineering, Tsinghua University, 100084, Beijing, China

    Miao Li & Ji Wu

Authors
  1. Miao Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ji Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Miao Li .

Editor information

Editors and Affiliations

  1. Institute of Behavioural Sciences, University of Helsinki Institute of Behavioural Sciences, Helsinki, Finland

    Kristiina Jokinen

  2. University of Helsinki , Helsinki, Finland

    Graham Wilcock

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer Science+Business Media Singapore

About this chapter

Cite this chapter

Li, M., Wu, J. (2017). The MSIIP System for Dialog State Tracking Challenge 4. In: Jokinen, K., Wilcock, G. (eds) Dialogues with Social Robots. Lecture Notes in Electrical Engineering, vol 427. Springer, Singapore. https://doi.org/10.1007/978-981-10-2585-3_38

Download citation

  • DOI: https://doi.org/10.1007/978-981-10-2585-3_38

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-10-2584-6

  • Online ISBN: 978-981-10-2585-3

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation