Abstract
Efficient statistical approaches have been recently proposed for natural language understanding in the context of dialogue systems. However, these approaches are trained on data semantically annotated at the segmental level, which increases the production cost of these resources. This kind of semantic annotation implies both to determine the concepts in a sentence and to link them to their corresponding word segments. In this paper, we propose a two-step automatic method for semantic annotation. The first step is an implementation of the latent Dirichlet allocation aiming at discovering concepts in a dialogue corpus. Then this knowledge is used as a bootstrap to infer automatically a segmentation of a word sequence into concepts using either integer linear optimisation or stochastic word alignment models (IBM models). The relation between automatically-derived and manually-defined task-dependent concepts is evaluated on a spoken dialogue task with a reference annotation.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Blei, D.M., Ng, A.Y., Jordan, M.I.: Latent dirichlet allocation. The Journal of Machine Learning Research 3, 993–1022 (2003)
Bonneau-Maynard, H., Rosset, S., Ayache, C., Kuhn, A., Mostefa, D.: Semantic annotation of the french media dialog corpus. In: Proceedings of the ISCA 9th European Conference on Speech Communication and Technology (2005)
Brown, P.F., Della Pietra, S.A., Della Pietra, V.J., Mercer, R.L.: The mathematics of statistical machine translation: Parameter estimation. Computational Linguistics 19(2), 263–311 (1993)
Celikyilmaz, A., Hakkani-Tur, D., Tur, G.: LDA based similarity modeling for question answering. In: Proceedings of the NAACL HLT 2010 Workshop on Semantic Search (2010)
Chen, D.-S., Batson, R., Dang, Y.: Applied Integer Programming: Modeling and Solution. Wiley (2010)
Hahn, S., Dinarelli, M., Raymond, C., Lef‘evre, F., Lehnen, P., De Mori, R., Moschitti, A., Hermann Ney, H., Riccardi, G.: Comparing stochastic approaches to spoken language understanding in multiple languages. IEEE Transactions on Audio, Speech and Language Processing 19(6), 1569–1583 (2010)
Huet, S., Lefèvre, F.: Unsupervised alignment for segmental-based language understanding. In: Proceedings of the EMNLP 1st Workshop on Unsupervised Learning in NLP, UNSUP (2011)
Iosif, E., Tegos, A., Pangos, A., Fosler-Lussier, E., Potamianos, A.: Unsupervised combination of metrics for semantic class induction. In: Proceedings of the IEEE/ACL Spoken Language Technology Workshop (2006)
Koehn, P., Hoang, H., Birch, A., Callison-Burch, C., Federico, M., Bertoldi, N., Cowan, B., Shen, W., Moran, C., Zens, R., Dyer, C., Bojar, O., Constantin, A., Herbst, E.: Moses: Open source toolkit for statistical machine translation. In: Proceedings of ACL, Companion Volume (2007)
Lefèvre, F.: Dynamic bayesian networks and discriminative classifiers for multi-stage semantic interpretation. In: Proceedings of the IEEE International Conference on Audio, Signal and Speech Processing (2007)
Mairesse, F., Gašić, M., Jurčíček, F., Keizer, S., Thomson, B., Yu, K., Young, S.: Spoken language understanding from unaligned data using discriminative classification models. In: Proceedings of the IEEE International Conference on Audio, Signal and Speech Processing (2009)
Meurs, M.-J., Lefèvre, F., de Mori, R.: Spoken language interpretation: On the use of dynamic bayesian networks for semantic composition. In: Proceedings of the IEEE International Conference on Audio, Signal and Speech Processing (2009)
Och, F., Ney, H.: A systematic comparison of various statistical alignment models. Computational Linguistics 29(1), 19–51 (2003)
Pargellis, A., Fosler-Lussier, E., Potamianos, A., Lee, C.: Metrics for measuring domain independence of semantic classes. In: Proceedings of the 7th ISCA European Conference on Speech Communication and Technology (2001)
Phan, X., Nguyen, L., Horiguchi, S.: Learning to classify short and sparse text & web with hidden topics from large-scale data collections. In: Proceeding of the 17th ACM International Conference on World Wide Web (2008)
ReVelle, C.S., Eiselt, H.A.: Location analysis: A synthesis and survey. European Journal of Operational Research 165(1), 1–19 (2005)
Siu, K., Meng, H.: Semi-automatic acquisition of domain-specific semantic structures. In: Proceedings of the ISCA 6th European Conference on Speech Communication and Technology (1999)
Tam, Y., Schultz, T.: Unsupervised language model adaptation using latent semantic marginals. In: Proceedings of ISCA INTERSPEECH (2006)
Vogel, S., Ney, H., Tillmann, C.: HMM-based word alignment in statistical translation. In: Proceedings of COLING (1996)
Ward, W.: Understanding spontaneous speech. In: Proceedings of the IEEE International Conference on Audio, Signal and Speech Processing (1991)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Camelin, N., Detienne, B., Huet, S., Quadri, D., Lefèvre, F. (2013). Concept Discovery and Automatic Semantic Annotation for Language Understanding in an Information-Query Dialogue System Using Latent Dirichlet Allocation and Segmental Methods. In: Fred, A., Dietz, J.L.G., Liu, K., Filipe, J. (eds) Knowledge Discovery, Knowledge Engineering and Knowledge Management. IC3K 2011. Communications in Computer and Information Science, vol 348. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-37186-8_3
Download citation
DOI: https://doi.org/10.1007/978-3-642-37186-8_3
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-37185-1
Online ISBN: 978-3-642-37186-8
eBook Packages: Computer ScienceComputer Science (R0)