Abstract
The traditional sequence-to-sequence model generates responses that are smooth but empty in their content. Background-based dialogue is one solution that uses the context’s unstructured knowledge to generate informative responses. The key point of background-based dialogue is knowledge extraction, but some conversations have poor performance in knowledge selection due to insufficient information. At the same time, to improve the satisfaction of the responses, this paper can enhance the amount of conversational knowledge while allowing the model to carry some emotional awareness by selecting external knowledge sources with emotional information. In this paper, we introduce the CEC model, which utilizes graph attention and a double-matching matrix for the selection of external and background knowledge. The generation process is conducted within each decoding step, considering the selected knowledge’s content. We conduct experiments on the Holl-E dataset. According to the experimental results, our model CEC outperforms the previous model in terms of performance.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Abro, W.A., Aicher, A., Rach, N., Ultes, S., Minker, W., Qi, G.: Natural language understanding for argumentative dialogue systems in the opinion building domain. Knowl.-Based Syst. 242, 108318 (2022)
Lecun, Y., Bengio, Y., Hinton, G.: Deep learning. Nature 521(7553), 436–444 (2015)
Xu, M., Zeng, B., Yang, H., Chi, J., Chen, J., Liu, H.: Combining dynamic local context focus and dependency cluster attention for aspect-level sentiment classification. Neurocomputing 478, 49–69 (2022)
Ghazvininejad, M., et al.: A knowledge-grounded neural conversation model. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 32 (2018)
Zhong, P., Wang, D., Li, P., Zhang, C., Wang, H., Miao, C.: CARE: commonsense-aware emotional response generation with latent concepts. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 35, pp. 14577–14585 (2021)
Huang, L., Wu, L., Wang, L.: Knowledge graph-augmented abstractive summarization with semantic-driven cloze reward. arXiv preprint arXiv:2005.01159 (2020)
Guan, J., Wang, Y., Huang, M.: Story ending generation with incremental encoding and commonsense knowledge. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 33, pp. 6473–6480 (2019)
Zhou, K., Prabhumoye, S., Black, A.W.: A dataset for document grounded conversations. arXiv preprint arXiv:1809.07358 (2018)
Zhong, P., Wang, D., Miao, C.: Knowledge-enriched transformer for emotion detection in textual conversations. arXiv preprint arXiv:1909.10681 (2019)
Young, T., Cambria, E., Chaturvedi, I., Zhou, H., Biswas, S., Huang, M.: Augmenting end-to-end dialogue systems with commonsense knowledge. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 32 (2018)
Liu, S., et al.: Towards emotional support dialog systems. arXiv preprint arXiv:2106.01144 (2021)
Wang, L., et al.: CASS: towards building a social-support chatbot for online health community. Proc. ACM Hum. Comput. Interact. 5(CSCW1), 1–31 (2021)
Wu, S., Wang, M., Li, Y., Zhang, D., Wu, Z.: Improving the applicability of knowledge-enhanced dialogue generation systems by using heterogeneous knowledge from multiple sources. In: Proceedings of the Fifteenth ACM International Conference on WEB Search and Data Mining, pp. 1149–1157 (2022)
Wu, S., Li, Y., Wang, M., Zhang, D., Zhou, Y., Wu, Z.: More is better: enhancing open-domain dialogue generation via multi-source heterogeneous knowledge. In: Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, pp. 2286–2300 (2021)
Bai, J., Yang, Z., Liang, X., Wang, W., Li, Z.: Learning to copy coherent knowledge for response generation. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 35, pp. 12535–12543 (2021)
Moghe, N., Arora, S., Banerjee, S., Khapra, M.M.: Towards exploiting background knowledge for building conversation systems. arXiv preprint arXiv:1809.08205 (2018)
Seo, M., Kembhavi, A., Farhadi, A., Hajishirzi, H.: Bidirectional attention flow for machine comprehension. arXiv preprint arXiv:1611.01603 (2016)
Zhang, Y., Ren, P., de Rijke, M.: Improving background based conversation with context-aware knowledge pre-selection. arXiv preprint arXiv:1906.06685 (2019)
Meng, C., Ren, P., Chen, Z., Monz, C., Ma, J., de Rijke, M.: RefNet: a reference-aware network for background based conversation. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 34, pp. 8496–8503 (2020)
Ren, P., Chen, Z., Monz, C., Ma, J., de Rijke, M.: Thinking globally, acting locally: distantly supervised global-to-local knowledge selection for background based conversation. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 34, pp. 8697–8704 (2020)
Liu, Z., Niu, Z.Y., Wu, H., Wang, H.: Knowledge aware conversation generation with explainable reasoning over augmented graphs. arXiv preprint arXiv:1903.10245 (2019)
Lian, R., Xie, M., Wang, F., Peng, J., Wu, H.: Learning to select knowledge for response generation in dialog systems. arXiv preprint arXiv:1902.04911 (2019)
Kim, B., Ahn, J., Kim, G.: Sequential latent knowledge selection for knowledge-grounded dialogue. arXiv preprint arXiv:2002.07510 (2020)
Meng, C., et al.: DukeNet: a dual knowledge interaction network for knowledge-grounded conversation. In: Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 1151–1160 (2020)
Meng, C., Ren, P., Chen, Z., Ren, Z., Xi, T., Rijke, M.D.: Initiative-aware self-supervised learning for knowledge-grounded conversations. In: Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 522–532 (2021)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Wang, H., Ye, H., Li, J. (2024). Integrating Background and General Knowledge for Dialogue Generation. In: Zhang, M., Xu, B., Hu, F., Lin, J., Song, X., Lu, Z. (eds) Computer Applications. CCF NCCA 2023. Communications in Computer and Information Science, vol 1959. Springer, Singapore. https://doi.org/10.1007/978-981-99-8764-1_10
Download citation
DOI: https://doi.org/10.1007/978-981-99-8764-1_10
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-99-8763-4
Online ISBN: 978-981-99-8764-1
eBook Packages: Computer ScienceComputer Science (R0)