Overview of the NLPCC 2018 Shared Task: Multi-turn Human-Computer Conversations

  • Juntao Li
  • Rui YanEmail author
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11109)


In this paper, we give an overview of multi-turn human-computer conversations at NLPCC 2018 shared task. This task consists of two sub-tasks: conversation generation and retrieval with given context. Data-sets for both training and testing are collected from Weibo, where there are 5 million conversation sessions for training and 40,000 non-overlapping conversation sessions for evaluating. Details of the shared task, evaluation metric, and submitted models will be given successively.


Multi-turn conversation Conversation generation Conversation retrieval Sequence matching 


  1. 1.
    Sutskever, I., Vinyals, O., Le, Q.V.: Sequence to sequence learning with neural networks. In: Advances in Neural Information Processing Systems, pp. 3104–3112 (2014)Google Scholar
  2. 2.
    Vinyals, O., Le, Q.V.: A neural conversational model. arXiv preprint arXiv:1506.05869 (2015)
  3. 3.
    Sordoni, A., et al.: A neural network approach to context-sensitive generation of conversational responses. In: HLT-NAACL, pp. 196–205 (2015)Google Scholar
  4. 4.
    Tian, Z., Yan, R., Mou, L., Song, Y., Feng, Y., Zhao, D.: How to make context more useful? an empirical study on context-aware neural conversational models. In: ACL, vol. 2, pp. 231–236 (2017)Google Scholar
  5. 5.
    Serban, I.V., Sordoni, A., Bengio, Y., Courville, A.C., Pineau, J.: Building end-to-end dialogue systems using generative hierarchical neural network models. In: AAAI, pp. 3776–3784 (2016)Google Scholar
  6. 6.
    Serban, I.V. et al.: A hierarchical latent variable encoder-decoder model for generating dialogues. In: AAAI, pp. 3295–3301 (2017)Google Scholar
  7. 7.
    Xing, C., et al.: Topic aware neural response generation. In: AAAI, pp. 3351–3357 (2017)Google Scholar
  8. 8.
    Li, J., Galley, M., Brockett, C., Gao, J., Dolan, B.: A diversity-promoting objective function for neural conversation models. In: HLT-NAACL, pp. 110–119 (2016)Google Scholar
  9. 9.
    Zhao, T., Zhao, R., Eskenazi, M.: Learning discourse-level diversity for neural dialog models using conditional variational autoencoders. In: ACL, vol. 1, pp. 654–664 (2017)Google Scholar
  10. 10.
    Li, J., Galley, M., Brockett, C., Spithourakis, G.P., Gao, J., Dolan, W.B.: A persona-based neural conversation model. In: ACL, vol. 1, pp. 994–1023 (2016)Google Scholar
  11. 11.
    Yan, R., Song, Y., Wu, H.: Learning to respond with deep neural networks for retrieval-based human-computer conversation system. In: SIGIR, pp. 55–64 (2016)Google Scholar
  12. 12.
    Wu, Y., et al.: Sequential matching network: a new architecture for multi-turn response selection in retrieval-based chatbots. In: ACL, vol. 1, pp. 496–505 (2017)Google Scholar
  13. 13.
    Papineni, K., Roukos, S., Ward, T., et al.: IBM research report bleu: a method for automatic evaluation of machine translation. In: ACL, vol. 2, pp. 311–318 (2002)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2018

Authors and Affiliations

  1. 1.Institute of Computer Science and Technology (ICST)Peking UniversityBeijingChina
  2. 2.Institute of Big Data ResearchPeking UniversityBeijingChina

Personalised recommendations