Comparison of Text Forum Summarization Depending on Query Type for Text Forums

  • Vladislav Grozin
  • Kseniya Buraya
  • Natalia Gusarova
Conference paper
Part of the Lecture Notes in Electrical Engineering book series (LNEE, volume 387)

Abstract

Various approaches are developed for evaluation of query-oriented text summarization. However, for text forums this procedure is not well-defined, and standard approaches are not suitable. Evaluation of query-oriented text summarization greatly depends on the query type. We compare two typical scenarios of search of professionally significant information on Internet forums. Our subject of interest is the similarities and differences between relevance-oriented queries and usefulness-oriented queries. To compare these query types we have collected dataset, extracted textual, structural features and social graph features, constructed different ranking models, used suitable quality measure (NDCG), and applied feature selection techniques to investigate causes of differences. We have found out that these query types are very different by their nature, have weak correlation. Distinct model types and features should be used in order to create an efficient information retrieval system for each query type.

References

  1. 1.
    Nenkova A, McKeown K (2012) A survey of text summarization techniques. Min Text Data Springer 43–76Google Scholar
  2. 2.
    Elbedweihy Khadija M, Wrigley Stuart N, Clough Paul, Ciravegna Fabio (2015) An overview of semantic search evaluation initiatives. Web Semant Sci Serv Agents World Wide Web 30:82–105CrossRefGoogle Scholar
  3. 3.
    Bhatia S, Mitra P (2010) Adopting inference networks for online thread retrieval. In: Proceedings of the twenty-fourth AAAI conference on artificial intelligence. Atlanta, Georgia, pp 1300–1305Google Scholar
  4. 4.
    Saracevic T, Kantor P, Chamis AY, Trivison D (1988) A study of information seeking and retrieving. I Backgr Methodol J Am Soc Inf Sci 39:161–176CrossRefGoogle Scholar
  5. 5.
    Ren Zh, Ma J, Wang Sh, Liu Y (2011) Summarizing web forum threads based on a latent topic propagation process. In: CIKM11, October 2428. Glasgow, ScotlandGoogle Scholar
  6. 6.
    Grozin VA, Gusarova NF, Dobrenko NV (2015) Feature selection for language-independent text forum summarization. In: International conference on knowledge engineering and semantic web, pp 63–71Google Scholar
  7. 7.
    Grozin VA, Dobrenko NV, Gusarova NF, Ning T (2015) The application of machine learning methods for analysis of text forums for creating learning objects. In: Computational linguistics and intellectual technologies, vol 1, pp 199–209Google Scholar
  8. 8.
    Tang J, Yao L, Chen D (2009) Multi-topic based query-oriented summarization. In: Society for industrial and applied mathematics—9th SIAM international conference on data mining 2009, Proceedings in applied mathematics 3, pp 1141–1152Google Scholar
  9. 9.
    Wang Jun-ze, Yan Zheng, Yang Laurence T (2015) Ben-xiong Huang An approach to rank reviews by fusing and mining opinions based on review pertinence. Inf Fusion 23:3–15CrossRefGoogle Scholar
  10. 10.
    Oufaida Houda, Nouali Omar, Blache Philippe (2014) Minimum redundancy and maximum relevance for single and multi-document Arabic text summarization. J King Saud Univ Comput Inf Sci 26:450–461Google Scholar
  11. 11.
    Petrelli Daniela (2008) On the role of user-centred evaluation in the advancement of interactive information retrieval. Inf Process Manage 44:22–38CrossRefGoogle Scholar
  12. 12.
    Borgatti Steve (2005) Centrality and network flow. Soc Netw 27(1):55–71CrossRefGoogle Scholar
  13. 13.
    Friedman J (2001) Greedy boosting approximation: a gradient boosting machine. Ann Stat 29:1189–1232Google Scholar
  14. 14.
    Croft WB (2015) Combining approaches to information retrieval. In: Croft WB (ed) Advances in information retrieval. Kluwer Academic Publishers, BostonGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2016

Authors and Affiliations

  • Vladislav Grozin
    • 1
  • Kseniya Buraya
    • 1
  • Natalia Gusarova
    • 1
  1. 1.Mechanics and OpticsNational Research University of Information TechnologiesSaint-PetersburgRussia

Personalised recommendations