Skip to main content
SpringerLink
Log in

An Evaluation of Diversification Techniques

  • Conference paper
  • First Online:
Database and Expert Systems Applications (Globe 2015, DEXA 2015)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 9262))

Abstract

Diversification is a method of improving user satisfaction by increasing the variety of information shown to user. Due to the lack of a precise definition of information variety, many diversification techniques have been proposed. These techniques, however, have been rarely compared and analyzed under the same setting, rendering a ‘right’ choice for a particular application very difficult. Addressing this problem, this paper presents a benchmark that offers a comprehensive empirical study on the performance comparison of diversification. Specifically, we integrate several state-of-the-art diversification algorithms in a comparable manner, and measure distinct characteristics of these algorithms with various settings. We then provide in-depth analysis of the benchmark results, obtained by using both real data and synthetic data. We believe that the findings from the benchmark will serve as a practical guideline for potential applications.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://code.google.com/p/diversity-benchmark.

  2. 2.

    https://code.google.com/p/diversity-benchmark.

  3. 3.

    https://code.google.com/p/diversity-benchmark.

  4. 4.

    https://code.google.com/p/diversity-benchmark.

  5. 5.

    https://code.google.com/p/diversity-benchmark.

References

  1. http://boston.lti.cs.cmu.edu/clueweb12/TRECcrowdsourcing2013/

  2. Agrawal, R., et al.: Diversifying search results. In: WSDM, pp. 5–14 (2009)

    Google Scholar 

  3. Boriah, S., et al.: Similarity measures for categorical data: a comparative evaluation. In: SIAM, pp. 243–254 (2008)

    Google Scholar 

  4. Braschler, M.: CLEF 2001 - overview of results. In: Peters, C., Braschler, M., Gonzalo, J., Kluck, M. (eds.) CLEF 2001. LNCS, vol. 2406, p. 9. Springer, Heidelberg (2002)

    Chapter  Google Scholar 

  5. Carbonell, J., et al.: The use of MMR, diversity-based reranking for reordering documents and producing summaries. In: SIGIR, pp. 335–336 (1998)

    Google Scholar 

  6. Chandar, P., et al.: Preference based evaluation measures for novelty and diversity. In: SIGIR, pp. 413–422 (2013)

    Google Scholar 

  7. Clarke, C.L., et al.: Overview of the trec 2009 web track. Technical report, DTIC Document (2009)

    Google Scholar 

  8. Clarke, C.L., et al.: Novelty and diversity in information retrieval evaluation. In: SIGIR, pp. 659–666 (2008)

    Google Scholar 

  9. Deng, T., et al.: On the complexity of query result diversification. Proc. VLDB Endowment 6, 577–588 (2013)

    Article  Google Scholar 

  10. Drosou, M., et al.: Search result diversification. ACM SIGMOD Rec. 39, 41–47 (2010)

    Article  MATH  Google Scholar 

  11. Drosou, M., et al.: Disc diversity: result diversification based on dissimilarity and coverage. Proc. VLDB Endowment 6, 13–24 (2012)

    Article  Google Scholar 

  12. Gabrilovich, E., et al.: Newsjunkie: providing personalized newsfeeds via analysis of information novelty. In: WWW, pp. 482–490 (2004)

    Google Scholar 

  13. Gollapudi, S., et al.: An axiomatic approach for result diversification. In: WWW, pp. 381–390 (2009)

    Google Scholar 

  14. Hasan, M., et al.: User effort minimization through adaptive diversification. In: KDD, pp. 203–212 (2014)

    Google Scholar 

  15. Jain, A., Sarda, P., Haritsa, J.R.: Providing diversity in k-nearest neighbor query results. In: Dai, H., Srikant, R., Zhang, C. (eds.) PAKDD 2004. LNCS (LNAI), vol. 3056, pp. 404–413. Springer, Heidelberg (2004)

    Chapter  Google Scholar 

  16. Kando, N., et al.: Overview of IR tasks at the first NTCIR workshop. In: NTCIR, pp. 11–44 (1999)

    Google Scholar 

  17. Küçüktunç, O., et al.: Diversified recommendation on graphs: pitfalls, measures, and algorithms. In: WWW, pp. 715–726 (2013)

    Google Scholar 

  18. Rafiei, D., et al.: Diversifying web search results, pp. 781–790. In: WWW 2010 (2010)

    Google Scholar 

  19. Skoutas, D., et al.: Tag clouds revisited. In: CIKM, pp. 221–230 (2011)

    Google Scholar 

  20. Tong, H., et al.: Diversified ranking on large graphs: an optimization viewpoint. In: KDD, pp. 1028–1036 (2011)

    Google Scholar 

  21. Vaughan, L., et al.: Search engine coverage bias: evidence and possible causes. Inf. Process. Manag. 40, 693–707 (2004)

    Article  Google Scholar 

  22. Verheij, A., et al.: A comparison study for novelty control mechanisms applied to web news stories. In: WI, pp. 431–436 (2012)

    Google Scholar 

  23. Vieira, M.R., et al.: On query result diversification. In: ICDE, pp. 1163–1174 (2011)

    Google Scholar 

  24. Yu, C., et al.: It takes variety to make a world: diversification in recommender systems. In: EDBT, pp. 368–378 (2009)

    Google Scholar 

  25. Zhai, C.X., et al.: Beyond independent relevance: methods and evaluation metrics for subtopic retrieval. In: SIGIR, pp. 10–17 (2003)

    Google Scholar 

  26. Zhang, B., Li, H., Liu, Y., Ji, L., Xi, W., Fan, W., Chen, Z., Ma, W.Y.: Improving web search results using affinity graph. In: SIGIR, pp. 504–511 (2005)

    Google Scholar 

  27. Zhu, X., et al.: Improving diversity in ranking using absorbing random walks. In: NAACL, pp. 97–104 (2007)

    Google Scholar 

  28. Ziegler, C.N., et al.: Improving recommendation lists through topic diversification. In: WWW, pp. 22–32 (2005)

    Google Scholar 

Download references

Acknowledgment

The research has received funding from the ScienceWise project.

Author information

Authors and Affiliations

  1. École Polytechnique Fédérale de Lausanne, Lausanne, Switzerland

    Duong Chi Thang, Nguyen Thanh Tam, Nguyen Quoc Viet Hung & Karl Aberer

Authors
  1. Duong Chi Thang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Nguyen Thanh Tam
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Nguyen Quoc Viet Hung
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Karl Aberer
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Nguyen Quoc Viet Hung .

Editor information

Editors and Affiliations

  1. Hewlett-Packard Enterprise, Sunnyvale, California, USA

    Qiming Chen

  2. Paul Sabatier University, Toulouse, France

    Abdelkader Hameurlain

  3. Blaise Pascal University, Aubiere, France

    Farouk Toumani

  4. University of Linz, Linz, Austria

    Roland Wagner

  5. Universidad Politécnica de Valencia, Valencia, Spain

    Hendrik Decker

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this paper

Cite this paper

Thang, D.C., Tam, N.T., Hung, N.Q.V., Aberer, K. (2015). An Evaluation of Diversification Techniques. In: Chen, Q., Hameurlain, A., Toumani, F., Wagner, R., Decker, H. (eds) Database and Expert Systems Applications. Globe DEXA 2015 2015. Lecture Notes in Computer Science(), vol 9262. Springer, Cham. https://doi.org/10.1007/978-3-319-22852-5_19

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-22852-5_19

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-22851-8

  • Online ISBN: 978-3-319-22852-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation