International Conference on Social Informatics

SocInfo 2014: Social Informatics pp 244-258 | Cite as

Can Diversity Improve Credibility of User Review Data?

  • Yoshiyuki Shoji
  • Makoto P. Kato
  • Katsumi Tanaka
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8851)


In this paper, we propose methods to estimate the credibility of reviewers as an individual and as a group, where the credibility is defined as the ability of precisely estimating the quality of items. Our proposed methods are built on two simple assumptions: 1) a reviewer who has reviewed many and diverse items has high credibility, and 2) a group of reviewers is credible if the group consists of many and diverse reviewers. To verify the two assumptions, we conducted experiments with a movie review dataset. The experimental results showed that the diversity of reviewed items and reviewers was effective to estimate the credibility of reviewers and reviewer groups, respectively. Therefore, yes, the diversity does improve the credibility of user review data.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Agrawal, R., Gollapudi, S., Halverson, A., Ieong, S.: Diversifying search results. In: Proceedings of the Second ACM International Conference on Web Search and Data Mining, WSDM 2009, pp. 5–14. ACM, New York (2009)Google Scholar
  2. 2.
    Amatriain, X., Lathia, N., Pujol, J.M., Kwak, H., Oliver, N.: The wisdom of the few: A collaborative filtering approach based on expert opinions from the web. In: Proceedings of the 32nd International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2009, pp. 532–539. ACM, New York (2009)Google Scholar
  3. 3.
    Capannini, G., Nardini, F.M., Perego, R., Silvestri, F.: Efficient diversification of web search results. Proc. VLDB Endow. 4(7), 451–459 (2011)CrossRefGoogle Scholar
  4. 4.
    Carbonell, J., Goldstein, J.: The use of mmr, diversity-based reranking for reordering documents and producing summaries. In: Proceedings of the 21st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 1998, pp. 335–336. ACM, New York (1998)CrossRefGoogle Scholar
  5. 5.
    Liu, X., Croft, W.B., Koll, M.: Finding experts in community-based question-answering services. In: Proceedings of the 14th ACM International Conference on Information and Knowledge Management, CIKM 2005, pp. 315–316 (2005)Google Scholar
  6. 6.
    Magurran, A.E.: Measuring biological diversity. African Journal of Aquatic Science 29(2), 285–286 (2004)CrossRefGoogle Scholar
  7. 7.
    McAuley, J.J., Leskovec, J.: From amateurs to connoisseurs: Modeling the evolution of user expertise through online reviews. In: Proceedings of the 22nd International Conference on World Wide Web, WWW 2013, pp. 897–908. International World Wide Web Conferences Steering Committee, Republic and Canton of Geneva (2013)CrossRefGoogle Scholar
  8. 8.
    Nolan, K.A., Callahan, J.E.: Beachcomber biology: The shannon-weiner species diversity index. In: Proc. Workshop ABLE, vol. 27, pp. 334–338 (2006)Google Scholar
  9. 9.
    Sha, X., Quercia, D., Michiardi, P., Dell’Amico, M.: Spotting trends: The wisdom of the few. In: Proceedings of the Sixth ACM Conference on Recommender Systems, RecSys 2012, pp. 51–58. ACM, New York (2012)CrossRefGoogle Scholar
  10. 10.
    Shoji, Y., Tanaka, K.: Diversity-based HITS: Web page ranking by referrer and referral diversity. In: Jatowt, A., Lim, E.-P., Ding, Y., Miura, A., Tezuka, T., Dias, G., Tanaka, K., Flanagin, A., Dai, B.T. (eds.) SocInfo 2013. LNCS, vol. 8238, pp. 377–390. Springer, Heidelberg (2013)CrossRefGoogle Scholar
  11. 11.
    Stirling, A.: A general framework for analysing diversity in science, technology and society. Journal of the Royal Society Interface 4(15), 707–719 (2007)CrossRefGoogle Scholar
  12. 12.
    Surowiecki, J.: The wisdom of crowds. Anchor (2005)Google Scholar
  13. 13.
    Wang, J., Zhu, J.: Portfolio theory of information retrieval. In: Proceedings of the 32nd international ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2009, pp. 115–122. ACM, New York (2009)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  • Yoshiyuki Shoji
    • 1
  • Makoto P. Kato
    • 1
  • Katsumi Tanaka
    • 1
  1. 1.Department of Social Informatics, Graduate School of InformaticsKyoto UniversityKyotoJapan

Personalised recommendations