Can Diversity Improve Credibility of User Review Data?
In this paper, we propose methods to estimate the credibility of reviewers as an individual and as a group, where the credibility is defined as the ability of precisely estimating the quality of items. Our proposed methods are built on two simple assumptions: 1) a reviewer who has reviewed many and diverse items has high credibility, and 2) a group of reviewers is credible if the group consists of many and diverse reviewers. To verify the two assumptions, we conducted experiments with a movie review dataset. The experimental results showed that the diversity of reviewed items and reviewers was effective to estimate the credibility of reviewers and reviewer groups, respectively. Therefore, yes, the diversity does improve the credibility of user review data.
Unable to display preview. Download preview PDF.
- 1.Agrawal, R., Gollapudi, S., Halverson, A., Ieong, S.: Diversifying search results. In: Proceedings of the Second ACM International Conference on Web Search and Data Mining, WSDM 2009, pp. 5–14. ACM, New York (2009)Google Scholar
- 2.Amatriain, X., Lathia, N., Pujol, J.M., Kwak, H., Oliver, N.: The wisdom of the few: A collaborative filtering approach based on expert opinions from the web. In: Proceedings of the 32nd International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2009, pp. 532–539. ACM, New York (2009)Google Scholar
- 4.Carbonell, J., Goldstein, J.: The use of mmr, diversity-based reranking for reordering documents and producing summaries. In: Proceedings of the 21st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 1998, pp. 335–336. ACM, New York (1998)CrossRefGoogle Scholar
- 5.Liu, X., Croft, W.B., Koll, M.: Finding experts in community-based question-answering services. In: Proceedings of the 14th ACM International Conference on Information and Knowledge Management, CIKM 2005, pp. 315–316 (2005)Google Scholar
- 7.McAuley, J.J., Leskovec, J.: From amateurs to connoisseurs: Modeling the evolution of user expertise through online reviews. In: Proceedings of the 22nd International Conference on World Wide Web, WWW 2013, pp. 897–908. International World Wide Web Conferences Steering Committee, Republic and Canton of Geneva (2013)CrossRefGoogle Scholar
- 8.Nolan, K.A., Callahan, J.E.: Beachcomber biology: The shannon-weiner species diversity index. In: Proc. Workshop ABLE, vol. 27, pp. 334–338 (2006)Google Scholar
- 10.Shoji, Y., Tanaka, K.: Diversity-based HITS: Web page ranking by referrer and referral diversity. In: Jatowt, A., Lim, E.-P., Ding, Y., Miura, A., Tezuka, T., Dias, G., Tanaka, K., Flanagin, A., Dai, B.T. (eds.) SocInfo 2013. LNCS, vol. 8238, pp. 377–390. Springer, Heidelberg (2013)CrossRefGoogle Scholar
- 12.Surowiecki, J.: The wisdom of crowds. Anchor (2005)Google Scholar
- 13.Wang, J., Zhu, J.: Portfolio theory of information retrieval. In: Proceedings of the 32nd international ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2009, pp. 115–122. ACM, New York (2009)Google Scholar