In recent years, consumer-to-consumer (C2C) marketplaces such as eBay and Taobao have adopted a component rating system, and run it simultaneously with but independent of a binary rating system. This paper investigates the extent to which binary rating and component rating systems are able to provide consistent signals of sellers’ quality, focusing on the reputation system design under the Chinese context. Using field data from Taobao, we performed canonical correlation analyses and found that the reputation signals of the two systems are generally correlated. As expected, negative and neutral ratings accurately reveal buyer dissatisfaction. Our results, however, show that positive ratings exhibit negative correlations with the three component ratings (i.e., item-as-described, customer service, and on-time delivery), suggesting that large numbers of positive ratings on Taobao may encourage trust in the platform but do not help to choose credible sellers. Our results elucidate the role of cultural difference in explaining the negative relationship in China and provide important implications for the design of reputation systems.
This is a preview of subscription content, access via your institution.
Buy single article
Instant access to the full article PDF.
Tax calculation will be finalised during checkout.
Akerlof, G. (1970). The market for lemons: Quality under uncertainty and the market mechanism. Quarterly Journal of Economics, 84, 488–500.
Aliresearch. (2011). The miracle of taobao in Singles Day. Beijing, China. Alibaba Research Center. Nov 12, 2011. Retrieved Nov 26, 2011, from http://www.aliresearch.com/index.php?m=cms&q=view&id=68267
Ba, S., & Pavlou, P. A. (2002). Evidence of the effect of trust building technology in electronic markets: Price premiums and buyer behaviour. MIS Quarterly, 26(3), 243–268.
Baroudi, J. J., & Orlikowski, W. J. (1989). The problem of statistical power in MIS research. MIS Quarterly, 13(1), 87–106.
Blau, P. M. (1964). Exchange and power in social life. New York: John Wiley & Sons.
China Daily. (2011). Singels’ Day sales push couriers to the limit. by Yu Ran and Shen Jingting, Beijing, China. China Daily. Nov 23, 2011. Retrieved Nov 26, 2011, from http://www.chinadaily.com.cn/bizchina/2011-11/23/content_14147977.htm
CNNIC. (2008). Survey of online retailing market of China in 2008. Beijing, China: China Internet Network Information Center. Retrieved May 20, 2010, from http://research.cnnic.cn/html/1247710466d1051.html
CNNIC. (2009). Survey of online retailing market of China in 2009. Beijing, China: China Internet Network Information Center. Retrieved May 20, 2010, from http://research.cnnic.cn/html/1247710466d1051.html
CNNIC. (2011). Statistical report on the Internet development in China: the 27th Survey. Beijing, China: China Internet Network Information Center. Retrieved February 1, 2011, from http://research.cnnic.cn/html/1295338825d2556.html
Darby, M. R., & Karni, E. (1973). Free competition and the optimal amount of fraud. Journal of Law and Economics, 16, 67–86.
Dellarocas, C. (2003). Efficiency through feedback-contingent fees and rewards in auction marketplaces with adverse selection and moral hazard. Proceedings of the 4th ACM Conference on Electronic Commerce, June 9–12. San Diego, CA, USA.
Dellarocas, C., & Wood, C. A. (2008). The sound of silence in online feedback: Estimating trading risks in the presence of reporting bias. Management Science, 54(3), 460–476.
Dellarocas, C. (2010). Online reputation systems: How to design one that does what you need. Sloan Management Review, 51(3), 33–38.
Dewan, S., & Hsu, V. (2004). Adverse selection in electronic markets: Evidence from online stamp auctions. The Journal of Industrial Economics, 52(4), 497–516.
Festinger, L. (1957). A theory of cognitive dissonance. Stanford, CA: Stanford University Press.
Girard, T., Silverblatt, R., & Korgaonkar, P. (2002). Influence of product class on preference for shopping on the internet. Journal of Computer Mediated Communications, 8(1), 1–35.
Grandon, E. E., & Pearson, J. M. (2004). Electronic commerce adoption: An empirical study of small and medium US businesses. Information Management, 42, 197–216.
Green, P. E., Halbert, M. H., & Robinson, P. J. (1966). Canonical analysis: An exposition and illustrative application. Journal of Marketing Research, 3, 32–39.
Gregg, D. G. (2009). Outline reputation scores: How well are they understood? The Journal of Computer Information Systems, 50(1), 90–97.
Grieger, M. (2003). Electronic marketplaces: A literature review and a call for supply chain management research. European Journal of Operational Research, 144, 280–294.
Hair, J. F., Anderson, R. E., Tatham, R. L., & Black, W. C. (1998). Multivariate data analysis. New Jersey: Prentice-Hall.
Hofstede, G. (1980). Culture’s consequences: Comparing values, behaviours, institutions, and organizations across nations. Thousand Oaks, CA: Sage Publications.
Houser, D., & Wooders, J. (2006). Reputation in auctions: Theory, and evidence from eBay. Journal of Economics and Management Strategy, 15(2), 353–369.
Kahneman, D., & Tversky, A. (1979). Prospect theory: An analysis of decisions under risk. Econometrica, 47, 313–327.
Koh, N. S., Hu, N., & Clemons, E. K. (2010). Do online reviews reflect a product’s true perceived quality? An investigation of online movie reviews across cultures. Electronic Commerce Research and Applications, 9(5), 374–385.
Lambert, Z. V., & Durand, R. M. (1975). Some precautions in using canonical analysis. Journal of Market Research, 12, 468–475.
Li, W., Wu, D., & Xu, H. (2008). Reputation in China’s online auction market: Evidence from Taobao.com. Frontiers of Business Research in China, 2(3), 323–338.
Lucking-Reiley, D. (2000). Auctions on the Internet: What's being auctioned, and how? The Journal of Industrial Economics, 48(3), 227–252.
Lucking-Reiley, D., Bryan, D., Prasad, N., & Reeves, D. (2007). Pennies from eBay: The determinants of price in online auctions. The Journal of Industrial Economics, 55(2), 223–233.
Luo, J., Ba, S., Zhang, H. (2012). The Effectiveness of Online Shopping Characteristics and Well-Designed Websites on Satisfaction. MIS Quarterly (forthcoming).
Mahmood, M. A., & Mann, G. J. (1993). Measuring the organizational impact of information technology investment: An exploratory study. Journal of Management Information Systems, 10(1), 97–122.
McDonald, C. G., & Slawson, V. C. (2002). Reputation in an Internet auction market. Economic Inquiry, 40(4), 633–650.
Melnik, M. I., & Alm, J. (2002). Does a seller’s eCommerce reputation matter? evidence from eBay auctions. The Journal of Industrial Economics, 50(3), 337–350.
Nelson, P. (1970). Information and consumer behavior. Journal of Political Economy, 78(2), 311–329.
Nelson, P. (1974). Advertising as information. Journal of Political Economy, 82(4), 729–754.
Newman, I., & Newman, C. (2000). A discussion of low r-squares: Concerns and uses. Educational Research Quarterly, 24(2), 3–9.
Pavlou, P. A., Liang, H., & Xue, Y. (2007). Understanding and mitigating uncertainty in online exchange relationships: A principal-agent perspective. MIS Quarterly, 31(1), 105–136.
Posselt, T., & Gerstner, E. (2005). Pre-sale vs. post-sale e-satisfaction: Impact on repurchase intention and overall satisfaction. Journal of Interactive Marketing, 19(4), 35–47.
Qu, Z., Zhang, H., & Li, H. (2008). Determinants of online merchant rating: Content analysis of consumer comments about Yahoo merchants. Decision Support Systems, 46, 440–449.
Resnick, P., Kuwabara, K., Zeckhauser, R., & Friedman, E. (2000). Reputation systems: Facilitating trust in the Internet interactions. Communications of the ACM, 43(12), 45–48.
Resnick, P., & Zeckhauser, R. (2002). Trust among strangers in Internet transactions: Empirical analysis of eBay's reputation system. In M. R. Baye (Ed.), The economics of the internet and E-Commerce, volume 11 of advances in applied microeconomics (pp. 127–157). Amsterdam: Elsevier Science.
Spence, M. (1973). Job market signalling. Quarterly Journal of Economics, 87(3), 355–374.
Srite, M., & Karahanna, E. (2006). The influence of national culture on the acceptance of information technologies: An empirical study. MIS Quarterly, 30(3), 679–704.
Standifird, S. S. (2001). Reputation and e-commerce: eBay auctions and the asymmetrical impact of positive and negative ratings. Journal of Management, 27, 279–295.
Stewart, D. K., & Love, W. A. (1968). General canonical correlation index. Psychological Bulletin, 70(5), 160–163.
Sun, B. (2006). Dynamic structural consumer models and current marketing issues. Marketing Science, 25(6), 625–628.
Thorndike, R. M. (1978). Correlational procedures for research. New York: John Wiley & Sons Inc.
Wolfinbarger, M., & Gilly, M. C. (2003). eTailQ: Dimensionalizing, measuring and predicting etail quality. Journal of Retailing, 79(3), 183–198.
Ye, Q., Li, Y., Kiang, M., & Wu, W. (2009). The impact of seller reputation on the performance of online sales: Evidence from TaoBao buy-it-now (BIN) data. ACM SIGMIS Database, 40(1), 12–19.
Zhang, X., & Xue, Z. (2010). A canonical analysis of the relationship between overall rating and component rating in Taobao. Proceedings of the 9 th Wuhan International Conference on E-Business (pp. 643–648). Wuhan, China, May 29–30. Alfred: Alfred University Press.
Zhou, L. A., Zhang, W. Y., Gu, Q. L., & Sheng, Y. (2006). The value of reputation: eBay data based example. Journal of Economics Research (Chinese), 12, 81–124.
This research was supported by the National Natural Science Foundation of China (Grant No.70802049 and Grant No. 70890081), National Social Science Foundation of China (10BGL099), and Scientific Research Foundation for the Returned Overseas Chinese Scholars of the State Education Ministry (by SRF for ROCS in 2011). The authors would like to thank the guest editors and the anonymous reviewers for their value comments on the manuscript. The authors also would like to thank Zhenyi Xue for his work in the basic data processing.
Responsible editor: Xin Luo
About this article
Cite this article
Zhang, X., Luo, J. & Li, Q. Do different reputation systems provide consistent signals of seller quality: a canonical correlation investigation of Chinese C2C marketplaces. Electron Markets 22, 155–168 (2012). https://doi.org/10.1007/s12525-012-0092-4
- Online trust
- Reputation system
- Binary rating system
- Component rating system