World Wide Web

, Volume 12, Issue 1, pp 3–25 | Cite as

Rater Credibility Assessment in Web Services Interactions

  • Zaki MalikEmail author
  • Athman Bouguettaya


We investigate the problem of establishing trust in service-oriented environments. The focus is on providing an infrastructure for evaluating the credibility of raters in a reputation-based framework that would enable trust-based Web services interactions. The techniques we develop aid a service consumer in assigning an appropriate weight to the testimonies of different raters regarding a prospective service provider. The experimental analysis show that the proposed techniques successfully dilute the effects of malicious ratings, thereby facilitating accurate and fair assessment of the providers’ reputations.


reputation credibility quality 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Aberer, K., Despotovic, Z.: Managing trust in a peer-2-peer information system. In: CIKM, pp. 310–317, Atlanta, 5–10 November 2001Google Scholar
  2. 2.
    Aberer, K., Despotovic, Z.: On reputation in game theory—application to online settings. Working Paper (2004)Google Scholar
  3. 3.
    Al-Masri, E., Mahmoud, Q.H.: Discovering the best web service. In: 16th International Conference on World Wide Web (WWW), pp. 1257–1258, Banff, 8–12 May 2007Google Scholar
  4. 4.
    Azzedin, F., Maheswaran, M.: Evolving and managing trust in grid cmputing systems. In: Proc. of the IEEE Canadian Conference on Electrical and Computer Engineering, pp. 1424–1429, Winnipeg, May 2002Google Scholar
  5. 5.
    Benatallah, B., Skogsrud, H., Casati, F.: Trust-Serv: a lightweight trust negotiation service. In: VLDB Demo, Toronto, August 2004Google Scholar
  6. 6.
    Bertino, E., Ferrari, E., Squicciarini, A.C.: Trust-X: a peer-to-peer framework for trust establishment. IEEE Trans. Knowl. Data Eng. 16(7), 827–842 (2004)CrossRefGoogle Scholar
  7. 7.
    Buchegger, S., Le Boudec, J.-Y.: Performance analysis of the CONFIDANT protocol. In: Proc. of the 3rd ACM Intl. Symposium on Mobile Ad Hoc Networking and Computing, pp. 226–236, Lausanne, June 9–11 2002Google Scholar
  8. 8.
    Bouguettaya, A., Ouzzani, M., Medjahed, B., Cameron, J.: Managing government databases. Computer 34(2), 56–64 (2001), FebruaryCrossRefGoogle Scholar
  9. 9.
    Buchegger, S., Le Boudec, J.-Y.: A robust reputation system for p2p and mobile ad-hoc networks. In: Proceedings of the Second Workshop on the Economics of Peer-to-Peer Systems (2004)Google Scholar
  10. 10.
    Buskens, V.: Social networks and the effect of reputation on cooperation. In: Proc. of the 6th Intl. Conf. on Social Dilemmas (1998)Google Scholar
  11. 11.
    Casati, F., Shan, E., Dayal, U., Shan, M.-C.: Business-oriented management of web services. Commun. ACM 46(10), 55–60 (2003)CrossRefGoogle Scholar
  12. 12.
    Damiani, E., De Capitani di Vimercati, S., Paraboschi, S., Samarati, P., Violante, F.: A reputation-based approach for choosing reliable resources in peer-to-peer networks. In: ACM Conference on Computer and Communications Security, pp. 207–216, Washingtion, DC, 18–22 November 2002Google Scholar
  13. 13.
    Dellarocas, C.: Immunizing online reputation reporting systems against unfair ratings and discriminatory behavior. In: 2nd ACM Conference on Electronic Commerce, Minneapolis, 17–20 October 2000Google Scholar
  14. 14.
    Dellarocas, C.: The digitalization of word-of-mouth: promise and challeges of online feedback mechanisms. Manage. Sci. 49, 1407–1424 (2003)CrossRefGoogle Scholar
  15. 15.
    Dewan, P., Dasgupta, P.: Pride: peer-to-peer reputation infrastructure for decentralized environments. In: WWW (Alternate Track Papers & Posters), pp. 480–481, New York, 17–20 May 2004Google Scholar
  16. 16.
    Emekci, F., Sahin, O.D., Agrawal, D., El-Abbadi, A.: A peer-to-peer framework for web service discovery with ranking. In: Intl. Conf. on Web Services (ICWS), San Diego, 6–9 June 2004Google Scholar
  17. 17.
    Falker, J., Kuchar, J.: Analytical and empirical analysis of restricting airspace. In: 4th. USA/Europe Air Traffic Management R&D Seminar, Santa Fe, December 2001Google Scholar
  18. 18.
    Finin, T.W., Joshi, A.: Agents, trust, and information access on the semantic web. ACM SIGMOD Record 31(4), 30–35 (2002)CrossRefGoogle Scholar
  19. 19.
    Giuliano, G.: ARGOS: dynamic composition of web services for goods movement analysis and planning. Technical report, Univ. of Southern California (2003)Google Scholar
  20. 20.
    Houser, D., Wooders, J.: Reputation in auctions: theory, and evidence from eBay. J. Econ. Manage. Strategy 15, 353–369 (2005)CrossRefGoogle Scholar
  21. 21.
    Huberman, B.A., Wu, F.: The Dynamics of Reputations. TR, Hewlett-Packard Laboratories and Stanford University, January (2003)Google Scholar
  22. 22.
    Huynh, T.D., Jennings, N.R., Shadbolt, N.R.: Certified reputation: how an agent can trust a stranger. In: AAMAS ’06: Proceedings of the fifth international joint conference on Autonomous agents and multiagent systems, pp. 1217–1224. ACM, New York (2006)CrossRefGoogle Scholar
  23. 23.
    IBM.: Aglet software development kit. (2000)
  24. 24.
    Jurca, R., Faltings, B.: An incentive compatible reputation mechanism. In: Proc. of the 2003 IEEE Intl. Conf. on E-Commerce, pp. 285–292, Newport Beach, June 2003Google Scholar
  25. 25.
    Kamvar, S.D., Schlosser, M.T., Garcia-Molina, H.: The eigentrust algorithm for reputation management in p2p networks. In: Proceedings of the Twelfth International World Wide Web Conference (WWW), Budapest, 20–24 May 2003Google Scholar
  26. 26.
    Karr, A.F., Sanil, A.P., Banks, D.L.: Data quality: a statistical perspective. Stat. Methodol. 3(2), 137–173 (2006), AprilCrossRefMathSciNetGoogle Scholar
  27. 27.
    Kesler, C.: Experimental games for the design of reputation management systems. IBM Syst. J. 42(3), (2003)Google Scholar
  28. 28.
    Lam, S.K., Riedl, J.: Shilling recommender systems for fun and profit. In: Proc. of the 13th International World Wide Web Conference (WWW), p. 393–402, New York, 17–22 May 2004Google Scholar
  29. 29.
    Li, Z., Wang, S.: The foundation of e-commerce: social reputation system–a comparison between american and china. In: ICEC ’05: Proceedings of the 7th International Conference on Electronic Commerce, pp. 230–232. ACM, New York (2005)CrossRefGoogle Scholar
  30. 30.
    Liu, Y., Yang, Y.R.: Reputation propagation and agreement in mobile ad-hoc networks. In: Proc. of the IEEE Wireless Communication and Networks Conference (WCNC) 2003, New Orleans, March 2003Google Scholar
  31. 31.
    MacQueen, J.B.: Some methods for classification and analysis of multivariate observations. In: Proceedings of 5-th Berkeley Symposium on Mathematical Statistics and Probability, pp. 281–297. University of California Press, Berkeley (1967)Google Scholar
  32. 32.
    Majithia, S., Ali, A.S., Rana, O.F., Walker, D.W.: Reputation-based semantic service discovery. In: Proc. of the 13th IEEE International Workshops on Enabling Technologies: Infrastructures for Collaborative Enterprises (WETICE), pp. 297–302, Modena, 14–16 June 2004Google Scholar
  33. 33.
    Malaga, R.: Web-based reputation management systems: problems and suggested solutions. Electronic Commerce Res. 1(1), 403–417 (2001)zbMATHCrossRefGoogle Scholar
  34. 34.
    Malik, Z., Bouguettaya, A.: RATEWeb: reputation assessment for trust establishment among web services. VLDB J. (2008, in press)Google Scholar
  35. 35.
    Maximilien, E.M., Singh, M.P.: Reputation and endorsement for web services. SIGecom Exchanges, 3(1), 24–31 (2002), DecemberCrossRefGoogle Scholar
  36. 36.
    Maximilien, E.M., Singh, M.P.: A framework and ontology for dynamic web services selection. IEEE Internet Comput. 8(5), 84–93 (2004), September–OctoberCrossRefGoogle Scholar
  37. 37.
    Maximilien, E.M., Singh, M.P.: Toward autonomic web services trust and selection. In: ICSOC 2004: Proceedings of 2nd International Conference on Service Oriented Computing, New York, November 2004Google Scholar
  38. 38.
    Maximilien, E.M., Singh, M.P.: Agent-based trust model involving multiple qualities. In: AAMAS 2005: Proceedings of 4th International Autonomous Agents and Multi Agent Systems, Utrecht, July 2005Google Scholar
  39. 39.
    Maximillien, E.M., Singh, M.P.: Conceptual model of web service reputation. SIGMOD Record, 31(4), 36–41 (2002), DecemberCrossRefGoogle Scholar
  40. 40.
    Medjahed, B., Bouguettaya, A.: Customized delivery of e-government web services. IEEE Intel. Syst. 20(6) (2005), November/DecemberGoogle Scholar
  41. 41.
    Medjahed, B., Bouguettaya, A., Elmagarmid, A.: Composing web services on the semantic web. VLDB J. 12(4) (2003), NovemberGoogle Scholar
  42. 42.
    Medjahed, B., Rezgui, A., Bouguettaya, A., Ouzzani, M.: Infrastructure for E-Government web services. IEEE Internet Comput. 7(1) (2003), January/FebruaryGoogle Scholar
  43. 43.
    Microsoft and Vodafone: Mobile web services technical roadmap. Technical report, Microsoft Corporation and Vodafone Group Services Ltd. (2003)Google Scholar
  44. 44.
    Page, L., Brin, S., Motwani, R., Winograd, T.: The PageRank citation ranking: bringing order to the web. Technical report, Stanford Digital Library Technologies Project (1998)Google Scholar
  45. 45.
    Papazoglou, M.P.: Web services and business transactions. World Wide Web: Internet and Web Inf. Syst. 6(1), 49–91 (2003), MarchCrossRefGoogle Scholar
  46. 46.
    Papazoglou, M.P., Georgakopoulos, D.: Serive-oriented computing. Commun. ACM 46(10), 25–65 (2003)CrossRefGoogle Scholar
  47. 47.
    Ran, S.: A model for web services discovery with qos. SIGecom Exch. 4(1), 1–10 (2003)CrossRefGoogle Scholar
  48. 48.
    Resnick, P., Zeckhauser, R.: Trust among strangers in internet transactions: empirical analysis of eBay’s reputation system. Advances in Applied Microeconomics, vol. 11. Elsevier, Amsterdam (2002)Google Scholar
  49. 49.
    Resnick, P., Zeckhauser, R., Friedman, E., Kuwabara, K.: Reputation systems. Commun. ACM 43(12) (2000), DecemberGoogle Scholar
  50. 50.
    Rocha, B.G., Almeida, V., Guedes, D.: Increasing qos in selfish overlay networks. IEEE Internet Comput. 10(3), 24–31 (2006), May–JuneCrossRefGoogle Scholar
  51. 51.
    Sabater, J., Sierra, C.: Reputation and social network analysis in multi-agent systems. In: Proc. of the first Intl. Joint Conf. on Autonomous Agents and Multiagent Systems, pp. 475–482, Bologna, 14–18 July 2003Google Scholar
  52. 52.
    Simunic, D.A.: Theory is Too Important to be Left to the Theorists. Canadian Academic Accounting Association, Mississauga (2008)Google Scholar
  53. 53.
    Sonnek, J.D., Weissman, J.B.: A quantitative comparison of reputation systems in the grid. In: The 6th IEEE/ACM International Workshop on Grid Computing, pp. 242–249, Seattle, November 2005Google Scholar
  54. 54.
    Sundaresan, N.: Online trust and reputation systems. In: EC ’07: Proceedings of the 8th ACM Conference on Electronic Commerce, pp. 366–367. ACM, New York (2007)CrossRefGoogle Scholar
  55. 55.
    Taiani, F., Hiltunen, M., Schlichting, R.: The impact of web service integration on grid performance. In: HPDC-14: Proceedings of the 14th IEEE International Symposium on High Performance Distributed Computing, vol. 14, pp. 24–27. IEEE, Piscataway (2005)Google Scholar
  56. 56.
    Tian, M., Gramm, A., Ritter, H., Schiller, J.: Efficient selection and monitoring of qos-aware web services with the ws-qos framework. In: International Conference on Web Intelligence, pp. 152–158. IEEE Computer Society, Washington, DC (2004)CrossRefGoogle Scholar
  57. 57.
    Udupi, Y.B., Singh, M.P.: Information sharing among autonomous agents in referral networks systems. In: 6th International Workshop on Agents and Peer-to-Peer Computing, Honolulu, May 2007Google Scholar
  58. 58.
    Vu, L.-H., Hauswirth, M., Aberer, K.: QoS-based service selection and ranking with trust and reputation management. In: 13th International Conference on Cooperative Information Systems (CoopIS 2005), Agia Napa, 31 October–4 November 2005Google Scholar
  59. 59.
    Walsh, K., Sirer, E.G.: Fighting peer-to-peer spam and decoys with object reputation. In: P2PECON ’05: Proceedings of the 2005 ACM SIGCOMM Workshop on Economics of Peer-to-Peer Systems, pp. 138–143. ACM, New York (2005)CrossRefGoogle Scholar
  60. 60.
    Wang, Y., Vassileva, J.: Trust and reputation model in peer-to-peer networks. In: Proc. of the Third International Conference on Peer-to-Peer Computing, pp. 150–158, Linköping, September 2003Google Scholar
  61. 61.
    Weng, J., Miao, C., Goh, A.: Protecting online rating systems from unfair ratings. Trust Priv. Secur. Digit. Bus. 3592, 50–59 (2005), AugustGoogle Scholar
  62. 62.
    Whitby, A., Jsang, A., Indulska, J.: Filtering out unfair ratings in bayesian reputation systems. Icfain J. Manage. Res. 4(2), 48–64 (2005), FebruaryGoogle Scholar
  63. 63.
    Wickramage, N., Weerawarana, S.: A benchmark for web service frameworks. In: SCC ’05: Proceedings of the 2005 IEEE International Conference on Services Computing, pp. 233–242. IEEE Computer Society, Washington, DC (2005)CrossRefGoogle Scholar
  64. 64.
    W3C WS-Policy: Web services policy framework. (2007)
  65. 65.
    Xiong, L., Liu, L.: PeerTrust: supporting reputation-based trust for peer-to-peer electronic communities. IEEE Trans. Knowl. Data Eng. (TKDE) 16(7), 843–857 (2004), JulyCrossRefGoogle Scholar
  66. 66.
    Yang, X., Bouguettaya, A., Medjahed, B., Long, H., He, W.: Organizing and accessing web services on air. IEEE Trans. Syst. Man Cybern. Part A Syst. Humans, 33(6) (2003), NovemberGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC 2008

Authors and Affiliations

  1. 1.Department of Computer ScienceVirginia TechBlacksburgUSA
  2. 2.CSIRO ICT CenterCanberraAustralia

Personalised recommendations