The Peer Sampling Service: Experimental Evaluation of Unstructured Gossip-Based Implementations

  • Márk Jelasity
  • Rachid Guerraoui
  • Anne-Marie Kermarrec
  • Maarten van Steen
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3231)

Abstract

In recent years, the gossip-based communication model in large-scale distributed systems has become a general paradigm with important applications which include information dissemination, aggregation, overlay topology management and synchronization. At the heart of all of these protocols lies a fundamental distributed abstraction: the peer sampling service. In short, the aim of this service is to provide every node with peers to exchange information with. Analytical studies reveal a high reliability and efficiency of gossip-based protocols, under the (often implicit) assumption that the peers to send gossip messages to are selected uniformly at random from the set of all nodes. In practice – instead of requiring all nodes to know all the peer nodes so that a random sample could be drawn – a scalable and efficient way to implement the peer sampling service is by constructing and maintaining dynamic unstructured overlays through gossiping membership information itself. This paper presents a generic framework to implement reliable and efficient peer sampling services. The framework generalizes existing approaches and makes it easy to introduce new ones. We use this framework to explore and compare several implementations of our abstraction. Through extensive experimental analysis, we show that all of them lead to different peer sampling services none of which is uniformly random. This clearly renders traditional theoretical approaches invalid, when the underlying peer sampling service is based on a gossip-based scheme. Our observations also help explain important differences between design choices of peer sampling algorithms, and how these impact the reliability of the corresponding service.

References

  1. 1.
    Albert, R., Barabási, A.-L.: Statistical mechanics of complex networks. Reviews of Modern Physics 74(1), 47–97 (2002)MathSciNetCrossRefMATHGoogle Scholar
  2. 2.
    Albert, R., Jeong, H., Barabási, A.-L.: Error and attack tolerance of complex networks. Nature 406, 378–382 (2000)CrossRefGoogle Scholar
  3. 3.
    Barabási, A.-L.: Linked: the new science of networks. Perseus, Cambridge (2002)Google Scholar
  4. 4.
    Birman, K.P., Hayden, M., Ozkasap, O., Xiao, Z., Budiu, M., Minsky, Y.: Bimodal multicast. ACM Transactions on Computer Systems 17(2), 41–88 (1999)CrossRefGoogle Scholar
  5. 5.
    Dabek, F., Zhao, B., Druschel, P., Kubiatowicz, J., Stoica, I.: Towards a common API for structured peer-to-peer overlays. In: Kaashoek, M.F., Stoica, I. (eds.) IPTPS 2003. LNCS, vol. 2735, Springer, Heidelberg (2003)CrossRefGoogle Scholar
  6. 6.
    Demers, A., Greene, D., Hauser, C., Irish, W., Larson, J., Shenker, S., Sturgis, H., Swinehart, D., Terry, D.: Epidemic algorithms for replicated database management. In: Proc. of the 6th Annual ACM Symposium on Principles of Distributed Computing (PODC 1987), August 1987, pp. 1–12. ACM, New York (1987)Google Scholar
  7. 7.
    Dorogovtsev, S.N., Mendes, J.F.F.: Evolution of networks. Advances in Physics 51, 1079–1187 (2002)CrossRefGoogle Scholar
  8. 8.
    Eugster, P.T., Guerraoui, R., Handurukande, S.B., Kermarrec, A.-M., Kouznetsov, P.: Lightweight probabilistic broadcast. ACM Transactions on Computer Systems 21(4), 341–374 (2003)CrossRefGoogle Scholar
  9. 9.
    Eugster, P.T., Guerraoui, R., Kermarrec, A.-M., Massoulié, L.: Epidemic information dissemination in distributed systems. IEEE Computer 37(5), 60–67 (2004)CrossRefGoogle Scholar
  10. 10.
    Ganesh, J., Kermarrec, A.-M., Massoulié, L.: Peer-to-peer membership management for gossip-based protocols. IEEE Transactions on Computers 52(2) (February 2003)Google Scholar
  11. 11.
    Gupta, I., Birman, K.P., van Renesse, R.: Fighting fire with fire: using randomized gossip to combat stochastic scalability limits. Quality and Reliability Engineering International 18(3), 165–184 (2002)CrossRefGoogle Scholar
  12. 12.
    Jelasity, M., Kowalczyk, W., van Steen, M.: Newscast computing. Technical Report IR-CS-006, Vrije Universiteit Amsterdam, Department of Computer Science, Amsterdam, The Netherlands (November 2003)Google Scholar
  13. 13.
    Jelasity, M., Kowalczyk, W., van Steen, M.: An approach to massively distributed aggregate computing on peer-to-peer networks. In: Proc. of the 12th Euromicro Conference on Parallel, Distributed and Network-Based Processing (PDP 2004), A Coruna, Spain, pp. 200–207. IEEE Computer Society, Los Alamitos (2004)CrossRefGoogle Scholar
  14. 14.
    Jelasity, M., Montresor, A.: Epidemic-style proactive aggregation in large overlay networks. In: Proc. of the 24th International Conference on Distributed Computing Systems (ICDCS 2004), Tokyo, Japan, pp. 102–109. IEEE Computer Society, Los Alamitos (2004)CrossRefGoogle Scholar
  15. 15.
    Jelasity, M., Montresor, A., Babaoglu, O.: A modular paradigm for building self-organizing peer-to-peer applications. In: Di Marzo Serugendo, G., Karageorgos, A., Rana, O.F., Zambonelli, F. (eds.) ESOA 2003. LNCS (LNAI), vol. 2977, pp. 265–282. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  16. 16.
    Kempe, D., Dobra, A., Gehrke, J.: Gossip-based computation of aggregate information. In: Proc. of the 44th Annual IEEE Symposium on Foundations of Computer Science (FOCS 2003), pp. 482–491. IEEE Computer Society, Los Alamitos (2003)CrossRefGoogle Scholar
  17. 17.
    Kermarrec, A.-M., Massoulié, L., Ganesh, A.J.: Probablistic reliable dissemination in large-scale systems. IEEE Transactions on Parallel and Distributed Systems 14(3) (March 2003)Google Scholar
  18. 18.
    Law, C., Siu, K.-Y.: Distributed construction of random expander graphs. In: Proc. of the 22nd Annual Joint Conference of the IEEE Computer and Communications Societies (INFOCOM 2003), San Francisco, California, USA (April 2003)Google Scholar
  19. 19.
    Loguinov, D., Kumar, A., Rai, V., Ganesh, S.: Graph-theoretic analysis of structured peer-to-peer systems: Routing distances and fault resilience. In: Proc. of ACM SIGCOMM, pp. 395–406 (2003)Google Scholar
  20. 20.
    Montresor, A., Jelasity, M., Babaoglu, O.: Robust aggregation protocols for large-scale overlay networks. In: Proc. of the 2004 International Conference on Dependable Systems and Networks (DSN), Florence, Italy, pp. 19–28. IEEE Computer Society, Los Alamitos (2004)CrossRefGoogle Scholar
  21. 21.
    Newman, M.E.J.: Random graphs as models of networks. In: Bornholdt, S., Schuster, H.G. (eds.) Handbook of Graphs and Networks: From the Genome to the Internet. ch. 2, John Wiley, New York (2002)Google Scholar
  22. 22.
    Pandurangan, G., Raghavan, P., Upfal, E.: Building low-diameter peer-to-peer networks. IEEE Journal on Selected Areas in Communications (JSAC) 21(6), 995–1002 (2003)CrossRefGoogle Scholar
  23. 23.
    Pastor-Satorras, R., Vespignani, A.: Epidemic dynamics and endemic states in complex networks. Physical Review E 63, 66–117 (2001)CrossRefGoogle Scholar
  24. 24.
    Pittel, B.: On spreading a rumor. SIAM Journal on Applied Mathematics 47(1), 213–223 (1987)MathSciNetCrossRefMATHGoogle Scholar
  25. 25.
    Ratnasamy, S., Francis, P., Handley, M., Karp, R., Schenker, S.: A scalable content-addressable network. In: Proc. of ACM SIGCOMM, pp. 161–172 (2001)Google Scholar
  26. 26.
    Rowstron, A., Druschel, P.: Pastry: Scalable, distributed object location and routing for large-scale peer-to-peer systems. In: Guerraoui, R. (ed.) Middleware 2001. LNCS, vol. 2218, pp. 329–350. Springer, Heidelberg (2001)CrossRefGoogle Scholar
  27. 27.
    Stoica, I., Morris, R., Karger, D., Kaashoek, M.F., Balakrishnan, H.: Chord: A scalable peer-to-peer lookup service for internet applications. In: Proc. of ACM SIGCOMM, pp. 149–160 (2001)Google Scholar
  28. 28.
    Van Renesse, R., Birman, K.P., Vogels, W.: Astrolabe: A robust and scalable technology for distributed system monitoring, management, and data mining. ACM Transactions on Computer Systems 21(2) (May 2003)Google Scholar
  29. 29.
    Voulgaris, S., van Steen, M.: An epidemic protocol for managing routing tables in very large peer-to-peer networks. In: Brunner, M., Keller, A. (eds.) DSOM 2003. LNCS, vol. 2867, pp. 41–54. Springer, Heidelberg (2003)CrossRefGoogle Scholar
  30. 30.
    Watts, D.J., Strogatz, S.H.: Collective dynamics of ’small-world’ networks. Nature 393, 440–442 (1998)CrossRefMATHGoogle Scholar

Copyright information

© IFIP International Federation for Information Processing 2004

Authors and Affiliations

  • Márk Jelasity
    • 1
    • 2
  • Rachid Guerraoui
    • 3
  • Anne-Marie Kermarrec
    • 4
  • Maarten van Steen
    • 5
  1. 1.University of BolognaItaly
  2. 2.RGAI, MTA SZTESzegedHungary
  3. 3.EPFLLausanneSwitzerland
  4. 4.INRIARennesFrance
  5. 5.Vrije UniversiteitAmsterdamThe Netherlands

Personalised recommendations