Advertisement

PolderCast: Fast, Robust, and Scalable Architecture for P2P Topic-Based Pub/Sub

  • Vinay Setty
  • Maarten van Steen
  • Roman Vitenberg
  • Spyros Voulgaris
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7662)

Abstract

We propose PolderCast, a P2P topic-based Pub/Sub system that is (a) fault-tolerant and robust, (b) scalable w.r.t the number of nodes interested in a topic and number of topics that nodes are interested in, and (c) fast in terms of dissemination latency while (d) attaining a low communication overhead. This combination of properties is provided by an implementation that blends deterministic propagation over maintained rings with probabilistic dissemination following a limited number of random shortcuts. The rings are constructed and maintained using gossiping techniques. The random shortcuts are provided by two distinct peer-sampling services: Cyclon generates purely random links while Vicinity produces interest-induced random links.

We analyze PolderCast and survey it in the context of existing approaches. We evaluate PolderCast experimentally using real-world workloads from Twitter and Facebook traces. We use widely renowned Scribe [5] as a baseline in a number of experiments. Robustness with respect to node churn is evaluated through traces from the Skype super-peer network. We show that the experimental results corroborate all of the above properties in settings of up to 10K nodes, 10K topics, and 5K topics per-node.

Keywords

Publish/Subscribe Peer-to-Peer Gossiping 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    An implementation of the Pastry protocol for PeerSim, http://peersim.sourceforge.net/code/pastry.tar.gz
  2. 2.
    Tibco rendezvous, http://www.tibco.com
  3. 3.
    Baehni, S., Eugster, P.T., Guerraoui, R.: Data-aware multicast. In: DSN (2004)Google Scholar
  4. 4.
    Baldoni, R., Beraldi, R., Quema, V., Querzoni, L., Tucci-Piergiovanni, S.: Tera: topic-based event routing for peer-to-peer architectures. In: DEBS (2007)Google Scholar
  5. 5.
    Castro, M., Druschel, P., Kermarrec, A.M., Rowstron, A.I.T.: Scribe: a large-scale and decentralized application-level multicast infrastructure. IEEE Journal on Selected Areas in Communications 20, 1489–1499 (2002)CrossRefGoogle Scholar
  6. 6.
    Chockler, G., Melamed, R., Tock, Y., Vitenberg, R.: Constructing scalable overlays for pub-sub with many topics. In: PODC (2007)Google Scholar
  7. 7.
    Chockler, G., Melamed, R., Tock, Y., Vitenberg, R.: Spidercast: a scalable interest-aware overlay for topic-based pub/sub communication. In: DEBS (2007)Google Scholar
  8. 8.
    Eugster, P.T., Felber, P.A., Guerraoui, R., Kermarrec, A.M.: The many faces of publish/subscribe. ACM Comput. Surv. 35, 114–131 (2003)CrossRefGoogle Scholar
  9. 9.
    Girdzijauskas, S., Chockler, G., Vigfusson, Y., Tock, Y., Melamed, R.: Magnet: practical subscription clustering for internet-scale Pub/Sub. In: DEBS (2010)Google Scholar
  10. 10.
    Guha, S., Daswani, N., Jain, R.: An Experimental Study of the Skype Peer-to-Peer VoIP System. In: IPTPS (2006)Google Scholar
  11. 11.
    Gummadi, K.P., Saroiu, S., Gribble, S.D.: King: estimating latency between arbitrary internet end hosts. In: SIGCOMM (2002)Google Scholar
  12. 12.
    Jelasity, M., Montresor, A., Babaoglu, Ö.: T-Man: Gossip-based fast overlay topology construction. Computer Networks 53(13), 2321–2339 (2009)CrossRefzbMATHGoogle Scholar
  13. 13.
    Kwak, H., Lee, C., Park, H., Moon, S.: What is Twitter, a social network or a news media? In: WWW (2010)Google Scholar
  14. 14.
    Li, G., Muthusamy, V., Jacobsen, H.A.: A distributed service-oriented architecture for business process execution. ACM Trans. Web. 4, 2:1–2:33 (2010)CrossRefGoogle Scholar
  15. 15.
    Liu, H., Ramasubramanian, V., Sirer, E.G.: Client behavior and feed characteristics of RSS, a publish-subscribe system for web micronews. In: IMC (2005)Google Scholar
  16. 16.
    Matos, M., Nunes, A., Oliveira, R., Pereira, J.: Stan: exploiting shared interests without disclosing them in gossip-based publish/subscribe. In: IPTPS (2010)Google Scholar
  17. 17.
    Montresor, A., Jelasity, M.: PeerSim: A scalable P2P simulator. In: P2P Computing (2009)Google Scholar
  18. 18.
    Patel, J.A., Rivière, É., Gupta, I., Kermarrec, A.M.: Rappel: Exploiting interest and network locality to improve fairness in publish-subscribe systems. Computer Networks 53, 2304–2320 (2009)CrossRefzbMATHGoogle Scholar
  19. 19.
    Rahimian, F., Girdzijauskas, S., Payberah, A.H., Haridi, S.: Vitis: A gossip-based hybrid overlay for internet-scale publish/subscribe enabling rendezvous routing in unstructured overlay networks. In: IPDPS (2011)Google Scholar
  20. 20.
    Reumann, J.: GooPS: Pub/Sub at Google. Lecture & Personal Communications at EuroSys & CANOE Summer School (2009)Google Scholar
  21. 21.
    Rowstron, A., Druschel, P.: Pastry: Scalable, Decentralized Object Location, and Routing for Large-Scale Peer-to-Peer Systems. In: Guerraoui, R. (ed.) Middleware 2001. LNCS, vol. 2218, pp. 329–350. Springer, Heidelberg (2001)CrossRefGoogle Scholar
  22. 22.
    Triantafillou, P., Aekaterinidis, I.: Peer-to-peer publish-subscribe systems. In: Encyclopedia of Database Systems 2009, pp. 2069–2075 (2009)Google Scholar
  23. 23.
    Voulgaris, S.: Epidemic-Based Self-Organization in Peer-to-Peer Systems. Phd thesis, VU Universiteit Amsterdam (2006)Google Scholar
  24. 24.
    Voulgaris, S., Gavidia, D., van Steen, M.: Cyclon: Inexpensive membership management for unstructured P2P overlays. Journal of Network and Systems Management 13, 197–217 (2005)CrossRefGoogle Scholar
  25. 25.
    Voulgaris, S., van Steen, M.: Hybrid Dissemination: Adding Determinism to Probabilistic Multicasting in Large-Scale P2P Systems. In: Cerqueira, R., Campbell, R.H. (eds.) Middleware 2007. LNCS, vol. 4834, pp. 389–409. Springer, Heidelberg (2007)CrossRefGoogle Scholar
  26. 26.
    Wilson, C., Boe, B., Sala, A., Puttaswamy, K.P.N., Zhao, B.Y.: User interactions in social networks and their implications. In: EuroSys (2009)Google Scholar
  27. 27.
    Wong, B., Guha, S.: Quasar: a probabilistic publish-subscribe system for social networks. In: IPTPS (2008)Google Scholar
  28. 28.
    Zhuang, S.Q., Zhao, B.Y., Joseph, A.D., Katz, R.H., Kubiatowicz, J.D.: Bayeux: an architecture for scalable and fault-tolerant wide-area data dissemination. In: NOSSDAV (2001)Google Scholar

Copyright information

© IFIP International Federation for Information Processing 2012

Authors and Affiliations

  • Vinay Setty
    • 1
  • Maarten van Steen
    • 2
  • Roman Vitenberg
    • 1
  • Spyros Voulgaris
    • 2
  1. 1.Department of InformaticsUniversity of OsloNorway
  2. 2.Department of Computer ScienceVU UniversityAmsterdamThe Netherlands

Personalised recommendations