PolderCast: Fast, Robust, and Scalable Architecture for P2P Topic-Based Pub/Sub

  • Vinay Setty
  • Maarten van Steen
  • Roman Vitenberg
  • Spyros Voulgaris
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7662)


We propose PolderCast, a P2P topic-based Pub/Sub system that is (a) fault-tolerant and robust, (b) scalable w.r.t the number of nodes interested in a topic and number of topics that nodes are interested in, and (c) fast in terms of dissemination latency while (d) attaining a low communication overhead. This combination of properties is provided by an implementation that blends deterministic propagation over maintained rings with probabilistic dissemination following a limited number of random shortcuts. The rings are constructed and maintained using gossiping techniques. The random shortcuts are provided by two distinct peer-sampling services: Cyclon generates purely random links while Vicinity produces interest-induced random links.

We analyze PolderCast and survey it in the context of existing approaches. We evaluate PolderCast experimentally using real-world workloads from Twitter and Facebook traces. We use widely renowned Scribe [5] as a baseline in a number of experiments. Robustness with respect to node churn is evaluated through traces from the Skype super-peer network. We show that the experimental results corroborate all of the above properties in settings of up to 10K nodes, 10K topics, and 5K topics per-node.


Publish/Subscribe Peer-to-Peer Gossiping 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    An implementation of the Pastry protocol for PeerSim,
  2. 2.
    Tibco rendezvous,
  3. 3.
    Baehni, S., Eugster, P.T., Guerraoui, R.: Data-aware multicast. In: DSN (2004)Google Scholar
  4. 4.
    Baldoni, R., Beraldi, R., Quema, V., Querzoni, L., Tucci-Piergiovanni, S.: Tera: topic-based event routing for peer-to-peer architectures. In: DEBS (2007)Google Scholar
  5. 5.
    Castro, M., Druschel, P., Kermarrec, A.M., Rowstron, A.I.T.: Scribe: a large-scale and decentralized application-level multicast infrastructure. IEEE Journal on Selected Areas in Communications 20, 1489–1499 (2002)CrossRefGoogle Scholar
  6. 6.
    Chockler, G., Melamed, R., Tock, Y., Vitenberg, R.: Constructing scalable overlays for pub-sub with many topics. In: PODC (2007)Google Scholar
  7. 7.
    Chockler, G., Melamed, R., Tock, Y., Vitenberg, R.: Spidercast: a scalable interest-aware overlay for topic-based pub/sub communication. In: DEBS (2007)Google Scholar
  8. 8.
    Eugster, P.T., Felber, P.A., Guerraoui, R., Kermarrec, A.M.: The many faces of publish/subscribe. ACM Comput. Surv. 35, 114–131 (2003)CrossRefGoogle Scholar
  9. 9.
    Girdzijauskas, S., Chockler, G., Vigfusson, Y., Tock, Y., Melamed, R.: Magnet: practical subscription clustering for internet-scale Pub/Sub. In: DEBS (2010)Google Scholar
  10. 10.
    Guha, S., Daswani, N., Jain, R.: An Experimental Study of the Skype Peer-to-Peer VoIP System. In: IPTPS (2006)Google Scholar
  11. 11.
    Gummadi, K.P., Saroiu, S., Gribble, S.D.: King: estimating latency between arbitrary internet end hosts. In: SIGCOMM (2002)Google Scholar
  12. 12.
    Jelasity, M., Montresor, A., Babaoglu, Ö.: T-Man: Gossip-based fast overlay topology construction. Computer Networks 53(13), 2321–2339 (2009)CrossRefzbMATHGoogle Scholar
  13. 13.
    Kwak, H., Lee, C., Park, H., Moon, S.: What is Twitter, a social network or a news media? In: WWW (2010)Google Scholar
  14. 14.
    Li, G., Muthusamy, V., Jacobsen, H.A.: A distributed service-oriented architecture for business process execution. ACM Trans. Web. 4, 2:1–2:33 (2010)CrossRefGoogle Scholar
  15. 15.
    Liu, H., Ramasubramanian, V., Sirer, E.G.: Client behavior and feed characteristics of RSS, a publish-subscribe system for web micronews. In: IMC (2005)Google Scholar
  16. 16.
    Matos, M., Nunes, A., Oliveira, R., Pereira, J.: Stan: exploiting shared interests without disclosing them in gossip-based publish/subscribe. In: IPTPS (2010)Google Scholar
  17. 17.
    Montresor, A., Jelasity, M.: PeerSim: A scalable P2P simulator. In: P2P Computing (2009)Google Scholar
  18. 18.
    Patel, J.A., Rivière, É., Gupta, I., Kermarrec, A.M.: Rappel: Exploiting interest and network locality to improve fairness in publish-subscribe systems. Computer Networks 53, 2304–2320 (2009)CrossRefzbMATHGoogle Scholar
  19. 19.
    Rahimian, F., Girdzijauskas, S., Payberah, A.H., Haridi, S.: Vitis: A gossip-based hybrid overlay for internet-scale publish/subscribe enabling rendezvous routing in unstructured overlay networks. In: IPDPS (2011)Google Scholar
  20. 20.
    Reumann, J.: GooPS: Pub/Sub at Google. Lecture & Personal Communications at EuroSys & CANOE Summer School (2009)Google Scholar
  21. 21.
    Rowstron, A., Druschel, P.: Pastry: Scalable, Decentralized Object Location, and Routing for Large-Scale Peer-to-Peer Systems. In: Guerraoui, R. (ed.) Middleware 2001. LNCS, vol. 2218, pp. 329–350. Springer, Heidelberg (2001)CrossRefGoogle Scholar
  22. 22.
    Triantafillou, P., Aekaterinidis, I.: Peer-to-peer publish-subscribe systems. In: Encyclopedia of Database Systems 2009, pp. 2069–2075 (2009)Google Scholar
  23. 23.
    Voulgaris, S.: Epidemic-Based Self-Organization in Peer-to-Peer Systems. Phd thesis, VU Universiteit Amsterdam (2006)Google Scholar
  24. 24.
    Voulgaris, S., Gavidia, D., van Steen, M.: Cyclon: Inexpensive membership management for unstructured P2P overlays. Journal of Network and Systems Management 13, 197–217 (2005)CrossRefGoogle Scholar
  25. 25.
    Voulgaris, S., van Steen, M.: Hybrid Dissemination: Adding Determinism to Probabilistic Multicasting in Large-Scale P2P Systems. In: Cerqueira, R., Campbell, R.H. (eds.) Middleware 2007. LNCS, vol. 4834, pp. 389–409. Springer, Heidelberg (2007)CrossRefGoogle Scholar
  26. 26.
    Wilson, C., Boe, B., Sala, A., Puttaswamy, K.P.N., Zhao, B.Y.: User interactions in social networks and their implications. In: EuroSys (2009)Google Scholar
  27. 27.
    Wong, B., Guha, S.: Quasar: a probabilistic publish-subscribe system for social networks. In: IPTPS (2008)Google Scholar
  28. 28.
    Zhuang, S.Q., Zhao, B.Y., Joseph, A.D., Katz, R.H., Kubiatowicz, J.D.: Bayeux: an architecture for scalable and fault-tolerant wide-area data dissemination. In: NOSSDAV (2001)Google Scholar

Copyright information

© IFIP International Federation for Information Processing 2012

Authors and Affiliations

  • Vinay Setty
    • 1
  • Maarten van Steen
    • 2
  • Roman Vitenberg
    • 1
  • Spyros Voulgaris
    • 2
  1. 1.Department of InformaticsUniversity of OsloNorway
  2. 2.Department of Computer ScienceVU UniversityAmsterdamThe Netherlands

Personalised recommendations