Skip to main content

Postman: An Elastic Highly Resilient Publish/Subscribe Framework for Self Sustained Service Independent P2P Networks

  • Conference paper
Stabilization, Safety, and Security of Distributed Systems (SSS 2014)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 8756))

Included in the following conference series:

Abstract

Self sustained service independent P2P networks aim to serve as a cheap alternative to traditional cloud providers. In such networks, users who add resources to the network are given strong (typically monetary) incentives to keep their devices connected for long periods of time. Further, in such networks, there is a decoupling between the machines that form the P2P network and the devices used to consume services from the network. In particular, users may access services offered by the network through their mobile devices. In fact, a user may obtain services even if he did not donate any resources, but is willing to pay for the services he consumes either through a service fee or by viewing ads, similarly to cloud services.

This work introduces Postman, a publish/subscribe architecture tailored for self sustained service independent P2P networks. Postman is designed to provide its users with a self-organizing, scalable, efficient and churn resilient publish/subscribe service. Postman achieves this using a novel client/mailbox architecture where a publish/subscribe system delivers content to a highly diverse set of mailboxes. Mailboxes are hosted on elastically selected set of peers and each mailbox accumulates multiple topics from many clients. Clients then fulfill their subscriptions by polling the relevant mailboxes, while the mailboxes act as subscribers of the actual publish/subscribe mechanism. Our experimental results show that the client/mailbox architecture significantly reduces the number of subscriptions the publish/subscribe mechanism handles. In addition, the publish/subscribe mechanism handles a much more uniform subscription pattern than the real subscription pattern, obtains very high delivery rates and is highly robust to failures and churn.

This work is partially supported by ISF grant 1247/09 and the Technion HPI center.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Postman implementation, https://code.google.com/p/postman-pubsub/

  2. An, K., Pradhan, S., Caglar, F., Gokhale, A.: A publish/subscribe middleware for dependable and real-time resource monitoring in the cloud. In: Proc. of the Workshop on Secure and Dependable Middleware for Cloud Monitoring and Management, SDMCMM 2012, pp. 3:1–3:6. ACM, New York (2012)

    Google Scholar 

  3. Androutsellis-Theotokis, S., Spinellis, D.: A Survey of P2P Content Distribution Technologies. ACM Computing Survey 36, 335–371 (2004)

    Article  Google Scholar 

  4. Baldoni, R., Beraldi, R., Querzoni, L., Virgillito, A., Italia, R.: Efficient publish/subscribe through a self-organizing broker overlay and its application to siena. The Computer Journal (2007)

    Google Scholar 

  5. Chockler, G., Melamed, R., Tock, Y., Vitenberg, R.: Spidercast: A scalable interest-aware overlay for topic-based pub/sub communication. In: Proc. of the 2007 Inaugural Int. Conf. on Distributed Event-Based Systems, DEBS 2007, New York, USA, pp. 14–25 (2007)

    Google Scholar 

  6. Einziger, G., Friedman, R., Kibbar, E.: Kaleidoscope: Adding colors to kademlia. In: 2013 IEEE Thirteenth Int. Conf. on Peer-to-Peer Computing (P2P), pp. 1–10 (September 2013)

    Google Scholar 

  7. Esposito, C., Ficco, M., Palmieri, F., Castiglione, A.: Interconnecting federated clouds by using publish-subscribe service. Cluster Computing, 1–17 (2013)

    Google Scholar 

  8. Eugster, P., Felber, P., Guerraoui, R., Kermarrec, A.-M.: The Many Faces of Publish/Subscribe. ACM Computing Surveys 35(2), 114–131 (2003)

    Article  Google Scholar 

  9. Friedman, R., Libov, A.: An advertising mechanism for p2p networks. In: 2013 IEEE Thirteenth Int. Conf. on Peer-to-Peer Computing (P2P), pp. 1–10 (September 2013)

    Google Scholar 

  10. Girdzijauskas, S., Chockler, G., Vigfusson, Y., Tock, Y., Melamed, R.: Magnet: Practical subscription clustering for internet-scale publish/subscribe. In: Proc. of the Fourth ACM Int. Conf. on Distributed Event-Based Systems, DEBS 2010, New York, USA, pp. 172–183 (2010)

    Google Scholar 

  11. Kubiatowicz, J., Bindel, D., Chen, Y., Czerwinski, S.E., Eaton, P.R., Geels, D., Gummadi, R., Rhea, S.C., Weatherspoon, H., Weimer, W., Wells, C., Zhao, B.Y.: Oceanstore: An architecture for global-scale persistent storage. In: Proc. of the 9th Int. Conf. on Architectural Support for Programming Languages and Operating Systems (ASPLOS), pp. 190–201 (2000)

    Google Scholar 

  12. Kwak, H., Lee, C., Park, H., Moon, S.: What is twitter, a social network or a news media? In: Proc. of the 19th Int. Conf. on World Wide Web, WWW 2010, pp. 591–600. ACM, New York (2010)

    Google Scholar 

  13. Lua, E.K., Crowcroft, J., Pias, M., Sharma, R., Lim, S.: A Survey and Comparison of P2P Overlay Network Schemes. IEEE Comm. Surveys Tutorials 7(2), 72–93 (2005)

    Article  Google Scholar 

  14. Maymounkov, P., Mazières, D.: Kademlia: A P2P Information System Based on the XOR Metric, 3rd edn., vol. 3279 (2005)

    Google Scholar 

  15. Ramasubramanian, V., Peterson, R., Sirer, E.G.: Corona: A high performance publish-subscribe system for the world wide web. In: Proc. of the 3rd Conf. on Networked Systems Design & Implementation, NSDI 2006, vol. 3, p. 2. USENIX Association, Berkeley (2006)

    Google Scholar 

  16. Rodrigues, R., Druschel, P.: P2p systems. Communications of the ACM 53(10), 72–82 (2010)

    Article  Google Scholar 

  17. Sandler, D.R., Wallach, D.S.: Birds of a fethr: open, decentralized micropublishing. In: Proc. of the 8th Int. Conf. on P2P systems, IPTPS 2009, p. 1. USENIX Association, Berkeley (2009)

    Google Scholar 

  18. Tran, D.A., Pham, C.: Pub-2-sub: A content-based publish/subscribe framework for cooperative p2p networks. In: Fratta, L., Schulzrinne, H., Takahashi, Y., Spaniol, O. (eds.) NETWORKING 2009. LNCS, vol. 5550, pp. 770–781. Springer, Heidelberg (2009)

    Chapter  Google Scholar 

  19. Wong, B., Guha, S.: Quasar: A probabilistic publish-subscribe system for social networks. In: Proc. of the 7th Int. Conf. on P2P Systems, IPTPS 2008, p. 2. USENIX Association, Berkeley (2008)

    Google Scholar 

  20. Xu, T., Chen, Y., Fu, X., Hui, P.: Twittering by cuckoo: decentralized and socio-aware online microblogging services. ACM SIGCOMM Computer Communication Review 41 (August 2010)

    Google Scholar 

  21. Zhu, Y., Wang, J., Wang, C.: Ripple: A publish/subscribe service for multidata item updates propagation in the cloud. Journal of Network and Computer Applications 34(4), 1054–1067 (2011)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer International Publishing Switzerland

About this paper

Cite this paper

Einziger, G., Friedman, R. (2014). Postman: An Elastic Highly Resilient Publish/Subscribe Framework for Self Sustained Service Independent P2P Networks. In: Felber, P., Garg, V. (eds) Stabilization, Safety, and Security of Distributed Systems. SSS 2014. Lecture Notes in Computer Science, vol 8756. Springer, Cham. https://doi.org/10.1007/978-3-319-11764-5_6

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-11764-5_6

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-11763-8

  • Online ISBN: 978-3-319-11764-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics