Advertisement

Decentralized Stream Processing Over Web-Enabled Devices

  • Masiar Babazadeh
  • Andrea Gallidabino
  • Cesare Pautasso
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9306)

Abstract

Thanks to the recent introduction of peer-to-peer communication between browsers with WebRTC, real time processing of streams can now be deployed on browsers in addition to traditional server-side execution environments. In this paper we present the Web Liquid Streams framework for building and executing stream processing topologies capable of gathering data from Web-enabled sensors and process it through JavaScript operators scattered across a peer-to-peer Cloud of computing peers. i) support for arbitrary topologies and data streams, ii) deployment on heterogeneous Web-enabled devices, iii) transparent stream delivery across the WebRTC, WebSockets and ZeroMQ protocols, iv) stateful and stateless operators. WLS takes care of the deployment of the topology on the available resources, while users are only required to implement the operators and describe the topology graph using JSON. The structure of the topology can be dynamically adapted without stopping the stream flowing through it. We present the platform and its programming interface, showing a first evaluation of the system.

Keywords

Data Stream Stream Processing Smart Device Execution Environment Topology Description 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Storm: distributed and fault-tolerant realtime computation (2011). http://storm-project.net/
  2. 2.
    Akidau, T., et al.: Millwheel: Fault-tolerant stream processing at internet scale. Proc. VLDB Endow. 6(11), 1033–1044 (2013)CrossRefGoogle Scholar
  3. 3.
    Arasu, A., et al: Linear road: a stream data management benchmark. In: Proc. of the Thirteenth International Conference on Very Large Data Bases, VLDB 2004, vol. 30, pp. 480–491. VLDB Endowment (2004)Google Scholar
  4. 4.
    Babaoglu, O., et al: Design and implementation of a p2p cloud system. In: Proc. of SAC 2012Google Scholar
  5. 5.
    Babaoglu, O., Jelasity, M., Kermarrec, A.-M., Montresor, A., van Steen, M.: Managing clouds: A case for a fresh look at large unreliable dynamic networks. SIGOPS Oper. Syst. Rev. 40(3), 9–13 (2006)CrossRefGoogle Scholar
  6. 6.
    Babazadeh, M., Gallidabino, A., Pautasso, C.: Liquid stream processing across web browsers and web servers. In: Cimiano, P., Frasincar, F., Houben, G.-J., Schwabe, D. (eds.) ICWE 2015. LNCS, vol. 9114, pp. 24–33. Springer, Heidelberg (2015) CrossRefGoogle Scholar
  7. 7.
    Babazadeh, M., Pautasso, C.: A RESTful API for controlling dynamic streaming topologies. In: 5th International Workshop on Web APIs and RESTful Design (WS-REST 2014), Seoul, Korea, April 2014Google Scholar
  8. 8.
    Cugola, G., Margara, A.: Processing flows of information: From data stream to complex event processing. ACM Comput. Surv. 44(3), 15:1–15:62 (2012)CrossRefGoogle Scholar
  9. 9.
    Guinard, D.: A Web of Things Application Architecture - Integrating the Real-World into the Web. PhD thesis, ETH Zurich, Zurich, Switzerland, August 2011Google Scholar
  10. 10.
    Jelasity, M., Montresor, A., Babaoglu, O.: Gossip-based aggregation in large dynamic networks. ACM Trans. Comput. Syst. 23(3), 219–252 (2005)CrossRefGoogle Scholar
  11. 11.
    Kakkad, V., Attar, S., Santosa, A.E., Fekete, A., Scholz, B.: Curracurrong: a stream programming environment for wireless sensor networks. Softw. Pract. Exper. 44(2), 175–199 (2014)CrossRefGoogle Scholar
  12. 12.
    Kakkad, V., et al: Curracurrong cloud: Stream processing in the cloud. In: Proc. of ICDEW, pp. 207–214, March 2014Google Scholar
  13. 13.
    Kovatsch, M.: CoAP for the web of things: from tiny resource-constrained devices to the web browser. In: Adj. Proc. of UbiComp, pp. 1495–1504 (2013)Google Scholar
  14. 14.
    Rodríguez, P., et al: Advanced videoconferencing services based on WebRTC. In: Proc. of ICWBC, pp. 180–184, July 2012Google Scholar
  15. 15.
    Vogt, C., et al: Content-centric user networks: WebRTC as a path to name-based publishing. In: Proc. of ICNP, October 2013Google Scholar
  16. 16.
    Vogt, C., Werner, M.J., Schmidt, T.C.: Leveraging webRTC for P2P content distribution in web browsers. In: Proc. of ICNP, October 2013Google Scholar
  17. 17.
    Zaharia, M., et al: Discretized streams: an efficient and fault-tolerant model for stream processing on large clusters. In: Proc. of USENIX HotCloud 2012Google Scholar

Copyright information

© IFIP International Federation for Information Processing 2015

Authors and Affiliations

  • Masiar Babazadeh
    • 1
  • Andrea Gallidabino
    • 1
  • Cesare Pautasso
    • 1
  1. 1.Faculty of InformaticsUniversity of Lugano (USI)LuganoSwitzerland

Personalised recommendations