Advertisement

FAIDECS: Fair Decentralized Event Correlation

  • Gregory Aaron Wilkin
  • K. R. Jayaram
  • Patrick Eugster
  • Ankur Khetrapal
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7049)

Abstract

Many distributed applications rely on event correlation. Such applications, when not built as ad-hoc solutions, typically rely on centralized correlators or on broker overlay networks. Centralized correlators constitute performance bottlenecks and single points of failure; straightforwardly duplicating them can hamper performance and cause processes interested in the same correlations to reach different outcomes. The latter problem can manifest also if broker overlays provide redundant paths to tolerate broker failures as events do not necessarily reach all processes via the same path and thus in the same order.

This paper describes FAIDECS, a generic middleware system for fair decentralized correlation of events multicast among processes: processes with identical interests reach identical outcomes, and subsumption relationships among subscriptions are considered for respectively delivered composite events. Based on a generic subset of FAIDECS’s predicate language, we introduce properties for composite event deliveries in the presence of process failures and present novel decentralized algorithms implementing these properties. Our algorithms are compared under various workloads to solutions providing equivalent guarantees.

Keywords

event correlation fair reliable multicast decentralized 

References

  1. 1.
    Abadi, D.J., Carney, D., Çetintemel, U., Cherniack, M., Convey, C., Lee, S., Stonebraker, M., Tatbul, N., Zdonik, S.: Aurora: A New Model and Architecture for Data Stream Management. VLDB Journal (2003)Google Scholar
  2. 2.
    Aguilera, M.K., Strom, R.E., Sturman, D.C., Astley, M., Chandra, T.D.: Matching Events in a Content-Based Subscription System. In: PODC (1999)Google Scholar
  3. 3.
    Basu, A., Charron-Bost, B., Toueg, S.: Simulating Reliable Links with Unreliable Links in the Presence of Failures. In: Babaoğlu, Ö., Marzullo, K. (eds.) WDAG 1996. LNCS, vol. 1151, pp. 105–122. Springer, Heidelberg (1996)Google Scholar
  4. 4.
    Birman, K.P., Hayden, M., Ozkasap, O., Xiao, Z., Budiu, M., Minsky, Y.: Bimodal Multicast. In: ACM TOCS (1999)Google Scholar
  5. 5.
    Carzaniga, A., Rosenblum, D., Wolf, A.: Design and Evaluation of a Wide Area Event Notification Service. In: ACM TOCS (2001)Google Scholar
  6. 6.
    Chakravarthy, S., Krishnaprasad, V., Anwar, E., Kim, S.-K.: Composite Events for Active Databases: Semantics, Contexts and Detection. In: VLDB (1994)Google Scholar
  7. 7.
    Défago, X., Schiper, A., Urbán, P.: Total Order Broadcast and Multicast Algorithms: Taxonomy and Survey. In: ACM CSUR (2004)Google Scholar
  8. 8.
    Demers, A., Gehrke, J., Hong, M., Riedewald, M., White, W.M.: Towards Expressive Publish/Subscribe Systems. In: Ioannidis, Y., Scholl, M.H., Schmidt, J.W., Matthes, F., Hatzopoulos, M., Böhm, K., Kemper, A., Grust, T., Böhm, C. (eds.) EDBT 2006. LNCS, vol. 3896, pp. 627–644. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  9. 9.
    Eugster, P., Jayaram, K.R.: EventJava: An Extension of Java for Event Correlation. In: Drossopoulou, S. (ed.) ECOOP 2009. LNCS, vol. 5653, pp. 570–594. Springer, Heidelberg (2009)CrossRefGoogle Scholar
  10. 10.
    Forgy, C.L.: On the efficient implementation of production systems. PhD thesis, Carnegie Mellon University (1979)Google Scholar
  11. 11.
    Garcia-Molina, H., Spauster, A.: Message Ordering in a Multicast Environment. In: ICDCS (1989)Google Scholar
  12. 12.
    Guerraoui, R., Schiper, A.: Genuine Atomic Multicast in Asynchronous Distributed Systems. In: TCS (2001)Google Scholar
  13. 13.
    Grimm, R., Davis, J., Lemar, E., MacBeth, A., Swanson, S., Anderson, T.E., Bershad, B.N., Borriello, G., Gribble, S.D., Wetherall, D.: System Support for Pervasive Applications. In: ACM TOCS (2004)Google Scholar
  14. 14.
    Hadzilacos, V., Toueg, S.: Fault-Tolerant Broadcasts and Related Problems. In: Distributed Systems, 2nd edn. (1993)Google Scholar
  15. 15.
    Koch, G.G., Koldehofe, B., Rothermel, K.: Cordies: Expressive Event Correlation in Distributed Systems. In: DEBS (2010)Google Scholar
  16. 16.
    Kompella, R.R., Yates, J., Greenberg, A.G., Snoeren, A.C.: IP Fault Localization Via Risk Modeling. In: NSDI (2005)Google Scholar
  17. 17.
    Krügel, C., Tóth, T., Kerer, C.: Decentralized Event Correlation for Intrusion Detection. In: Kim, K.-c. (ed.) ICISC 2001. LNCS, vol. 2288, pp. 114–131. Springer, Heidelberg (2002)CrossRefGoogle Scholar
  18. 18.
    Lamport, L.: Time, Clocks, and the Ordering of Events in a Distributed System. CACM (1978)Google Scholar
  19. 19.
    Li, G., Jacobsen, H.-A.: Composite Subscriptions in Content-Based Publish/Subscribe Systems. In: Alonso, G. (ed.) Middleware 2005. LNCS, vol. 3790, pp. 249–269. Springer, Heidelberg (2005)CrossRefGoogle Scholar
  20. 20.
    Pietzuch, P.R., Shand, B., Bacon, J.: A Framework for Event Composition in Distributed Systems. In: Endler, M., Schmidt, D.C. (eds.) Middleware 2003. LNCS, vol. 2672, pp. 62–82. Springer, Heidelberg (2003)CrossRefGoogle Scholar
  21. 21.
    Rabinovich, E., Etzion, O., Ruah, S., Archushin, S.: Analyzing the Behavior of Event Processing Applications. In: DEBS (2010)Google Scholar
  22. 22.
    Sánchez, C., Sankaranarayanan, S., Sipma, H.B., Zhang, T., Dill, D.L., Manna, Z.: Event Correlation: Language and Semantics. In: Alur, R., Lee, I. (eds.) EMSOFT 2003. LNCS, vol. 2855, pp. 323–339. Springer, Heidelberg (2003)CrossRefGoogle Scholar
  23. 23.
    Tatbul, N., Çetintemel, U., Zdonik, S.B.: Staying FIT: Efficient Load Shedding Techniques for Distributed Stream Processing. In: VLDB (2007)Google Scholar
  24. 24.
    Wilkin, G.A., Eugster, P.: Multicast with Aggregated Deliveries (2010), http://www.cs.purdue.edu/homes/peugster/EventJava/MDMcastTR.pdf
  25. 25.
    Wilkin, G.A., Jayaram, K.R., Eugster, P., Khetrapal, A.: Fair Decentralized Event Correlation with FAIDECS (2011), http://www.cs.purdue.edu/homes/peugster/EventJava/FAIDECSTR.pdf
  26. 26.
    Zhao, Y., Strom, R.E.: Exploiting Event Stream Interpretation in Publish-Subscribe Systems. In: PODC (2001)Google Scholar

Copyright information

© IFIP International Federation for Information Processing 2011

Authors and Affiliations

  • Gregory Aaron Wilkin
    • 1
  • K. R. Jayaram
    • 1
  • Patrick Eugster
    • 1
  • Ankur Khetrapal
    • 1
  1. 1.Department of Computer SciencePurdue UniversityUSA

Personalised recommendations