Skip to main content
SpringerLink
Log in

Performance Evaluation of ZooKeeper Atomic Broadcast Protocol

  • Conference paper
  • First Online:
Performance Evaluation Methodologies and Tools (VALUETOOLS 2021)

Abstract

In this paper, we present a performance model of the Zab protocol formally specified using the Markovian process algebra PEPA. The model is parameterised from measurements taken from a real deployment of Zookeeper and is evaluated to derive estimates for average latency and throughput at various loads. These estimates are then compared against further measurements from the real system. Although the model is highly abstract and ignores much implementation detail, it is shown to give qualitative predictions for system behaviour, most notably for estimating the saturation point.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. ZooKeeper, A.: https://cwiki.apache.org/confluence/display/ZOOKEEPER/Index (2015). Accessed 16 Dec 2015

  2. AlTurki, M., Meseguer, J.: PVeStA: a parallel statistical model checking and quantitative analysis tool. In: Corradini, A., Klin, B., Cîrstea, C. (eds.) CALCO 2011. LNCS, vol. 6859, pp. 386–392. Springer, Heidelberg (2011). https://doi.org/10.1007/978-3-642-22944-2_28

    Chapter  Google Scholar 

  3. Bernardo, M., Gorrieri, R.: A tutorial on EMPA: a theory of concurrent processes with nondeterminism, priorities, probabilities and time. Theoret. Comput. Sci. 202, 1–54 (1998)

    Article  MathSciNet  Google Scholar 

  4. Borthakur, D., et al.: Apache Hadoop goes realtime at Facebook. In: Proceedings of the 2011 ACM SIGMOD International Conference on Management of Data. SIGMOD 2011, pp. 1071–1080. ACM, New York, NY, USA (2011)

    Google Scholar 

  5. Burrows, M.: The chubby lock service for loosely-coupled distributed systems. In: Proceedings of the 7th Symposium on Operating Systems Design and Implementation, pp. 335–350. OSDI 2006, USENIX Association (2006)

    Google Scholar 

  6. Clavel, M., et al.: All About Maude - A High-Performance Logical Framework. LNCS, vol. 4350. Springer, Heidelberg (2007). https://doi.org/10.1007/978-3-540-71999-1

    Book  MATH  Google Scholar 

  7. Donatelli, S.: Superposed generalized stochastic petri nets: definition and efficient solution. In: Valette, R. (ed.) ICATPN 1994. LNCS, vol. 815, pp. 258–277. Springer, Heidelberg (1994). https://doi.org/10.1007/3-540-58152-9_15

    Chapter  Google Scholar 

  8. EL-Sanosi, I., Ezhilchelvan, P.: Improving ZooKeeper atomic broadcast performance by coin tossing. In: Reinecke, P., Di Marco, A. (eds.) EPEW 2017. LNCS, vol. 10497, pp. 249–265. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-66583-2_16

    Chapter  Google Scholar 

  9. Fan, W., Bifet, A.: Mining big data: current status, and forecast to the future. SIGKDD Explor. Newsl. 14(2), 1–5 (2013)

    Article  Google Scholar 

  10. Harrison, P.G., Strulo, B.: Spades - a process algebra for discrete event simulation. J. Logic Comput. 10(1), 3–42 (2000)

    Article  MathSciNet  Google Scholar 

  11. Hayden, R.A., Bradley, J.T.: Fluid-flow solutions in PEPA to the state space explosion problem. In: 6th Workshop on Process Algebra and Stochastically Timed Activities (PASTA), p. 25 (2007)

    Google Scholar 

  12. Hillston, J.: Fluid flow approximation of PEPA models. In: Second International Conference on the Quantitative Evaluation of Systems (QEST 2005), pp. 33–42 (2005)

    Google Scholar 

  13. Hillston, J.: A compositional Approach to Performance Modelling. Cambridge University Press, Cambridge (2008)

    MATH  Google Scholar 

  14. Hillston, J., Gilmore, S.: Performance evaluation process algebra. http://www.dcs.ed.ac.uk/pepa/about/ (2011). Accessed 05 April 2016

  15. Hunt, P., Konar, M., Junqueira, F.P., Reed, B.: Zookeeper: wait-free coordination for internet-scale systems. In: USENIX Annual Technical Conference, vol. 8, p. 9 (2010)

    Google Scholar 

  16. Junqueira, F.P., Reed, B.C., Serafini, M.: Zab: high-performance broadcast for primary-backup systems. In: 2011 IEEE/IFIP 41st International Conference on Dependable Systems Networks (DSN), pp. 245–256 (2011)

    Google Scholar 

  17. Junqueira, F., Reed, B.: ZooKeeper: Distributed Process Coordination. O’Reilly Media, Inc. (2013)

    Google Scholar 

  18. Lamport, L.: The part-time parliament. ACM Trans. Comput. Syst. 16(2), 133–169 (1998)

    Article  Google Scholar 

  19. MacCormick, J., Murphy, N., Najork, M., Thekkath, C.A., Zhou, L.: Boxwood: abstractions as the foundation for storage infrastructure. In: Proceedings of the 6th Conference on Symposium on Operating Systems Design and Implementation - Volume 6. OSDI 2004, USENIX Association (2004)

    Google Scholar 

  20. Medeiros, A.: Zookeeper’s atomic broadcast protocol: Theory and practice. Technical report (2012). Accessed 07 Oct 2015

    Google Scholar 

  21. Reed, B., Junqueira, F.P.: A simple totally ordered broadcast protocol. In: proceedings of the 2nd Workshop on Large-Scale Distributed Systems and Middleware. ACM (2008)

    Google Scholar 

  22. Shi, X., et al.: GIRAFFE: a scalable distributed coordination service for large-scale systems. In: 2014 IEEE International Conference on Cluster Computing (CLUSTER), pp. 38–47, September 2014

    Google Scholar 

  23. Skeirik, S., Bobba, R.B., Meseguer, J.: Formal analysis of fault-tolerant group key management using ZooKeeper. In: Proceedings of the 13th IEEE/ACM International Symposium on Cluster, Cloud, and Grid Computing 2013, pp. 636–641, May 2013

    Google Scholar 

  24. Tribastone, M., Duguid, A., Gilmore, S.: The PEPA Eclipse Plugin. SIGMETRICS Perform. Eval. Rev. 36(4), 28–33 (2009)

    Article  Google Scholar 

  25. Zimmerman, J.: Apache zookeeper in netflix. http://techblog.netflix.com/2011/11/introducing-curator-netflix-zookeeper.html (2011). Accessed 19 Jan 2016

  26. Zookeeper, A.: Zookeeper: a distributed coordination service for distributed applications. https://zookeeper.apache.org/doc/trunk/zookeeperOver.html (2014). Accessed 16 Feb 2017

Download references

Author information

Authors and Affiliations

  1. Faculty of Science-Khoms, Elmergib University, Khoms, Libya

    Said Naser Said Kamil

  2. School of Computing, Newcastle University, Newcastle upon Tyne, UK

    Nigel Thomas

  3. Faculty of Science, Sebha University, Sebha, Libya

    Ibrahim Elsanosi

Authors
  1. Said Naser Said Kamil
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Nigel Thomas
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ibrahim Elsanosi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Said Naser Said Kamil .

Editor information

Editors and Affiliations

  1. Tsinghua University, Beijing, China

    Qianchuan Zhao

  2. Sun Yat-sen University, Guangzhou, China

    Li Xia

Rights and permissions

Reprints and permissions

Copyright information

© 2021 ICST Institute for Computer Sciences, Social Informatics and Telecommunications Engineering

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Kamil, S.N.S., Thomas, N., Elsanosi, I. (2021). Performance Evaluation of ZooKeeper Atomic Broadcast Protocol. In: Zhao, Q., Xia, L. (eds) Performance Evaluation Methodologies and Tools. VALUETOOLS 2021. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 404. Springer, Cham. https://doi.org/10.1007/978-3-030-92511-6_4

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-92511-6_4

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-92510-9

  • Online ISBN: 978-3-030-92511-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation