Skip to main content

Apache Kafka

  • Living reference work entry
  • Latest version View entry history
  • First Online:
Encyclopedia of Big Data Technologies

Abstract

Abstract Text

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Institutional subscriptions

Similar content being viewed by others

References

  • Apache Software Foundation (2017a) Apache Hadoop project web page. https://hadoop.apache.org/

  • Apache Software Foundation (2017b) Apache Kafka project web page. https://kafka.apache.org/

  • Apache Software Foundation (2017c) Apache Samza project web page. https://samza.apache.org/

  • Apache Software Foundation (2017d) Apache ZooKeeper project web page. https://zookeeper.apache.org/

  • Facebook Inc (2017) RocksDB project web page. http://rocksdb.org/

  • Goodhope K, Koshy J, Kreps J, Narkhede N, Park R, Rao J, Ye VY (2012) Building LinkedIn’s real-time activity data pipeline. IEEE Data Eng Bull 35(2):33–45. http://sites.computer.org/debull/A12june/pipeline.pdf

    Google Scholar 

  • Hunt P, Konar M, Junqueira FP, Reed B (2010) ZooKeeper: Wait-free coordination for internet-scale systems. In: Proceedings of the 2010 USENIX conference on USENIX annual technical conference, USENIX Association, Berkeley, CA, USA, USENIX ATC’10, pp 11–11, http://dl.acm.org/citation.cfm?id=1855840.1855851

  • Kleppmann M (2016) Making sense of stream processing, 1st edn. O’Reilly Media

    Google Scholar 

  • Kleppmann M (2017) Designing data-intensive applications. O’Reilly Media

    Google Scholar 

  • Kleppmann M, Kreps J (2015) Kafka, Samza and the Unix philosophy of distributed data. IEEE Data Eng Bull 38(4):4–14. http://sites.computer.org/debull/A15dec/p4.pdf

    Google Scholar 

  • Kreps J, Narkhede N, Rao J (2011) Kafka: a distributed messaging system for log processing. In: Proceedings of the NetDB, pp 1–7

    Google Scholar 

  • Noghabi SA, Paramasivam K, Pan Y, Ramesh N, Bringhurst J, Gupta I, Campbell RH (2017) Samza: stateful scalable stream processing at LinkedIn. Proc VLDB Endowment 10(12):1634–1645. https://doi.org/10.14778/3137765.3137770

    Article  Google Scholar 

  • Sax MJ, Wang G, Weidlich M, Freytag J (2018) Streams and tables: two sides of the same coin. In: Castellanos M, Chrysanthis PK, Chandramouli B, Chen S (eds) Proceedings of the international workshop on real-time business intelligence and analytics, BIRTE 2018, Rio de Janeiro, Brazil, August 27, 2018, ACM, New York, pp 1:1–1:10. https://doi.org/10.1145/3242153.3242155

  • Vavilapalli VK, Murthy AC, Douglas C, Agarwal S, Konar M, Evans R, Graves T, Lowe J, Shah H, Seth S, Saha B, Curino C, O’Malley O, Radia S, Reed B, Baldeschwieler E (2013) Apache Hadoop YARN: yet another resource negotiator. In: 4th ACM symposium on cloud computing (SoCC). https://doi.org/10.1145/2523616.2523633

  • Wang G, Koshy J, Subramanian S, Paramasivam K, Zadeh M, Narkhede N, Rao J, Kreps J, Stein J (2015) Building a replicated logging system with Apache Kafka. PVLDB 8(12):1654–1655. http://www.vldb.org/pvldb/vol8/p1654-wang.pdf

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Matthias J. Sax .

Editor information

Editors and Affiliations

Section Editor information

Rights and permissions

Reprints and permissions

Copyright information

© 2022 Springer Nature Switzerland AG

About this entry

Check for updates. Verify currency and authenticity via CrossMark

Cite this entry

Sax, M.J. (2022). Apache Kafka. In: Zomaya, A., Taheri, J., Sakr, S. (eds) Encyclopedia of Big Data Technologies. Springer, Cham. https://doi.org/10.1007/978-3-319-63962-8_196-2

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-63962-8_196-2

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-63962-8

  • Online ISBN: 978-3-319-63962-8

  • eBook Packages: Springer Reference MathematicsReference Module Computer Science and Engineering

Publish with us

Policies and ethics

Chapter history

  1. Latest

    Apache Kafka
    Published:
    10 March 2022

    DOI: https://doi.org/10.1007/978-3-319-63962-8_196-2

  2. Original

    Apache Kafka
    Published:
    10 February 2018

    DOI: https://doi.org/10.1007/978-3-319-63962-8_196-1