Skip to main content

The Broker: Apache Kafka

  • Chapter
  • First Online:

Abstract

The goal of this chapter is to get you familiar with Apache Kafka and show you how to solve the consumption of millions of messages in a pipeline architecture. Here we show some Scala examples to give you a solid foundation for the different types of implementations and integrations for Kafka producers and consumers.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   29.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   39.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Notes

  1. 1.

    https://engineering.linkedin.com/blog/2016/04/kafka-ecosystem-at-linkedin

  2. 2.

    http://www.datanami.com/2015/10/05/how-uber-uses-spark-and-hadoop

  3. 3.

    https://blog.twitter.com/2015/handling-five-billion-sessions-a-day-in-real-time

  4. 4.

    http://techblog.netflix.com/2013/12/announcing-suro-backbone-of-netflixs.html

  5. 5.

    http://www.meetup.com/stockholm-hug/events/121628932/

  6. 6.

    The complete list is in http://kafka.apache.org/documentation.html#brokerconfigs

  7. 7.

    The complete list is in http://kafka.apache.org/documentation.html#producerconfigs

  8. 8.

    The complete list is in http://kafka.apache.org/documentation.html#consumerconfigs

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Raul Estrada and Isaac Ruiz

About this chapter

Cite this chapter

Estrada, R., Ruiz, I. (2016). The Broker: Apache Kafka. In: Big Data SMACK. Apress, Berkeley, CA. https://doi.org/10.1007/978-1-4842-2175-4_8

Download citation

Publish with us

Policies and ethics