Extra 11: Introduction to Apache Kafka

  • needs to be ledger over just a stream

  • horizontal scaling

  • Kafka - Event Ledge
    • Distributed Commit Log

  • Records
    • tuple (key, value, timestamp)
    • Immutable, Append Only, Persisted

  • Producers and Consumers

  • Topics can contain multiple partitions

  • Offsets

  • Delivery Guarantees

  • Akka Streams

  • aggregating from Kafka