PinnedAvro Schema Evolution Strategies on KafkaIf you have spent any significant time with Avro (or Protbuf) and are using the Confluent Schema Registry you probably have encountered a…Dec 25, 2020Dec 25, 2020
PinnedPublished inThe StartupETL Batch Processing With Kafka?Kafka is most likely not the first platform you reach for when thinking of processing batched data. Most likely you’ve heard of Kafka…Oct 2, 20203Oct 2, 20203
PinnedHard vs Soft deletes in KafkaThere are several ways on how to model a delete event in Kafka with each having their own advantages and disadvantages. While using…Jan 23, 2024Jan 23, 2024
PinnedSynchronize two lookup topics using foreign key joins in Kafka StreamsPart 1: The theoryFeb 13, 2024Feb 13, 2024
Thanks for this article.For me Kafka is a natural choice as the source of truth for a data lake but there are still many people that perceive this as an…Apr 29, 2024Apr 29, 2024
Historized SCD lookups with Versioned Stores and IQv2 in Kafka StreamsIntroductionFeb 21, 2024Feb 21, 2024
The curious case of missing headers in Kafka StreamsKIP-82 Introduced headers to Kafka and they’ve been a hit ever since. Headers allow you to pass metadata information such as logging…Dec 25, 20221Dec 25, 20221
How to sink a Kafka roll outHas management started to flirt with the idea of doing event sourcing and rolling out a Kafka cluster? Have you read up on the technology…Nov 7, 2022Nov 7, 2022