PinnedAvro Schema Evolution Strategies on KafkaIf you have spent any significant time with Avro (or Protbuf) and are using the Confluent Schema Registry you probably have encountered a…Dec 25, 2020Dec 25, 2020
PinnedPublished inThe StartupETL Batch Processing With Kafka?Kafka is most likely not the first platform you reach for when thinking of processing batched data. Most likely you’ve heard of Kafka…Oct 2, 20203Oct 2, 20203
PinnedHard vs Soft deletes in KafkaThere are several ways on how to model a delete event in Kafka with each having their own advantages and disadvantages. While using…Jan 23Jan 23
PinnedSynchronize two lookup topics using foreign key joins in Kafka StreamsPart 1: The theoryFeb 13Feb 13
Thanks for this article.For me Kafka is a natural choice as the source of truth for a data lake but there are still many people that perceive this as an…Apr 29Apr 29
The curious case of missing headers in Kafka StreamsKIP-82 Introduced headers to Kafka and they’ve been a hit ever since. Headers allow you to pass metadata information such as logging…Dec 25, 2022Dec 25, 2022
How to sink a Kafka roll outHas management started to flirt with the idea of doing event sourcing and rolling out a Kafka cluster? Have you read up on the technology…Nov 7, 2022Nov 7, 2022