PinnedTom KaszubaAvro Schema Evolution Strategies on KafkaIf you have spent any significant time with Avro (or Protbuf) and are using the Confluent Schema Registry you probably have encountered a…Dec 25, 2020Dec 25, 2020
PinnedTom KaszubainThe StartupETL Batch Processing With Kafka?Kafka is most likely not the first platform you reach for when thinking of processing batched data. Most likely you’ve heard of Kafka…Oct 2, 20203Oct 2, 20203
PinnedTom KaszubaHard vs Soft deletes in KafkaThere are several ways on how to model a delete event in Kafka with each having their own advantages and disadvantages. While using…Jan 23Jan 23
PinnedTom KaszubaSynchronize two lookup topics using foreign key joins in Kafka StreamsPart 1: The theoryFeb 13Feb 13
Tom KaszubaThanks for this article.For me Kafka is a natural choice as the source of truth for a data lake but there are still many people that perceive this as an…Apr 29Apr 29
Tom KaszubaHistorized SCD lookups with Versioned Stores and IQv2 in Kafka StreamsIntroductionFeb 21Feb 21
Tom KaszubaThe curious case of missing headers in Kafka StreamsKIP-82 Introduced headers to Kafka and they’ve been a hit ever since. Headers allow you to pass metadata information such as logging…Dec 25, 2022Dec 25, 2022
Tom KaszubaHow to sink a Kafka roll outHas management started to flirt with the idea of doing event sourcing and rolling out a Kafka cluster? Have you read up on the technology…Nov 7, 2022Nov 7, 2022