PinnedTom KaszubaAvro Schema Evolution Strategies on KafkaIf you have spent any significant time with Avro (or Protbuf) and are using the Confluent Schema Registry you probably have encountered a…7 min read·Dec 25, 2020----
PinnedTom KaszubainThe StartupETL Batch Processing With Kafka?Kafka is most likely not the first platform you reach for when thinking of processing batched data. Most likely you’ve heard of Kafka…6 min read·Oct 2, 2020--3--3
PinnedTom KaszubaHard vs Soft deletes in KafkaThere are several ways on how to model a delete event in Kafka with each having their own advantages and disadvantages. While using…3 min read·Jan 23, 2024----
PinnedTom KaszubaSynchronize two lookup topics using foreign key joins in Kafka StreamsPart 1: The theory4 min read·Feb 13, 2024----
PinnedTom KaszubaHistorized SCD lookups with Range Queries in Kafka StreamsIntroduction7 min read·Feb 18, 2024----
Tom KaszubaThanks for this article.For me Kafka is a natural choice as the source of truth for a data lake but there are still many people that perceive this as an…1 min read·6 days ago----
Tom KaszubaHistorized SCD lookups with Versioned Stores and IQv2 in Kafka StreamsIntroduction5 min read·Feb 21, 2024----
Tom KaszubaThe curious case of missing headers in Kafka StreamsKIP-82 Introduced headers to Kafka and they’ve been a hit ever since. Headers allow you to pass metadata information such as logging…6 min read·Dec 25, 2022----
Tom KaszubaHow to sink a Kafka roll outHas management started to flirt with the idea of doing event sourcing and rolling out a Kafka cluster? Have you read up on the technology…6 min read·Nov 7, 2022----