Tom Kaszuba
Feb 29, 2024

Yeah, none of that is true. By default Kafka has infinite retention set on a topic. If you use compaction then there are specific rules around what gets deleted and when. You can also delete data in Kafka yourself by using tombstones or through the admin client. I've worked with Kafka retaining data with infinite retention for over 6 years and never encountered "accidental" purges. Kafka is as stable at data retention as any other database.

Tom Kaszuba
Tom Kaszuba

Written by Tom Kaszuba

Java, Scala and .Net Consultant with over 20 years experience in the Financial Industry, specializing in Big Data and Integration... and especially Kafka.

Responses (1)