KAF-143: Remove Diffusion Topic(s) When a Kafka Null-Value Record (Tombstone) Is Consumed and a Tombstone Action Is Configured
A Kafka tombstone is a consumer record with a null value that marks a key as deleted on a compacted Kafka topic. Kafka adapter subscription services can now be configured to remove the corresponding Diffusion topic(s) when a tombstone is consumed using the new tombstoneAction. Settings available:
- IGNORE - the tombstone is discarded and no Diffusion topics are removed (default).
- REMOVE_TOPIC - removes the Diffusion topic based upon the resolved diffusionTopicPattern.
- REMOVE_DESCENDANTS - removes the topics beneath the resolved diffusionTopicPattern, leaving that topic in place.
- REMOVE_BRANCH - removes the topic resolved by diffusionTopicPattern and all Diffusion topics beneath it.
The default setting is IGNORE, so existing subscription services behave as before and no Diffusion topic removals are performed.
KAF-137: Cached Key-based Diffusion Topic Name Lookups Never Released Causing Potential Memory Leak
This version of the Kafka adapter fixes a potential memory leak where cached Diffusion topic name lookups were never released, causing unbounded memory growth for services using key-based Diffusion topic patterns.