...
Discussion thread: here
JIRA: KAFKA-1981
Released: <Kafka Version> 0.10.1.0
Motivation
Currently Kafka's log compaction gives minimal control over what portion of the log remains uncompacted. There is a setting that prevents compaction until a certain dirty ratio has been reached but this does not provide any upper bound on how much of the log's head will remain uncompacted once it runs. Although the segment currently being written will never be compacted, this could leave as little as one message uncompacted.
...