...

• `uncleanable-partitions-count` (Int) - Count of partitions that are uncleanable per logDir
• `uncleanable-bytes` (Long) - The current number of uncleanable bytes. This is the sum of uncleanable bytes for every uncleanable partition

New broker config value:

• `log.cleaner.max.uncleanable.bytes` - the maximum amount of uncleanable megabytes a single LogDir can have before it is marked as offline. Default value is set to 10GB (value of 10000000000)

Proposed Changes

Catch any unexpected (non-IO) exceptions in `CleanerThread#cleanOrSleep()`.

...

When evaluating which logs to compact, skip the marked as uncleanable ones.Introduce new cluster-level configurable value - `log.cleaner.max.uncleanable.bytes`. When the sum of uncleanable bytes for all marked partitions reaches this threshold, mark the disk  are on as offline. (this most likely indicates a problem with the disk itself)

Compatibility, Deprecation, and Migration Plan

...