Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

To address (2), the producer maintains a staleness duration threshold for every topic, but it does not act upon this for metadata fetching, instead falls back to fetching information about all recently used topics in the cluster. Further optimization could be done to only request metadata updates for topics whose staleness thresholds have been exceeded. A soft threshold could also be added such that best-effort fetching could be performed on a subset of the topics, so that metadata updates are staggered over time and performed in smaller batches.

...