...

Current state: Under Discussion

Discussion thread: here

JIRA: KAFKA-2063

Please keep the discussion on the mailing list rather than commenting on the wiki (wiki discussions get unwieldy fast).

...

This KIP proposes to introduce new version of fetch request with new parameter "limit_bytes" to limit the size of fetch response and solve above problem. The per-partition limit is removed from fetch request.

Public Interfaces

This KIP introduces:

• New fetch request (v.3) with a global response limit and without per-partition limit
• New client-side config parameter fetch.limit.bytes - global fetch size limit
• New replication config parameter replica.fetch.limit.bytes - limit used by replication thread
• New server-side config parameter fetch.partition.max.bytes - maximum per-partition server side limit when serving new fetch request
• New inter-broker protocol version "0.11.0-IV0" - starting from this version brokers will use fetch request v.3 for replication 

...