This page is meant as a template for writing a KIP. To create a KIP choose Tools->Copy on this page and modify with your content and replace the heading with the next KIP number and a description of your issue. Replace anything in italics with your own description.

Status

Current state: Draft [One of "Under Discussion", "Accepted", "Rejected"]

Discussion thread: not yethere [Change the link from the KIP proposal email archive to your own email thread]

JIRA: KAFKA-4133

Please keep the discussion on the mailing list rather than commenting on the wiki (wiki discussions get unwieldy fast).

...

Public Interfaces

The following options option will be added to KafkaConfigs.java and can be configured as properties for Kafka clientsto for consumers to configure (in ConsumerConfigs.java):

1. max.in.flight.fetches (Integer) Specifies the maximum number of in-flight fetches the client consumer can make.

Proposed Changes

Update Fetcher.java to take into account the number of existing in-flight fetches before initiating a new fetch request. NetworkClient already tracks the total number of in-flight requests, so we'd just need to check this value when creating new fetches in Fetcher.createFetchRequests().

Compatibility, Deprecation, and Migration Plan

This KIP should be transparent to users not interested in setting this new configuration.

Rejected Alternatives

None so far