Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Table of Contents

This page is meant as a template for writing a KIP. To create a KIP choose Tools->Copy on this page and modify with your content and replace the heading with the next KIP number and a description of your issue. Replace anything in italics with your own description.

Status

Current state"DraftUnder Discussion"

Discussion thread: here [Change the link from the KIP proposal email archive to your own email thread]

...

This KIP introduces a way to list the client metrics configuration resources introduced by KIP-714. The client metrics configuration resources can be created, read, updated and deleted using the existing RPCs and the kafka-configs.sh tool, in common with all of the other configuration resources. There is, as yet, no way to list these resources. Some configuration resources, such as brokers, are singletons. Some are associated with other Kafka resources, such as topics. Client metrics configuration resources are named, but not associated with another Kafka resource, so there needs to be a way to list them.

Proposed Changes

The KIP adds a new RPC to the Kafka protocol called ListClientMetrics ListClientMetricsResources  which responds with a list of the client metrics configuration resources. It also adds AdminClient.listClientMetricslistClientMetricsResources to provide a programming interface for building tools to list client metrics configuration resources.

As an example, you could get the configuration for all of the client metrics resources using two calls:

Code Block
AdminClient.listClientMetricsResources()
AdminClient.describeConfigs(Collection<ConfigResource>)


Public Interfaces

This KIP introduces support for obtaining a list of client metrics configuration resources to the Kafka protocol and admin client.

Kafka Protocol

...

ListClientMetricsResources RPC

Code Block
{
  "apiKey": XX,
  "type": "request",
  "listeners": ["broker", "zkBroker", "controller"],
  "name": "ListClientMetricsRequestListClientMetricsResourcesRequest",
  "validVersions": "0",
  "flexibleVersions": "0+",
  "fields": [
  ]}
}

{
  "apiKey": XX,
  "type": "response",
  "name": "ListClientMetricsResponseListClientMetricsResourcesResponse",
  "validVersions": "0",
  "flexibleVersions": "0+",
  "fields": [
      { "name": "ThrottleTimeMs", "type": "int32", "versions": "0+",
        "about": "The duration in milliseconds for which the request was throttled due to a quota violation, or zero if the request did not violate any quota." },
      { "name": "ErrorCode", "type": "int16", "versions": "0+" },
      { "name": "ClientMetricsClientMetricsResources", "type": "[]ClientMetricsListClientMetricsResourcesList", "versions": "0+", "fields": [
        { "name": "Name", "type": "string", "versions": "0+" }
    ]}
  ]
}

...

Code Block
languagejava
   /**
    * List the client metrics configuration resources available in the cluster.
    *
    * @param options The options to use when listing the client metrics resources.
    * @return The ListClientMetricsResultListClientMetricsResourcesResult.
    */
   ListClientMetricsResultListClientMetricsResourcesResult listClientMetricslistClientMetricsResources(ListClientMetricsOptionsListClientMetricsResourcesOptions options);

   /**
    * List the client metrics configuration resources available in the cluster with the default options.
    * <p>
    * This is a convenience method for {@link #listClientMetrics#listClientMetricsResources(ListClientMetricsOptionsListClientMetricsResourcesOptions)}
    * with default options.
    * See the overload for more details.
    *
    * @return The ListClientMetricsResultListClientMetricsResourcesResult.
    */
   default ListClientMetricsResultListClientMetricsResourcesResult listClientMetricslistClientMetricsResources() {
      return listClientMetricslistClientMetricsResources(new ListClientMetricsOptionsListClientMetricsResourcesOptions());
   }

The options are defined as follows:

Code Block
package org.apache.kafka.client.admin;

/**
 * Options for {@link Admin#listClientMetricsAdmin#listClientMetricsResources()}.
 *
 * The API of this class is evolving, see {@link Admin} for details.
 */
@InterfaceStability.Evolving
public class ListClientMetricsOptionsListClientMetricsResourcesOptions extends AbstractOptions<ListClientMetricsOptions>AbstractOptions<ListClientMetricsResourcesOptions> {
}

The result is defined as follows:

Code Block
package org.apache.kafka.clients.admin;

/**
 * The result of the {@link Admin#listClientMetricsAdmin#listClientMetricsResources()} call.
 * <p>
 * The API of this class is evolving, see {@link Admin} for details.
 */
@InterfaceStability.Evolving
public class ListClientMetricsResultListClientMetricsResourcesResult {
    /**
     * Returns a future that yields either an exception, or the full set of client metrics
     * resource listings.
     *
     * In the event of a failure, the future yields nothing but the first exception which
     * occurred.
     */
    public KafkaFuture<Collection<ClientMetricsListing>>KafkaFuture<Collection<ClientMetricsResourceListing>> all() {
    }
}

And finally the listing itself, which is initially only the name:

Code Block
package org.apache.kafka.clients.admin;

@InterfaceStability.Evolving
public class ClientMetricsListingClientMetricsResourceListing {
    private final String idname;

    public ClientMetricsListingClientMetricsResourceListing(
        String name
    ) {
        this.name = name;
    }

    public String name() {
        return name;
    }
}

Security

Client metrics subscriptions configuration resources are secured using the CLUSTER resource.

API Request

Resource

ACL operation

ListClientMetricsListClientMetricsResources

CLUSTER

DESCRIBE_CONFIGS

Compatibility, Deprecation, and Migration Plan

...