Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Code Block
languagejava
titleTopic Level Configs
    public static final String REMOTE_COPY_LAG_MS_CONFIG = "remote.copy.lag.ms";
    public static final String REMOTE_COPY_LAG_MS_DOC = "Controls how long to delay uploading segments to remote storage. " +
            "When set to 0 (default), segments are uploaded as soon as they are eligible (no delay). " +
            "When set to -1, theresolves value isto the effective <code>local.retention.ms</code> (maximum delay, or upload immediately when <code>local.retention.ms</code> is -1). " +
            "When set to a positive value (ms), a segment becomes eligible for upload only after the time since the latest record in the segment reaches the value. " +
            "The value should not exceed the effective <code>local.retention.ms</code> (local retention time) when the latter is non-negative.";

    public static final String REMOTE_COPY_LAG_BYTES_CONFIG = "remote.copy.lag.bytes";
    public static final String REMOTE_COPY_LAG_BYTES_DOC = "Controls size-based delay for uploading segments to remote storage. " +
            "When set to 0 (default), segments are uploaded as soon as they are eligible (no delay). " +
            "When set to -1, theresolves value isto the effective <code>local.retention.bytes</code> (maximum delay, or upload immediately when <code>local.retention.bytes</code> is -1). " +
            "When set to a positive value (bytes), a segment becomes eligible for upload only when the total bytes of log data after the segment reach the value. " +
            "The value should not exceed the effective <code>local.retention.bytes</code> (local retention size) when the latter is non-negative.";

(2) Two new server configuration items:  log.remote.copy.lag.ms and log.remote.copy.lag.bytes
If a user wants to enable the lazy copy behavior for all the topics (including the new ones), then they can set this broker level configs. Otherwise,
it will be hard for the user to create the new topics with these configs set when remote storage is enabled.

...