Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Code Block
languagejava
titleTopic Level Configs
    public static final String REMOTE_COPY_LAG_MS_CONFIG = "remote.copy.lag.ms";
    public static final String REMOTE_COPY_LAG_MS_DOC = "Controls how long to delay uploading segments to remote storage. " +
            "When set to 0 (default), segments are uploaded as soon as they are eligible (no delay check). " +
            "When set to a positive value (ms), a segment can't become eligible for upload util the time since the latest record in the segment reaches the value. " +
            "The value should not exceed the real local retention ms except the latter is save forever. " +
            "When set to -1, resolves to the real local retention ms (maximum delay, or no delay check when the retention is save forever). " +
            "For how the real local retention time is computed, see <code>local.retention.ms</code>.";

    public static final String REMOTE_COPY_LAG_BYTES_CONFIG = "remote.copy.lag.bytes";
    public static final String REMOTE_COPY_LAG_BYTES_DOC = "Controls size-based delay for uploading segments to remote storage. " +
            "When set to 0 (default), segments are uploaded as soon as they are eligible (no delay check). " +
            "When set to a positive value (bytes), a segment can't become eligible for upload util the total bytes of log data after the segment reach the value. " +
            "The value should not exceed the real local retention bytes except the latter is save forever. " +
            "When set to -1, resolves to the real local retention bytes (maximum delay, or no delay check when the retention is save forever). " +
            "For how the real local retention size is computed, see <code>local.retention.bytes</code>.";

(2) Two new dynamic server configuration items:  log.remote.copy.lag.ms and log.remote.copy.lag.bytes
If a user wants to enable the lazy copy behavior for all the topics (including the new ones), then they can set these broker-level dynamic configs. Otherwise,
it will be hard for the user to create the new topics with these configs set when remote storage is enabled. 

...