Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

When an AD stream is marked as bootstrap, it guarantees that an initial snapshot is built before processing of input streams starts; otherwise input stream and AD streams are processed at the same time. After bootstrap, for change capture data, we keep updating its AD store when new updates arrives.

The handling of bootstrap is different for streams associated with persistent and non-persistent stores

  • for persistent stores, the underlying store is checked during startup. A bootstrap is forced if the store is not available or not valid (e.g. too old)
  • for non-persistent stores, bootstrap is always forced

Key and Value

By Default, we use the key and value in IncomingMessageEnvelop to store an AD data item in a store, user provides serde as done today. Configuration options will be provided to allow user to

...