Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Gliffy Diagram
namePropagationWrapperIntro
pagePin1

Multiple Rapid Foreign-Key Value Changes -

...

Why a highwater table is required.

In this case, there are multiple, rapid changes made to the foreign-key of a single record. We The joiner will need to resolve which one is the correct final value. Records will arrive out of order due to a variety of reasons, such as a node crashing, congestion in the input partition or network latency.

Gliffy Diagram
nameHighwaterMarkUsage
pagePin3

...