Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

we have two 5-second windows but the key by which the operations work is different. Since the timestamp for elements that result from the first window operations is the minimum of the timestamps inside the window the resulting element would also be in that same window. Since we have windows based on timestamps the windows are aligned. Therefore, the result of a window from t to  to t + 5 will also be in the window from t to  to t + 5 in  in the second window operation.

Technically speaking, if you have an element with timestamp t and  and windows of size size duration (both in milliseconds) the start of the window that this element is in is given by t - (t mod duration). The same applies to sliding time windows on timestamp time. 

(This does not show how we re-partition the data after the first window operation, need to think about this picture.)

Image Added

Accessing the Timestamp of an Element

Still TBD, this is a first idea.

...

Other windows

Staging buffer