Versions Compared

Old Version 17

changes.mady.by.user Jiangjie Qin

Saved on

compared with

New Version 18

changes.mady.by.user Jiangjie Qin

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Image RemovedImage Added

  1. Users invoke Table.invalidateCache()
    1. Clients remove the intermediate result entry from local metadata.
  2. Clients send RPC to each TM Dispatcher to delete the corresponding result partition.
  3. Dispatcher forwards the result partition deletion request to ResourceManager
  4. ResourceManager sends RPC to each TaskManager hosting the result partitions to release them.

If a Task Manager instance fails, Flink will bring it up again. However, all the intermediate result which has a partition on the failed TM will become unavailable.

...