Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

We would focus on point 1 in this FLIP, and continue to discuss point2 and point 3 in the later FLIP.

Many Lookup table sources introduce cache to reduce the RPC call, such as JDBC, CSV, HBase connectors.

For those connectors, we could raise cache hit ratio by routing the same lookup keys to the same task instance. This is the purpose of this FLIP.

There are many similar requirements from user mail list and JIRA about hash Lookup Join, for example:

...