Versions Compared

Old Version 10

changes.mady.by.user Jiangjie Qin

Saved on

compared with

New Version 11

changes.mady.by.user Jiangjie Qin

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

The cache service will serve as a storage for both cache and shuffle data. This means both the storage tier and the RPC protocol will support SubPartitions.

Future works

Make cache service pluggable

  • In some cases, users may want to plugin their own cache service. In the future, we could add support for that.
  • Some API changes will be needed to support customized cache service. We will start another FLIP to discuss that. The change should not be much. Curious readers can read the google doc for some idea.

Compatibility, Deprecation, and Migration Plan

...