...

The Apache Ignite cluster balance procedure with enabled persitence currently doesn't utilize network and storage device throughout to its full extent. The balance procedure processes cache data entries one by one which is not efficient enough for the cluster with enabled persistence.

Competitive Analysis

Please, see details:

Profiling current

...

balancing procedure

• Process limitations overview
• Profiling current processThe rebalance

Rebalance procedure optimizations

• Sending cache partitions
• Cache batch insert\update
• Streaming cache data

Proposed Changes

The Apache Ignite can support cache rebalancing as transferring partition files using zero copy algorithm [1] based on an extension of communication SPI and Java NIO API.

...