Current state: Under Discussion
Discussion thread: https://lists.apache.org/thread/953fzz19pttr3nv4syt3br88lymgjfz0
JIRA or Github Issue: https://github.com/apache/incubator-doris/issues/9847
Released: <Doris Version>
During load process, the same operation are performed on all replicas such as sort and aggregation, which are resource-intensive. Concurrent data load would consume much CPU and memory resources.
Advantage:
Reduce the usage of CPU and Memory for load.
Disadvantage:
During load process, one replica should be chosen as Master and other replicas as Slave for each tablet. We will perform write process (writing data into MemTable and then data flush) on master replica and synchronizie segment files to slave replicas before transaction finished.
The basic architecture is as following:
