...

Motivation

...

[1] https://dev.mysql.com/doc/refman/8.0/en/insert-optimization.html
[2] https://dev.mysql.com/doc/refman/8.0/en/load-data.html
[3] https://dev.mysql.com/doc/internals/en/bulk-insert.html

Proposed Changes

...

1. Implement distributed table (cache) lock - when it is held no other operation on cache is possible

2. Implement external sort - get some memory buffer, collect there values in some order, flush to disk if needed, merge in the end
3. Implement direct data load - write data to data blocks, re-created indexes with external sort and other necessary data structures in the end
4. Add necessary API to control direct data load mode 

Tickets