...
- All data stored in the single partition file will be transmitted within single batch (equal to partition file) much faster and without the serealization\deserialization overhead. To roughly estimate the superiority of partition file transmitting using network sockets the native Linux
scp\rsync
commands can be used. The test environment showed us results – 270MB\s
over the current 40MB\s
rebalance speed.; - The zero-copy file transmission can be used [1]. The contents of a file can be transmitted without copying them through the user space. Internally, it depends on the underlying operating system's support for zero copy. For instance, in UNIX and various flavors of Linux, the Java method
FileChannel.transfertTo()
call is routed to the sendfile()
system call;
...
{"serverDuration": 116, "requestCorrelationId": "616bd462c0020533"}