...

Implementation

Write Implementation

How

...

batch operation works

We use concurrrency to achive the batch operation.

 We use concurrrency to achive the batch operation. .Main class hudiimport is used to import the rdd dataset to hudi.what the proceduce is import?
(1)We apply the fileparse class to parse the file which we need to import such as txt,csv,tsv.At the same time we define the badfileparseexception to handle the bad file when the file have the problem.
(2)We apply the lineparse class to parse the command line.At the same time we define the badparselineexception to the bad command line.
(3)We apply the multithreading to run fileparse class to batch processing to accelerate the import process.

Hudi provide two standard command lines which hudiimport and hudiexport to realize data batch operation.

...