...

curl --location-trusted -u root -T date -H "label:123" http://abc.com:8030/api/test/date/_load

Overview

How to Load

Users only need to execute an HTTP request with the dataset-related table creation information to complete:

• Verification of user import permissions.
• Creation of a Paimon table according to the table creation information.
• Reading of the uploaded file, data segmentation according to specified separators, followed by batch data import.
• Execution of filtering and adjustment of column positions.

Signature parameters

curl --location-trusted -u user:passwd [-H ""...] -T data.file -XPUT http://load_host:http_port/api/{db}/{table}/_load

...

• Status: Import completion status.
• NumberTotalRows: Total number of rows processed during import.
• NumberFilteredRows: Number of rows that do not meet data quality standards.
• NumberUnselectedRows: Number of rows filtered by the WHERE condition.
• LoadTimeMs: Import completion time. Unit: milliseconds.

Proposed Changes

In the context of implementing different data format writing, the WriteStrategy interface provides a blueprint for writing operation and schema retrieval. Implementing classes would provide the specific logic for handling different data formats. For example, a CsvWriteStrategy class might implement WriteStrategy to handle CSV files, parsing the content string based on the provided columnSeparator and writing it out in the CSV format. Similarly, JsonWriteStrategy and ExcelWriteStrategy could be implemented for JSON and Excel formats, respectively. Each of these would handle the peculiarities of their respective formats, such as handling JSON objects or Excel cells and rows.

public interface WriteStrategy extends Serializable {

    void writer(BatchTableWrite batchTableWrite, String content, String columnSeparator)
            throws Exception;

    Schema retrieveSchema() throws Exception;
}

Compatibility, Deprecation, and Migration Plan

No

Test Plan

UT and IT

Compatibility, Deprecation, and Migration Plan

This is a new additional feature.

...