Versions Compared

Old Version 21

changes.mady.by.user Mang Zhang

Saved on

compared with

New Version 22

changes.mady.by.user Mang Zhang

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Code Block
languagesql
titlesyntax
CREATE TABLE ctas_hudi
 (
 	id BIGINT,
 	name STRING,
 	age INT
 )
 WITH ('connector.type' = 'hudi');

INSERT INTO ctas_hudi SELECT id, name, age FROM hive_catalog.default.test WHERE mod(id, 10) = 0;

Public API Changes

Table Environment

Providing method that are used to execute CTAS for Table API user.

@PublicEvolving
public interface TableEnvironment {
    /**
     * Registers the given {@link Table}'s result as a catalog table with {@link TableDescriptor}'s options.
     *
     * <p> CTAS for Table API.
     *
     * <p>Examples:
     *
     * <pre>{@code
     * Map<String, String> options = new HashMap<String, String>();
     * options.put("connector.type", "hudi");
     * tEnv.createTable("MyTable", options, tEnv.sqlQuery("select id, name from user_table"));
     * }</pre>
     *
     * @param path The path under which the table will be registered. See also the {@link
     *     TableEnvironment} class description for the format of the path.
     * @param options Table options.
     * @param query The {@link Table} object describing the pipeline for further transformations.
     */
     void createTable(String path, Map<String, String> options, Table query);
}

Program research

I investigated other bigdata engine implementations such as hive, spark:

...

Users need to be clear about their business needs and set the table options correctly.

Public API Changes

Table Environment

Providing method that are used to execute CTAS for Table API user.

@PublicEvolving
public interface TableEnvironment {

...

.

...

Compatibility, Deprecation, and Migration Plan

...