Versions Compared

Old Version 26

changes.mady.by.user Szehon Ho

Saved on

compared with

New Version 27

changes.mady.by.user Shannon Ladymon

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: (Added Hive 1.2.0 update for Parquet data type support)

...

Native Parquet support was added to Hive 0.13 via HIVE-5783. Please note that not all Parquet data types are supported yet. in this version.

Hive 1.2.0

Support for the remaining Parquet data types is being added through was added to Hive 1.2.0 via HIVE-6384. 

Hive QL Syntax

A CREATE TABLE statement can specify the Parquet storage format with syntax that depends on the Hive version.

...

No Format
CREATE TABLE parquet_test (
 id int,
 str string,
 mp MAP<STRING,STRING>,
 lst ARRAY<STRING>,
 strct STRUCT<A:STRING,B:STRING>) 
PARTITIONED BY (part string)
STORED AS PARQUET;

Limitations

...

  • Timestamp, decimal, char and varchar are not supported in Hive releases 0.10.0 through 0.13.1, but Hive 0.14.0 adds support for timestamp (HIVE-6394), decimal (HIVE-6367), char and varchar (HIVE-7735).
  • Column rename is supported with use of the flag parquet.column.index.access, starting with release 0.14.0 (HIVE-6938).
  • Create Table AS SELECT (CTAS) is supported starting with release 0.13.0 (HIVE-6375).
  • Parquet column names were case sensitive (query has to use column case that matches exactly what is in the metastore), but became case insensitive as of Hive 0.14.0 (HIVE-7554).

...