Apache Kylin : Analytical Data Warehouse for Big Data
Page History
...
| Conf key | Explanation | Example | ||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| kylin.dictionary.mr-hive.database | Which database will the Hive Global Dictionary in. | default | ||||||||
| kylin.dictionary.mr-hive.columns | A list, contain all columns which need a Hive Global Dictionary, in a {TABLE_NAME}_{COLUMN_NAME} pattern. | KYLIN_SALES_SALES_ID,KYLIN_SALES_BUYER_ID | ||||||||
| kylin.dictionary.mr-hive.table.suffix | Suffix for Segment Dictionary Table and Global Dictionary Table | _global_dict | ||||||||
| kylin.dictionary.mr-hive.intermediate.table.suffix | Suffix for Distinct Value Table | _group_by | ||||||||
| kylin.dictionary.mr-hive.columns.reduce.num | A key/value structure(or a map), which key is {TABLE_NAME}_{COLUMN_NAME}, and value is number for expected reducers in Build Segment Level Dictionary (MR job Parallel Part Build). | KYLIN_SALES_SALES_ID:3,KYLIN_SALES_BUYER_ID:2 | ||||||||
| kylin.source.hive.databasedir | The location of Hive table in HDFS. In Kylin 3.1.1, this configuration were removed (see
| /user/hive/warehouse/lacus.db | ||||||||
| kylin.dictionary.mr-hive.ref.columns | To reuse other global dictionary(s), you can specific a list here, to refer to some existent global dictionary(s) built by another cube. | KYLIN_SALES_SALES_ID,KYLIN_SALES_BUYER_ID |
...
| Step Name | Duration EST | Data size |
|---|---|---|
Create Intermediate Flat Hive Table | ||
Build Hive Global Dict - extract distinct value | ||
Redistribute Flat Hive Table | ||
Build Hive Global Dict - parallel part build | ||
Build Hive Global Dict - parallel total build | ||
Build Hive Global Dict - merge to dict table | ||
Build Hive Global Dict - replace intermediate table | ||
Extract Fact Table Distinct Columns | ||
Build Dimension Dictionary | ||
Extract Dictionary from Global Dictionary(When shrunken dictionary enabled) | ||
Build Base Cuboid -l | ||
| Total | ||
| Comment |
Part IV Reference
...
Overview
Content Tools
ThemeBuilder
Apps