Apache Kylin : Analytical Data Warehouse for Big Data
Welcome to Kylin Wiki.
| Module | Property | Default Value | Optional Value | Description |
|---|---|---|---|---|
kylin.env | DEV | QA, PROD, LOCAL | The environment of Kylin. DEV will turn on some dev features, QA and PROD has no difference in terms of functions. | |
kylin.env.hdfs-working-dir | /kylin | Working folder in HDFS, better be qualified absolute path, make sure user has the right permission to this directory | ||
kylin.env.zookeeper-base-path | /kylin | kylin zk base path | ||
kylin.env.zookeeper-is-local | false | Run a TestingServer for curator locally | ||
kylin.env.zookeeper-connect-string | sandbox.hortonworks.com | Connect to a remote zookeeper with the url, should set kylin.env.zookeeper-is-local to false | ||
kylin.env.hadoop-conf-dir | /etc/hadoop/conf | Hadoop conf folder, will export this as "HADOOP_CONF_DIR" to run spark-submit. This must contain site xmls of core, yarn, hive, and hbase in one folder | ||
kylin.env.hdfs-metastore-bigcell-dir | kylin.env.hdfs-metastore-bigcell-dir | |||
kylin.env.zookeeper-base-sleep-time | 3000 | |||
kylin.job.zookeeper-monitor-interval | 30 | |||
kylin.env.zookeeper.zk-auth | digest:ADMIN:KYLIN | |||
kylin.env.zookeeper-acl-enabled | false | |||
kylin.metadata.url | kylin_metadata@hbase | The metadata store in hbase | ||
kylin.metadata.sync-retries | 3 | metadata cache sync retry times | ||
kylin.metadata.sync-error-handler | MockupErrHandler | |||
kylin.server.mode | all | query, job | Kylin server mode, valid value [all, query, job] | |
kylin.server.cluster-servers | localhost:7070 | List of web servers in use, this enables one web server instance to sync up with other servers. | ||
kylin.server.query-metrics-percentiles-intervals | 60, 360, 3600 | kylin query metrics percentiles intervals default=60, 300, 3600 | ||
kylin.server.host-address | localhost:7070 | get server rest address | ||
kylin.server.cluster-name | ||||
kylin.server.init-tasks | ||||
kylin.server.sequence-sql.workers-per-server | 1 | |||
kylin.server.sequence-sql.expire-time | 86400000 | |||
kylin.server.query-metrics-enabled | false | |||
kylin.server.query-metrics2-enabled | false | |||
kylin.server.auth-user-cache.expire-seconds | 300 | |||
kylin.server.auth-user-cache.max-entries | 100 | |||
kylin.server.external-acl-provider | ||||
kylin.server.cluster-servers-with-mode | ||||
kylin.storage.hbase.owner-tag | whoami@kylin.apache.org | Optional information for the owner of kylin platform, it can be your team's email, Currently it will be attached to each kylin's htable attribute | ||
kylin.storage.url | hbase | The storage for final cube file in hbase | ||
kylin.storage.hbase.cluster-fs | HBase Cluster FileSystem, which serving hbase, format as hdfs://hbase-cluster:8020, Leave empty if hbase running on same cluster with hive and mapreduce | |||
kylin.storage.hbase.compression-codec | gzip | default compression codec for htable,snappy,lzo,gzip,lz4 | ||
| kylin.storage.hbase.namespace | default | |||
kylin.storage.hbase.cluster-hdfs-config-file | ||||
kylin.storage.hbase.region-cut-gb | 0.1 | The cut size for hbase region, in GB. E.g, for cube whose capacity be marked as "SMALL", split region per 10GB by default | ||
kylin.storage.hbase.min-region-count | 1 | |||
kylin.storage.hbase.max-region-count | 500 | |||
kylin.storage.hbase.hfile-size-gb | 2 | The hfile size of GB, smaller hfile leading to the converting hfile MR has more reducers and be faster. set 0 to disable this optimization | ||
kylin.storage.hbase.run-local-coprocessor | false | |||
kylin.storage.hbase.coprocessor-mem-gb | 3.0 | |||
kylin.storage.partition.aggr-spill-enabled | true | |||
kylin.storage.partition.max-scan-bytes | 3L * 1024 * 1024 * 1024 | |||
kylin.storage.hbase.coprocessor-timeout-seconds | 0 | |||
kylin.storage.hbase.max-fuzzykey-scan | 200 | |||
kylin.storage.hbase.max-fuzzykey-scan-split | 1 | |||
kylin.storage.hbase.max-visit-scanrange | 1000000 | |||
kylin.storage.hbase.gtstorage | org.apache.kylin.storage.hbase.cube.v2.CubeHBaseEndpointRPC | |||
kylin.storage.hbase.scan-cache-rows | 1024 | |||
kylin.storage.hbase.region-cut-gb | 5.0 | |||
kylin.storage.hbase.max-scan-result-bytes | 5 * 1024 * 1024 | |||
kylin.storage.hbase.compression-codec | none | |||
kylin.storage.hbase.rowkey-encoding | FAST_DIFF | |||
kylin.storage.hbase.block-size-bytes | 1048576 | |||
kylin.storage.hbase.small-family-block-size-bytes | 65536 | |||
kylin.storage.hbase.endpoint-compress-result | true | |||
kylin.storage.hbase.max-hconnection-threads | 2048 | |||
kylin.storage.hbase.core-hconnection-threads | 2048 | |||
kylin.storage.hbase.hconnection-threads-alive-seconds | 60 | |||
kylin.storage.hbase.replication-scope | 0 | |||
kylin.storage.clean-after-delete-operation | false | |||
kylin.storage.project-isolation-enable | true | |||
kylin.storage.limit-push-down-enabled | true | |||
kylin.storage.provider | org.apache.kylin.common.storage.DefaultStorageProvider | |||
kylin.storage.columnar.shard-size-mb | 128 | |||
kylin.storage.columnar.shard-rowcount | 2500000 | |||
kylin.storage.columnar.shard-countdistinct-rowcount | 1000000 | |||
kylin.storage.columnar.repartition-threshold-size-mb | 128 | |||
kylin.storage.columnar.shard-min | 1 | |||
kylin.storage.columnar.shard-max | 1000 | |||
kylin.storage.columnar.hdfs-blocksize-bytes | 5 * shard_size | |||
kylin.storage.columnar.shard-expand-factor | 10 | |||
kylin.storage.columnar.dfs-replication | 3 | |||
kylin.storage.columnar.jdbc.file-system | ||||
kylin.storage.default | 2 | |||
kylin.storage.hbase.table-name-prefix | KYLIN_ | |||
Configurations remained from Kylin3.x
| Module | Property | Description |
|---|---|---|
Configurations removed from Kylin3.X
| Module | Property | Description |
|---|---|---|
New configurations
| Module | Property | Description |
|---|---|---|
Overview
Content Tools
ThemeBuilder
Apps