Apache Kylin : Analytical Data Warehouse for Big Data
Page History
...
- Object storage such as S3 are not well tested, and is tagged as experimental feature, and performance is not good as HDFS. So it is not recommend in production env without a storage cache layer (such as Alluxio).
- When using Standalone as cluster manager, Kylin 4.0.0 only support client as deployMode .
- Please configure proper kylin.engine.spark-conf.spark.sql.hive.metastore.version, kylin.engine.spark-conf.spark.sql.hive.metastore.jars, kylin.engine.spark-conf.spark.sql.hive.metastore.version, kylin.query.spark-conf.spark.sql.hive.metastore.jars; please check http://spark.apache.org/docs/latest/configuration.html or http://spark.apache.org/docs/latest/sql-data-sources-hive-tables.html for detail (spark connect to hive).
- In some Hadoop platform or custom Hadoop(version) combination, you may still face some class conflict issue. Some of them are related with hive lib/jars. Please report them to user mailing list to find a solution.
- In Hadoop 3.X env, you may find Kylin didn't print logger output into 'kylin.log', and only part of them exists in 'kylin.out'. This is usually caused by Slf4j did't work as expected, I suggested you to copy 'log4j-1.2.17.jar' and 'slf4j-log4j12-1.7.25.jar' (these two jars maybe found under $SPARK_HOME/jars) into $KYLIN_HOME/ext and restart Kylin instance. You can found some output like 'SLF4J: Class path contains multiple SLF4J bindings.' in 'kylin.out'.
- Class conflict may happen in some Hadoop Platform we didn't tested, some user has reported them, here are some related issues :
andJira server ASF JIRA serverId 5aa69414-a9e9-3523-82ec-879b028fb15b key KYLIN-5073
. If you faced these troubles, please try to check comment under these issues before open a JIRA issue.Jira server ASF JIRA serverId 5aa69414-a9e9-3523-82ec-879b028fb15b key KYLIN-5069 - If you faced "java.lang.NoSuchMethodError: org.apache.hadoop.hive.metastore.HiveMetaStoreClient.<init>(Lorg/apache/hadoop/hive/conf/HiveConf;)V " when you are using Hive 3.X, please try to check this issue :
for solution.Jira server ASF JIRA serverId 5aa69414-a9e9-3523-82ec-879b028fb15b key KYLIN-5084
Kylin 4.0.1 Support Matrix
...
Overview
Content Tools
ThemeBuilder
Apps