THIS IS A TEST INSTANCE. ALL YOUR CHANGES WILL BE LOST!!!!

Apache Kylin : Analytical Data Warehouse for Big Data

Page tree

Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

As we all know, Kylin 4.0 needs to build cube data before querying, so if the build jobs and query jobs are both running in one cluster, service may be unstable because of the resource preemption. 

...

  1. Install Kylin 4.0 by the following guide on Kylin server.
  2. Create a directory called 'build_hadoop_conf' in the $KYLIN_HOME and then copy the hadoop configuration files of the build cluster to this directory (Note: make sure copy the real configuration files not the symbolic links).
  3. Set  the value of the configuration 'kylin.engine.submit-hadoop-conf-dir' in the '$KYLIN_HOME/conf/kylin.properties' to the directory created in the step 2.
  4. Copy the hive-site.xml of the build cluster into the directory of the hive configuration on query cluster, for example: /etc/hive/conf.
  5. The value of the configuration 'kylin.engine.spark-conf.spark.yarn.queue' in the '$KYLIN_HOME/conf/kylin.properties' should be configured as the queue of the Yarn on build cluster.

...