THIS IS A TEST INSTANCE. ALL YOUR CHANGES WILL BE LOST!!!!
...
| Code Block | ||
|---|---|---|
| ||
#livy has one bug (https://issues.cloudera.org/browse/LIVY-94), so we need to make these three jars in spark classpath datanucleus-api-jdo-3.2.6.jar datanucleus-core-3.2.10.jar datanucleus-rdbms-3.2.9.jar |
Setup Dev Env
...
Git clone
| Code Block | ||
|---|---|---|
| ||
git clone https://github.com/apache/incubator-griffin.git |
build
| Code Block | ||
|---|---|---|
| ||
cd incubator-griffin
mvn clean install -DskipTests |
dev
Project layout
There are three modules in griffin
...
| Code Block | ||
|---|---|---|
| ||
#spring boot app org.apache.griffin.core.GriffinWebApplication |
ui : front end
...
Update several files to reflect your dev env
...
create a griffin working directory in hdfs
...
| Code Block | ||
|---|---|---|
| ||
sparkJob.file = hdfs://<griffin measureworking path>directory>/griffin-measure.jar sparkJob.args_1 = hdfs://<griffin working directory>/env.json sparkJob.jars_1 = hdfs://<pathTo>/datanucleus-api-jdo-3.2.6.jar sparkJob.jars_2 = hdfs://<pathTo>/datanucleus-core-3.2.10.jar sparkJob.jars_3 = hdfs://<pathTo>/datanucleus-rdbms-3.2.9.jar sparkJob.uri = http://<LIVY-IP>:8998/batches |
...
| Code Block | ||
|---|---|---|
| ||
#make sure you can access es by http ES_SERVER = "http://<ES-IP>:9200" |
Build
| Code Block | ||
|---|---|---|
| ||
cd incubator-griffin
mvn clean install -DskipTests#cp jars to hdfd griffin working dircp /measure/target/measure-0.1.3-incubating-SNAPSHOT.jar /measure/target/griffin-measure.jarhdfs dfs -put griffin-measure.jar <griffin working dir> |
Run
| Code Block | ||
|---|---|---|
| ||
java -jar service/target/service.jar
#open from your browser
http://<YOUR-IP>://8080 |
License Header File
Each source file should include the following Apache License header
...