...
- Now let’s download and install Apache Kylin sqoop2 by following the excellent instructions available on the Kylin sqoop2 site itself. Please follow the steps to install apache kylinsqoop2(Apache Kylin sqoop2 Installation Guide).
- These instructions were written for version 21.199.07. So grab that tar (apache-kylinsqoop-2.1.0-bin-hbase1x.tar.gz) and checksum file (apache-kylin-2.1.099.7-bin-hbase1xhadoop200.tar.gz.md5).
- If java is not there, install JDK first.
Enabling Ranger
...
Sqoop2 Plugins
a. We’ll start by extracting our Ranger plugin build at the appropriate place (/usr/local).
Code Block |
---|
cd /usr/local
sudo tar zxvf ~/ranger/target/ranger-1.0.0-kylinsqoop-plugin.tar.gz
sudo ln -s ranger-1.0.0-kylinsqoop-plugin ranger-kylinsqoop-plugin
cd ranger-kylinsqoop-plugin |
b. Now let’s edit the install.properties file. Here are the relevant lines that you should edit
- Change the install.properties file
PROPERIYPROPERTY | VALUE | DESCRIPTION |
---|
POLICY_MGR_URL | http://localhost:6080 | Pull the address of the |
Ranger sqoop2 policy |
REPOSITORY_NAME |
kylindevKylin sqoop2 service name |
COMPONENT_INSTALL_DIR_NAME | /opt/ |
ZDH/parcels/lib/kylinsqoop/sqoop-1.99.7-bin-hadoop200 | sqoop2 |
Kylin component installed directory |
XAAUDIT.SOLR.ENABLE | true | Whether to save the audit log true: save the audit log false: do not save the audit log |
XAAUDIT.SOLR.URL | http://localhost:8983/solr/ranger_audits | The address of the audit log |
CUSTOM_USER |
kylinsqoop2 | The user of installing the kylin component |
CUSTOM_GROUP |
kylinsqoop2 | The user group of installing the kylin component |
c. Now enable the kylinsqoop2-plugin by running the enable-kylinsqoop-plugin.sh command command using root user (Remember to set JAVA_HOME before running the command)
Code Block |
---|
cd /usr/local/rrangerenable-kylinsqoop-plugin
./enable-kylinsqoop-plugin |
d.
...
Restart apache sqoop2
de. Restart apache kylinranger.
Code Block |
---|
sudo ranger-admin restart |
ef.Verify install result
- Check whether the kylinthesqoop_kylindevsqoopdev.json file exists under the /etc/ranger/kylindev/policycache pathdirectory.
- Check the kylin sqoop2 plugin status on the Plugins tab page of the Audit function on the Ranger Web page
...