Page History

...

1. Hadoop must be configured to allow impersonation.
   • For setting up impersonation in Hadoop, please see the Hadoop documentation for Secure Impersonation.
2. Set up a Kerberos keytab for the Kerberos principal and host Flume is connecting to HDFS from. This user must match the Hadoop configuration in Step 1 above.
   • Instructions for configuring Hadoop security can be found online which explain how to create a keytab file.
3. Configure the HDFS sink with the following configuration options:
   • hdfs.kerberosPrincipal - fully-qualified principal. Note: _HOST will be replaced by the hostname of the local machine (only in-between the / and @ characters, though)
   • hdfs.kerberosKeytab - location on the local machine of the keytab containing user and host keys for the above principal
   • hdfs.proxyUser - "proxy" user to impersonate

...