Versions Compared

Old Version 3

changes.mady.by.user Unknown User (sanjaysubramanian@yahoo.com)

Saved on

compared with

New Version 4

changes.mady.by.user Unknown User (sanjaysubramanian@yahoo.com)

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Migrated to Confluence 4.0

...

No Format
hive -e "SET mapreduce.output.fileoutputformat.compress.codec=com.hadoop.compression.lzo.LzopCodec;SET hive.exec.compress.output=true;SET mapreduce.output.fileoutputformat.compress=true;<query-string>"

     Note: If the data sets are large or number of output files are large , then this option does not work.

Option 2: Write Custom Java to Create LZO Files

...