Versions Compared

Old Version 4

changes.mady.by.user Scott Preece

Saved on

compared with

New Version 5

changes.mady.by.user Lefty Leverenz

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: add link to SerDe section in Developer Guide

SerDe is short for Serializer/Deserializer. A SerDe allows Hive to read in data from a table, and write it back out to HDFS in any custom format. Anyone can write their own SerDe for their own data formats. See Hive SerDe for an introduction to SerDes.

For JSON files, Amazon has provided a JSON SerDe available at:

     s3://elasticmapreduce/samples/hive-ads/libs/jsonserde.jar

Hive uses the Serde interface for IO. The interface handles both serialization and deserialization and also interpreting the results of serialization as individual fields for processing.

...