THIS IS A TEST INSTANCE. ALL YOUR CHANGES WILL BE LOST!!!!
...
1. Datatype support: we discussed the datatype support for Sqoop2. Among the points raised were the following:
- Sqoop 1 datatypes are different for Java, Hive and Avro
...
- . Most of the time the connector does the datatype mapping.
- For Sqoop ,2 we would like to standardize on the datatype support so that all connectors can conform for consistency.
- Some datatypes discussed today were:
- String, char: UTF 8 encoded
- Timestamp: Unix time representation to millisecond level
- Binary: byte array
- Numeric: byte, short, int, long, float, double, byte
- Null type
2. Intermediate data format
Jarcec has started out the intermediate format specification page on the Wiki at 1. This was discussed at a high level in context of the various datatypes to be used.1 https://cwiki.apache.org/confluence/display/SQOOP/Sqoop2+Intermediate+representation
Follow-up:
- Arvind to create a wiki page for datatypes and send it to dev list for discussion
- Jarcec to further refine intermediate representation specification on the wiki
...