DUE TO SPAM, SIGN-UP IS DISABLED. Goto Selfserve wiki signup and request an account.
...
- Import data from the remote source to Hive tables on Trafodion cluster. Use one of these approaches:
- Use a tool like Apache Sqoop(TM) to move data from a remote relational database management system (RDBMS), such as MySQL or Oracle, to Hive tables on the Trafodion system. For more information, see Using Sqoop to Import Data Into Hive
- Copy the data to be imported into Trafodion onto HDFS on the Trafodion cluster. Use Hive external tables to make this data visible from Hive. For more information, see Creating Create Hive External Tables.
- Use the Trafodion LOAD statement to import data from Hive to Trafodion tables. For more information, see Bulk Loading Data Into Trafodion Tables
...
| Parameter | Guidelines |
|---|---|
| --split-by <column-name> | By default, if not specified, sqoop will use the primary key column as a splitting column, which is not optimal most of the time. Also, if the table does not contain a primary key, you must manually specify the splitting column. |
| --null-string <null-string> | This is the string to be written for a null value in a string column. |
| --null-non-string <null-string> | This is the string to be written for a null value in a non-string column. |
| --hive-drop-import-delims | This drops \n, \r, and \01 string fields when importing to Hive. NOTE: If the data contains \n or \r and if you do not use the hive-drop-import-delims option, then data will be truncated. You will need to use additional Sqoop options during migration by specifying the delimiter that you would like to use, which does not exist in the data itself. |
Anchor Create Hive External Tables Create Hive External Tables
Creating Hive External Tables
| Create Hive External Tables | |
| Create Hive External Tables |
A Hive table must be created from a Hive interface like the Hive shell. External tables in Hive are convenient to use during loading. You can load the data into Hive simply by copying the source data files into a single HDFS directory and then by creating a Hive external table to point to the directory. Data types used for each column in the Hive table must match the source data. For the syntax to create external tables, see the Hive wiki. For the data types available in Hive, see Hive LanguageManual Types. When Hive tables are accessed through Trafodion columns with integral, string and char types are accessible. To populate an external table, use this type of hadoop command to copy data to an HDFS directory:
...