Page History

...

JIRA: https://issues.apache.org/jira/browse/SQOOP-1744 and its sub-tickets.

Problem

Requirements

...

Summary

Currently we have KiteConnector in Sqoop2 ( as of writing this doc) with support for writing to and reading from a HDFS dataset. The goal of SQOOP-1744 is to extend it to support reading from and writing to Hbase data set as well. An additional goal will be to support reading delta records and writing delta records from/to hbase using the Kite SDK/ APIs.

Background

There is no design or feature doc yet written for the details of the KiteConnector. Here are the relevant JIRA tickets that provide details on how the Kite FROM and Kite TO connectors work.

Kite FROM part : https://issues.apache.org/jira/browse/SQOOP-1647

Kite TO part ( for writing to HDFS via Kite ) : https://issues.apache.org/jira/browse/SQOOP-1588 

Requirements

1. Ability for the user to read from and write to Hbase by choosing the Kite connector, It is implementation detail if we choose to have a standalone Kite-Hbase connector reuse the KiteConnector we have today in some fashion to indicate the data set we will use
2. Ability to indicate the partition strategy and column mapping for hbase data sets
3. Ability to support delta reads and writes to the Hbase 
4. Integration tests to prove that we can move data from the JDBC to Hbase and vice versa 

Design

Implementation Details

...