Page History

...

SqoopOutputFormatLoadExecutor and SqoopOutputFormatDataReader

1. The LoaderContext is set up in the ConsumerThread.run(..) method. 
2. Loader's load method is invoked passing the SqoopOutputFormatDataReader and the LoaderContext
3. The load method invokes the SqoopOutputFormatDataReader to read to records from the SqoopRecordWriter associated with the SqoopNullOutputFormat

VB: The internal details of this class is not something I clearly understand, so I am hoping @jarcec can add some notes here on the ConsumerThread class and its significance. I understand reader/ writer problem but in the context of Map tasks and missing Reduce Tasks and sometimes with both Map and Reduce Tasks, I would like to validate my understanding

...