Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Extends the Reducer API and at this point only runs the progressService. It is invoked only when the numLoaders driver config is > 0. See above. VB: It is still un clear unclear to me, how this would support throttling as indicated in this ticket, Looking for some details on how invoking a reducer helps.

...

VB: The internal details of this class is not something I clearly understand, so I am hoping @jarcec can add some notes here on the ConsumerThread class and its significance. I  I understand reader/ writer problem but in the context of Map tasks and missing Reduce Tasks and sometimes with both Map and Reduce Tasks, I would like to validate my understanding

 

Few related tickets proposed for enhancement 

...