...
Extends the Reducer API and at this point only runs the progressService. It is invoked only when the numLoaders driver config is > 0. See above. VB: It is still un clear unclear to me, how this would support throttling as indicated in this ticket, Looking for some details on how invoking a reducer helps.
...
VB: The internal details of this class is not something I clearly understand, so I am hoping @jarcec can add some notes here on the ConsumerThread class and its significance. I I understand reader/ writer problem but in the context of Map tasks and missing Reduce Tasks and sometimes with both Map and Reduce Tasks, I would like to validate my understanding
Few related tickets proposed for enhancement
...