Versions Compared

Old Version 74

changes.mady.by.user Eugene Koifman

Saved on

compared with

New Version 75

changes.mady.by.user Lefty Leverenz

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: fix typo "Workrs" reported by Michael T. Deguzis via Josh Elser (thanks, both)

...

Each Worker handles a single compaction task.  A compaction is a MapReduce job with name in the following form: <hostname>-compactor-<db>.<table>.<partition>.  Each worker submits the job to the cluster (via hive.compactor.job.queue if defined) and waits for the job to finish.  hive.compactor.worker.threads determines the number of Workers in each Metastore.  The total number of Workrs Workers in the Hive Warehouse determines the maximum number of concurrent compactions.

...