Versions Compared

Old Version 5

changes.mady.by.user Szehon Ho

Saved on

compared with

New Version 6

changes.mady.by.user Szehon Ho

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Some edit of pre-requisites.

...

It is not the purpose to go in depth for implementations design of the various joinsjoin implementations in Spark, such as the common-join (HIVE-7384), or the optimized join variants like mapjoin (HIVE-7613), skew-join (HIVE-8406) or SMB mapjoin (HIVE-8202).  It will be helpful to refer to the design documents attached on JIRA for those details before reading this document.  It , as they will also contain some background of how they are implemented in MapReduce and comparisons.  Lastly, it will also be helpful to read the overall Hive on Spark design doc before reading this document.

...