Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

How does the integration test suite work? 

  • The integration tests are tightly tied to the MR Execution engine at this point. Some rework will be needed to get this working in a Spark execution engine context.
  • They use the Hadoop Minicluster** behind the scenes. to simulate the MR execution engine environment. It runs the test to simulate a real distributed cluster but only difference is that it happens in the same JVM. Hence it is also referred to as the psuedo distributed mode


  • When using this option -Dsqoop.hadoop.runner.class=org.apache.sqoop.test.hadoop.HadoopLocalRunner, it does use the minicluster and 

** http://www.lopakalogic.com/articles/hadoop-articles/hadoop-testing-with-minicluster/

What DB does integration tests use today for storing the Sqoop entities ?

...