Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

All the configs provided in the start up script will be passed to AM through environment variable and loaded by the designated config loader to load the complete config. 

The full list of configs can be found in

Take wikipedia-feed in Hello Samza as an example:

...

Users need to change job submission script and provide related configs explicitly through --config, instead of using --config-factory and --config-path to load local file; 

References

  • Complete list of job submission configs

Code Block
[Required] job.factory.class 
[Required] job.name
[Required] yarn.package.path
[Optional] app.runner.class 
[Optional] yarn.resourcemanager.address
[Optional] job.id
[Optional] yarn.application.type
[Optional] fs.*.impl
[Optional] samza.cluster.based.job.coordinator.dependency.isolation.enabled
[Optional] yarn.am.opts
[Optional] yarn.am.java.home
[Optional] yarn.am.container.memory.mb
[Optional] yarn.am.container.cpu.cores
[Optional] yarn.queue
[Optional] yarn.am.container.label
[Optional] yarn.resources.*