Versions Compared

Old Version 5

changes.mady.by.user Abhishek Shivanna

Saved on

compared with

New Version 6

changes.mady.by.user Abhishek Shivanna

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Proposed Changes

JobCoordinator side

  • Expose a REST endpoint (eg: /isContainerValid) who's purpose is to get requests from the Samza container periodically and respond back weather the container is in the Job Coordinator's current list of valid containers.

    Code Block
    languagebash
    $ curl <host>:<port>/isContainerValid?execution_resource_id=container_1490224420978_0323_01_000282
{
	isValid: true
}
  • Endpoint could be a part of the JobModelManager's servlet which is currently used for retrieving the JobModel by the containers during startup.
  • Endpoint can accept a "Execution Resource ID" (eg: YARN container ID) and validate it against state maintained by the Job Coordinator (eg: YarnAppState) and future implementations of other cluster managers need to implement this endpoint and expose the same validation.

...