Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  • set an environment variable with the "Execution Container ID" during container launch. This can be read from the container to make requests to the above endpoint.
  • A new ContainerHeartbeatMonitor class that accepts a ContainerHeartbeatClient (which has the business logic to make heartbeat checks on the JC endpoint) and a Runnable callback.
    The ContainerHeartbeatMonitor schedules a separate thread at a fixed rate which uses the client to check if the heartbeat is still valid. On failure of the heartbeat, the passed in Runnable callback is executed, which is used to shutdown the container and set state on LocalContainerRunner to shutdown with non-zero code.

...

  • Introduce the new REST endpoints for YARN.
  • Implement validator heartbeat monitor on container side and check for reschedules after a container shutdownthat is responsible for killing the container if needed.
  • Setup metrics for number of invalid containers that made a call to the endpoint.
  • Add unit tests to test/verify compatibility

...