This page describes the release, validation, and other aspects related to SDKHarness images.

Overview

The idea is to build a set of public SDKHarness pre-built images, that users can utilize to run their portable pipelines without having to manually build them, or use these images as base images for customization.

Location/Naming

This section describes the naming scheme and location for publication of the containers.

Proposed repository:

gcr.io/beam

Proposed tagging scheme:

  java-SNAPSHOT
  java-2.10.1
  python2-SNAPSHOT
  python2-2.10.1
  go-SNAPSHOT
  go-2.10.1

For example:

  gcr.io/beam:java-SNAPSHOT
  gcr.io/beam:java-2.10.1

Gcr.io

Things to know about gcr.io:

• Quotas:
  • ?
• Permissions:
  • access - public ?
  • publish ?
• GCP Project:
  • apache-beam-testing
• Troubleshooting:
  • ping dev@ ?

Publication Schedule

Snapshots

• automatic, when HEAD is built ?
• TTL, cleanup procedure ?

Release Images

• manual, as part of Beam release;

Commands

Build

  $ ./gradlew .... ?

Run a test against locally built container

  $ ./gradlew ... ?

Publish

  $ ./gradlew ... ?

Release Images Validation

This section describes how to validate a published image.

Automated test suites

To execute a test suite ??? against container ??? :

  $ ./gradlew ... ?

Manual testing

To run a custom pipeline  against an image :

  $ ./gradlew ... ?

Backwards compatibility

 - ?

Other verification

• hash, signature ?

Support Story

How do we allow the images to be used?

What's the process of reporting issues?

Any special licensing?