This page describes the release, validation, and other aspects related to SDKHarness images.
Overview
The idea is to build a set of public SDKHarness pre-built images, that users can utilize to run their portable pipelines without having to manually build them, or use these images as base images for customization.
Location/Naming
This section describes the naming scheme and location for publication of the containers.
Proposed repository:
gcr.io/beam
Proposed tagging scheme:
java-SNAPSHOT
java-2.10.1
python2-SNAPSHOT
python2-2.10.1
go-SNAPSHOT
go-2.10.1
For example:
gcr.io/beam:java-SNAPSHOT
gcr.io/beam:java-2.10.1
Gcr.io
Things to know about gcr.io:
- Quotas:
- ?
- Permissions:
- access - public ?
- publish ?
- GCP Project:
- apache-beam-testing
- Troubleshooting:
- ping dev@ ?
Publication Schedule
Snapshots
- automatic, when HEAD is built ?
- TTL, cleanup procedure ?
Release Images
- manual, as part of Beam release;
Commands
Build
$ ./gradlew .... ?
Run a test against locally built container
$ ./gradlew ... ?
Publish
$ ./gradlew ... ?
Release Images Validation
This section describes how to validate a published image.
Automated test suites
To execute a test suite ??? against container ??? :
$ ./gradlew ... ?
Manual testing
To run a custom pipeline against an image
:
$ ./gradlew ... ?
Backwards compatibility
- ?
Other verification
- hash, signature ?
Support Story
How do we allow the images to be used?
What's the process of reporting issues?
Any special licensing?