...
Setup release branches
Anchor |
---|
| setup-release-branches |
---|
| setup-release-branches |
---|
|
(Release Manager)
First, update the RELEASE_NOTES in incubator-streampipes (dev) by adding significant new features from JIRA that correspond to the new release version.
incubator-streampipes
Update active UI modules.
Depending on the features that should be released, the UI config for active modules needs to be updated. If the feature set changes, open the ui/deployment/rel/config.yml file and edit the list of active modules:
Code Block |
---|
language | bash |
---|
title | Edit active UI modules |
---|
|
login:
backgroundImage: 'deployment/dev/img/background.png'
logo: 'deployment/dev/img/logo.png'
logo-right: 'deployment/dev/img/sp-logo-right-white.png'
modules:
- spEditor
- spPipelines
- spConnect
- spDashboard
- spAppOverview
- spAdd
- spMyElements
- spDataExplorer
- spConfiguration |
Commit and push these changes to dev
If needed, change the current SNAPSHOT version to the version that is planned for the upcoming release:
|
# Make sure to only use a SNAPSHOT version here
# THIS STEP IS ONLY NEEDED IF THE NEXT RELEASE VERSION DIFFERS FROM THE CURRENT SNAPSHOT VERSION (e.g., when jumping from 0.90.0 to 0.95.0) |
Code Block |
---|
language | bash |
---|
title | Set project version |
---|
|
# Make sure to only use a SNAPSHOT version here
mvn versions:set -DnewVersion=0.66.0-SNAPSHOT
# Check the output and briefly check if all changed version numbers in the POM files are ok
mvn versions:commit
# Manually change the project version in the package.json file in the ui/ folder.
# Push the changes to dev |
...
The maven-release-plugin will ask you to provide the version number of the next development version (use the new minor version, not the suggested patch version). Afterwards, a new branch will be created and the version number in dev is increased to the next development version. All changes will be automatically pushed by the plugin.
API Docs
Update the streampipes version within the API docs:
Code Block |
---|
language | bash |
---|
title | Create release branch |
---|
|
# Go to /streampipes-service-core/src/main/resources/openapi.yaml in dev
# adapt the streampipes version
openAPI:
info:
version: '0.91.0' |
Checkout dev and change the aforementioned versions to the next release version (e.g., 0.67.0-SNAPSHOT)
Prepare test setup
Anchor |
---|
| prepare-test-setup |
---|
| prepare-test-setup |
---|
|
(Release Manager)
...
In case modules are changed, update the docker-compose files in incubator-streampipes and incubator-streampipes-extensions streampipes project by adding/modifying/removing defined services.
Perform technical release readiness assessment
Anchor |
---|
| perform-technical-release-readiness-assessment |
---|
| perform-technical-release-readiness-assessment |
---|
|
Requirements
The following build tools need to be installed to properly test a release candidate:
- JDK (starting from v0.70, JDK 17 is the new minimum java version)
- Maven (tested with 3.6)
- NodeJS + NPM (tested with v12+/ v6+)
- Docker + Docker-Compose
Anchor |
---|
| checkout-release-branches |
---|
| checkout-release-branches |
---|
|
(Community)
First, create a new folder and checkout the release branches of both projects incubator- streampipes and incubator-streampipes-extensions:
Code Block |
---|
language | bash |
---|
title | Checkout release branches |
---|
|
# Clone & checkout a clean copy from the release branch
mkdir test-streampipes-rc && cd test-streampipes-rc
git clone git@github.com:apache/incubator-streampipes.git
# ALTERNATIVE: git clone git@githubhttps://github.com:/apache/incubator-streampipes-extensions.git
cd incubator-streampipes
# Change VERSION to the current release branch
git checkout rel/VERSION
cd ../incubator-streampipes-extensions
# Change VERSION to the current release branch
git checkout rel/VERSION
|
Anchor |
---|
| setup-test-environment |
---|
| setup-test-environment |
---|
|
(Community)
Now we'll build the system from source and run a test instance in Docker. Note that the docker-compose file used here should only be used for final release testing, as no volumes are defined for persistence.
incubator-streampipes
Build backend & UI
From the parent folder of the core, do the following to build the Java-based core:
Code Block |
---|
Code Block |
---|
language | bash |
---|
title | Build Maven artifacts |
---|
|
# Openin incubator-streampipesdownload folder
cd incubator-streampipes
# Run Maven Build, use install to make core artifacts available to the extensions build later
mvn clean install
|
Code Block |
---|
language | bash |
---|
title | Build UI |
---|
|
# Run NPM Build
cd ui
npm install
npm run build
directory
mvn clean package |
This build should be successful.
The next step is to build the UI, switch to the ui directory and do the following:
Code Block |
---|
|
# cd ui
npm install
# If this results in an error, do npm install --legacy-peer-deps
npm run build |
Start test system
If you want to test the system, there is a convenience docker-compose file that will help you starting the release candidate for testing.
Go back to the main directory of the core release artifact (where the docker-compose.yml file is located) and do the following:
Code Block |
---|
title | Set proper line encoding in docker entrypoint |
---|
|
# this might be optional - seems to only occur in rare cases on Windows systems
# Set the correct EOL encoding for the UI entrypoint file (docker-entrypoint.sh) file to LF:
awk 'BEGIN{RS="^$";ORS="";getline;gsub("\r","");print>ARGV[1]}' ui/docker-entrypoint.sh
# Alternative: Open the file ui/docker-entrypoint.sh, change the eol encoding to "LF" (e.g., in Notepad++ by clicking on "Windows CRLF" in the bottom status bar). |
Code Block |
---|
title | Build Docker images and start |
---|
|
docker-compose up --build -d
# Use docker-compose up to run it in foreground
# Docker images will be locally built |
Once you're done with that, proceed to the next step.
(Community)
Go to your browser and open the StreamPipes UI at localhost:80.
Perform the installation steps (all pipeline elements should be automatically installed) and test the system according to the Pre-Release Checklist. Mark everything you have checked in the pre-release checklist that has been created for the upcoming release.
Anchor |
---|
| fix-critical-issue |
---|
| fix-critical-issue |
---|
|
(Community
)If you find a release-blocking issue during testing, do the following steps:
- Create an issue in JIRA
- If you plan to fix the issue by yourself:
- Fix the issue in the release branch (e.g., rel/0.66.0)
- All changes made to the release branch should be cherry-picked back into dev (git log / git cherry-pick COMMIT_HASH)
Perform legal release readiness assessment
...