Planned releases

Release 0.9.0(Planned)

Target Date:

Code Freeze Date:

Release Manager:

Target Features:

JIRA

Category

Description

Assignee

Jira

server	ASF JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	5aa69414-a9e9-3523-82ec-879b028fb15b
key	SUBMARINE-1306

Experiment

Upgrade database support (Hibernate, Postgresql ...)

Need assignee

Jira

server	ASF JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
maximumIssues	10
jqlQuery	project = SUBMARINE AND ("Target Version" = 0.9.0 OR fixVersion = 0.9.0 )
serverId	5aa69414-a9e9-3523-82ec-879b028fb15b

Release 0.8.1(Planned)

Target Date:

Code Freeze Date:

Release Manager:

Target Features:

JIRA

Category

Description

Assignee

Jira

server	ASF JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	5aa69414-a9e9-3523-82ec-879b028fb15b
key	SUBMARINE-1345

Experiment

Add XGBoost support.

Need assignee

Jira

server	ASF JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	5aa69414-a9e9-3523-82ec-879b028fb15b
key	SUBMARINE-1385

Python SDK

Update TensorFlow/Pytorch/Mlflow/Tensorboard/Conda/Minio versions to the latest and deal with related version dependency issues encountered

Need assignee

Jira

server	ASF JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
maximumIssues	10
jqlQuery	project = SUBMARINE AND ("Target Version" = 0.8.1 OR fixVersion = 0.8.1 )
serverId	5aa69414-a9e9-3523-82ec-879b028fb15b

Completed releases (Following releases are all completed)

Release 0.8.0(Released)

Target Date: 9/23/2023

Code Freeze Date:

Release Manager: cdmikechen

Target Features:

JIRA

Category

Description

Assignee

Jira

server	ASF JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,customfield_12311032,customfield_12311037,customfield_12311022,customfield_12311027,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,Priority,Priority,Priority,Priority,priority,status,resolution
serverId	5aa69414-a9e9-3523-82ec-879b028fb15b
key	SUBMARINE-1152

Workbench

Making submarine support i18n is a meaningful work, which can make it more convenient for users using different languages.

cdmikechen

Jira

server	ASF JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	5aa69414-a9e9-3523-82ec-879b028fb15b
key	SUBMARINE-1272

Cloud-native Deployment

We want to build a more robust and easy develop operator with operator-sdk (submarine-cloud-v3) and update supported k8s version to latest(1.24/1.25).

cdmikechen

Jira

server	ASF JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	5aa69414-a9e9-3523-82ec-879b028fb15b
key	SUBMARINE-1138

Security

Use pac4j to support OIDC and other SSO.

cdmikechen

Jira

server	ASF JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	5aa69414-a9e9-3523-82ec-879b028fb15b
key	SUBMARINE-1320

Python SDK

Python2.7 has reached EOL since January 1, 2020. Python3.6 also has reached EOL since Dec 23, 2021. Popular ML/DL packages, such as Tensorflow and Pytorch, have not support Python 3.6. The support for Python3.6 will affect the dependency maintenance in the future.

Therefore, we should upgrade syntax for newer versions of Python.

Yao-Ching Huang

Jira

server	ASF JIRA
serverId	5aa69414-a9e9-3523-82ec-879b028fb15b
key	SUBMARINE-1327

Cloud-native Deployment

We are still only up to 1.21 on the master branch and we need to consider how to support the latest releases of k8s and make the relevant adjustments.
Currently planned support for k8s versions: 1.22, 1.23, 1.24. And 1.25 will be supported when it is relatively stable.

cdmikechen

Jira

server	ASF JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
maximumIssues	10
jqlQuery	project = SUBMARINE AND ("Target Version" = 0.8.0 OR fixVersion = 0.8.0 )
serverId	5aa69414-a9e9-3523-82ec-879b028fb15b

Release 0.7.0(Released)

Target Date: 4/25/2022

Code Freeze Date:

Release Manager: Kevin Su

Target Features:

Jira

server	ASF JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
maximumIssues	10
jqlQuery	project = SUBMARINE AND fixVersion = 0.7.0
serverId	5aa69414-a9e9-3523-82ec-879b028fb15b

Release 0.6.0(Released)

Target Date: 10/21/2021

Code Freeze Date:

Release Manager: Kevin Su

Target Features:

JIRA

Category

Description

Assignee

Jira

server	ASF JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,customfield_12311032,customfield_12311037,customfield_12311022,customfield_12311027,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,Priority,Priority,Priority,Priority,priority,status,resolution
serverId	5aa69414-a9e9-3523-82ec-879b028fb15b
key	SUBMARINE-1024

Experiment Template

Fix the error when building the jupyter image

Kevin Su

Jira

server	ASF JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,customfield_12311032,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,Priority,status,resolution
maximumIssues	10
jqlQuery	project = SUBMARINE AND "Target Version" = 0.6.0
serverId	5aa69414-a9e9-3523-82ec-879b028fb15b

...

Release 0.5.0(Released)

Target Date: TBD12/24/2020

Code Freeze Date: TBD

Release Manager: Kevin Su

Target Features Features:

JIRA

Category

Description

Assignee

Jira

server	ASF JIRA
serverId	5aa69414-a9e9-3523-82ec-879b028fb15b
key	SUBMARINE-559

Predefined Experiment

Predefined Template:

[API] Define Experiment API for pre-defined template

Experiment

[SDK] Add Python SDK to support pre-defined experiment
[Sever] Support submit pre-defined template, and translate it to an actual job

John Ting

Jira

server	ASF JIRA
serverId	5aa69414-a9e9-3523-82ec-879b028fb15b
key	SUBMARINE-569

Experiment UI

[UI]: Allow Run Adhoc Python/TF/PyTorch Experiment via UI

Experiment

[UI] Allow Run pre-defined experiment

Experiment

[API] Define Swagger API for pre-defined template submission

Experiment

[API] Define Swagger API for pre-defined template registration/delete, etc.

Various

Jira

server	ASF JIRA
serverId	5aa69414-a9e9-3523-82ec-879b028fb15b
key	SUBMARINE-570

Common

Experiment/Notebook

[Server] Support run experiment/notebook with defined code sync (like Github)

Experiment

[Sever] Support submit pre-defined template, and translate it to actual job

Git repo)

Need assignee

Jira

server	ASF JIRA
serverId	5aa69414-a9e9-3523-82ec-879b028fb15b
key	SUBMARINE-571

Environment UI

UI

Environment

[API] Define swagger API for environment management (add/remove/iupdate/list)update)

Need assignee

Jira

server	ASF JIRA
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId	5aa69414-a9e9-3523-82ec-879b028fb15b
key	SUBMARINE-507

Environment

[API] Define

UI

swagger API for environment management (add/remove/update/list)

Environment

[Server] Support get an environment definition, and generate experiment/notebook submission spec

Environment

[Dockerfile] Prepare sample Dockerfile for Environment

Mani

Jira

server	ASF JIRA
serverId	5aa69414-a9e9-3523-82ec-879b028fb15b
key	SUBMARINE-477

Notebook

[API] Define Swagger API for notebook managmeent (Launch/Delete/Get)

Notebook

[Server] Implement logic to submit Jupyter notebook to K8s (with Environment/code sync)

On-going releases

Completed releases (Following releases are all completed)

Ryan Lo

Jira

server	ASF JIRA
columns	type,key,summary,priority,status,created,updated,assignee,reporter
maximumIssues	10
jqlQuery	project in ("Apache Submarine") AND "Target Version" = 0.5.0
serverId	5aa69414-a9e9-3523-82ec-879b028fb15b

Release 0.4.0

Target Date: 30/06/2020

...

Jira

server	ASF JIRA
columns	type,key,summary,priority,status,created,updated,assignee,reporter
maximumIssues	2010
jqlQuery	project in ("Apache Submarine") AND "Target Version" = 0.4.0
serverId	5aa69414-a9e9-3523-82ec-879b028fb15b

...

Jira

server	ASF JIRA
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
maximumIssues	20
jqlQuery	project = SUBMARINE AND status in (Open, "In Progress", Reopened, "Patch Available") AND "Target Version" = 0.3.0 AND (component = "Mini Submarine" OR component = "Backend Server" OR component = Commons OR component = Doc)
serverId	5aa69414-a9e9-3523-82ec-879b028fb15b

Legacy issues

Release 0.6.1

Some issues (like hadoop related issues) are no longer considered for maintenance, so we create a new release to temporarily categorize these issues.

Target Features

Jira

server	ASF JIRA
columnIds	issuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columns	key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
maximumIssues	10
jqlQuery	project = SUBMARINE AND ("Target Version" = 0.6.1 OR fixVersion = 0.6.1 )
serverId	5aa69414-a9e9-3523-82ec-879b028fb15b

Page tree

Versions Compared

Old Version 26

New Version Current

Key

Planned releases

Release 0.9.0(Planned)

Release 0.8.1(Planned)

Completed releases (Following releases are all completed)

Release 0.8.0(Released)

Release 0.7.0(Released)

Release 0.6.0(Released)

Release 0.5.0(Released)

On-going releases

Completed releases (Following releases are all completed)

Release 0.4.0

Legacy issues

Release 0.6.1

Page tree

Page History

Versions Compared

Old Version 26

New Version Current

Key

Planned releases

Release 0.9.0(Planned)

Release 0.8.1(Planned)

Completed releases (Following releases are all completed)

Release 0.8.0(Released)

Release 0.7.0(Released)

Release 0.6.0(Released)

Release 0.5.0(Released)

On-going releases

Completed releases (Following releases are all completed)

Release 0.4.0

Legacy issues

Release 0.6.1