Page History

...

1. Each table only has one main branch, and other branches can only be created from the specified tag of the main branch

2. Create Users can create or delete a branch for tables in Paimon, and create a tag tags for a specified branch.

3. Update schema for the branch, such as altering tables to add/drop columns.

4. Jobs can streaming/batch read from and write data to in the branch

5. There are merge merging and replace replacing operations from branch to main, and after replace main with given branch, the previous main branch will be deleted.

...

There is a main branch file  in the branch directory and it has the main branch name in the file. Besides that, there will be multiple branch directories and each branch has snapshot, tag and schema in its directory.

...

There will be a series of snapshots, tags and schemas in the main branch of a Paimon table. We can create a new branch with branch - name from the tag for the table. To do that, Paimon will should create a new directory with the given branch name, copy the specified tag, snapshot and schema from the main branch to the new branch.

...

We need to support replacing the main branch with a branch without affecting streaming and batch data read and write on the branch. To achieve this, we need to do the following steps:

1. Calculate and copy the snapshots, tags and schemas which should be copied from the main branch to target branch

2. Update the Main Branch File to the target branch

3. Drop the previous main branch, including snapshots, tags and schemas.

...