Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Table of Contents


# Next scheduled major/minor release: 1.2

...

# Release date:

# Release manager:

# New Features

## 1. Support using S3 as cold data storage

* [DSIP-010](https://cwiki.apache.org/confluence/display/DORIS/DSIP-010%3A+Cooldown+Data+to+S3)
* [#10280](https://github.com/apache/doris/pull/10280)
* [#10405](https://github.com/apache/doris/pull/10405)

## 2. JAVA UDF and JAVA UDAF

* [DSIP-001](https://cwiki.apache.org/confluence/display/DORIS/DSIP-001%3A+Java+UDF)

## 3. New Realtime Update Storage Engine 

* [DSIP-018](https://cwiki.apache.org/confluence/display/DORIS/DSIP-018%3A+Support+Merge-On-Write+implementation+for+UNIQUE+KEY+data+model)

## 4. Multi-Catalog support

* [DSIP-014](https://cwiki.apache.org/confluence/display/DORIS/DSIP-014%3A+Multi+Catalog+Support)

## 5. Light weight schema change

* [#10136](https://github.com/apache/doris/pull/10136)

## 7. New Types

1. Array Type [DSIP-013](https://cwiki.apache.org/confluence/display/DORIS/DSIP-013%3A+Support+ARRAY+type)
2. Jsonb Type [#10322](https://github.com/apache/doris/pull/10322)
3. Decimal v3 [#9582](https://github.com/apache/doris/pull/9582)
4. Data Datetime v2 [#9916](https://github.com/apache/doris/pull/9916)

## 8. New Flink CDC Connector

Support 2PC stream load and Exactly-Once sematice

* [](https://github.com/apache/doris-flink-connector/pull/12)

## 9. Support for deployment in k8s

# Performance Improvement

## 1. Global Dictionary for low cardinality data for group by.

* [#9842](https://github.com/apache/doris/pull/9842)

## 2. Store decoded bitshuffle data in page cache

* [#10036](https://github.com/apache/doris/pull/10036)

## 3. Compaction and Load optimization

Support load and compaction for single replica

* [DSIP-015](https://cwiki.apache.org/confluence/display/DORIS/DSIP-015%3A+Support+single+replica+load+for+load)
* [#10298](https://github.com/apache/doris/pull/10298)
* [#10301](https://github.com/apache/doris/pull/10301)

## 4. Improvements in Runtime Filter

The Runtime Filter feature with vectorized engine still need to be improved.

## 5. Full vectorization support

In version 1.2, all features should be supported running with vectorized engine, including:

1. Stream Load
2. Insert into values
3. Insert into select
4. Broker load
5. Spark dpp
6. Routine load
7. Query for olap, hive, iceberg, mysql, odbc, es
8. File format support: parquet, json, csv, orc file, plain text
9. Schema Change
10. Compaction
11. Export
12. Select outfile 

# Stability Improvement

## 1. New memory tracker

* [DSIP-002](https://cwiki.apache.org/confluence/display/DORIS/DSIP-002%3A+Refactor+memory+tracker+on+BE)

# Test

## 1. Add more regression tests

Add more regression tests

# Refactor

## Remove and Refactor old codes

1. Remove Mini load related code
2. Remove Alpha Rowset (Segment v1) code
3. Remove string type
4. Compatibility for C++ UDF Framework running in vectorized query engine.