You are viewing an old version of this page. View the current version.
Compare with Current
View Page History
« Previous
Version 14
Next »
Backlog
Release | Tag | Features | Exit criteria |
---|
TODO | TODO | - HDFS to Ozone upgrade
- Load Balancer Deployments for S3 gateway
- Using NFS gateway from HDFS for Ozone
- Truncate support
- Snapshot support
- Certificate rotation
- Rolling upgrades
| - Run Ozone tests with multiple SCM
- This will allow HDFS clusters to upgrade to Ozone without data copies.
- Native CSI support (ozone specific daemon)
- Security is on by default, TDE, and Security testing with different applications.
- Test and Document different load balancers that can with S3 gateway.
- Test with NFS client
|
Upcoming Releases
Release | Tag | Features | Exit criteria |
---|
1.3.0 | Grand Canyon | - Erasure Coding - V1 support (Online reconstruction support)
- Erasure Coding - offline recovery support (HDDS-6462)
- Container balancer
- Limit number of rocksdb instances to 1 per disk on high-density datanodes (HDDS-3630)
- Multi-tenancy Support for Ozone (S3 multi-volume support)
- S3 Grpc improvements for metadata path
- Support filesystem optimization for existing installations not already using it
| Support SCM HA for existing installations not already using it (documentation - TODO) Upgrade finalization for SCM HA (Done)- EC offline recovery stability (HDDS-6462)
Ranger client bump to release version- Rocksdb version bump - possible blockers: HDDS-6722
|
Past Releases
Ozone releases can be downloaded from https://ozone.apache.org/downloads/
Release | Tag | Features | Exit criteria |
---|
1.2.0 | Glacier RELEASED | - SCM HA support for fresh installations
- Non-rolling upgrade and downgrade support
- Optimized filesystem (prefix) support for fresh installations
- Transparent data encryption for S3 buckets
|
|
1.1.0 | Everglades RELEASED | - Volume/Bucket Quota Support
- ofs/o3fs performance improvements with Teragen and Spark
- Ozone FS namespace
|
|
1.0.0 | Denali RELEASED | - Security Phase II
- HA support for Ozone Manager
- OFS (HDDS-2665), new scheme: ofs://om/volume/bucket/key
- Ozone Filesystem performance improvement (HDDS-2939)
- Ozone support security enabled Hadoop 2.x
- S3 volume/bucket mapping changes and bind mounted buckets (HDDS-3385)
- Hadoop 2.7 support / remove of Isolated class loader (HDDS-3458)
- Recon / Recon UI improvements (new management / debug screens)
| - Support upgrading / persist current versions metadata
- Support MR jobs with the new scheme
- Support fast directory list with 1 billion keys and deep hierarchy
- Testing integrations with other projects
- Hive LLAP
- Impala
- Spark (TPC-DS)
|
0.5.0 | Crater Lake RELEASED | - Stability improvements
- Performance and Scale
- High Availability
- Topology awareness.
- Management Console
- Disk Scanner
- Centralized Management
- UI updates to SCM and OM.
- Decommissioning
| - Long-running tests based on Apache NIFI, Hive, and Spark.
- Able to handle 1 Billion objects.
- GDPR Right to Erasure
- Network Topology awareness for block placement.
- Recon Server V1
- Disk scanner and ability to detect block corruptions.
- Hadoop Configurations are hard to manage, make it easy for ozone.
- Support Decommission.
|
0.4.1 | Biscayne RELEASED | - Stability improvements
- Ozone Native ACL support
- First class K8s support
| - Support Native ACLs in Ozone.
- Ozone becomes K8s aware.
|
0.4.0 | Badlands RELEASED | Security | - Hadoop Delegation Tokens and Block Tokens supported for Ozone.
- Transparent Data Encryption (TDE) Support - Allows data blocks to be encrypted-at-rest.
- Kerberos support for Ozone.
- Certificate Infrastructure for Ozone - Tokens use PKI instead of shared secrets.
- to communication secured via mutual TLS.
- Ability secure ozone cluster that works with Yarn, Hive, and Spark.
- Helm/ support to deploy Ozone clusters on K8s.
- Support S3 Authentication Mechanisms like - S3 v4 Authentication protocol.
- S3 Gateway supports upload.
- Support S3A file system
- Support for Tracing and Profiling for all Ozone components.
- Audit Support - including Audit Parser tools.
- Apache Ranger Support in Ozone.
|
0.3.0 | Arches RELEASED | S3 Protocol head | - Create an S3 protocol head that can work with Ozone.
- Ingest via S3 protocol head, process data via Ozone FS.
- Support a minimally complete S3 API set.
- Make sure that AWS CLI and AWS Java SDK works correctly against the protocol head
- Large Scale and complete testing of Application Stack. YARN, Hive, and Spark.
|
0.2.1 | Acadia RELEASED | Basic Ozone functionality - Ozone FS
- Command Shell
- Java SDK.
| - Be able to create ozone volumes, buckets, and Keys.
- Create a large number of keys. Millions of keys tested.
- Write large single key – 50GBs +
- Support Ozone REST and RPC protocols.
- User facing documentation
- Ship Java client Libraries for Ozone supporting both RPC and REST.
- Meet Apache Release criteria.
- Make sure YARN, Hive, and Spark applications can work against Ozone FS.
|
These release names are based on US national parks, and for every minor release, we also move to the next letter for the release code name.