...
| Release | Tag | Features | Exit criteria |
|---|
| TODO | TODO | - HDFS to Ozone upgrade
- Load Balancer Deployments for S3 gateway
- Using NFS gateway from HDFS for Ozone
- Limit number of rocksdb instances on high density datanodes
- Truncate support
- Snapshot support
- Certificate rotation
- Rolling upgrades
| - Run Ozone tests with multiple SCM
- This will allow HDFS clusters to upgrade to Ozone without data copies.
- Native CSI support (ozone specific daemon)
- Security is on by default, TDE, and Security testing with different applications.
- Test and Document different load balancers that can with S3 gateway.
- Test with NFS client
|
Upcoming Releases
| Release | Tag | Features | Exit criteria |
|---|
Support SCM HA for existing installations not already using it.Support filesystem optimization for existing installations not already using it.| 1.5.0 | Indiana Dunes |
|
|
| 1.3.1 | ? |
| Critical bugs fixed found in 1.3.0 all landed |
Container balancer
Past Releases
Ozone releases can be downloaded from https://ozone.apache.org/downloads/
...
| Release | Tag | Features | Exit criteria |
|---|
1.4.0 | Hot Springs | - Ozone Snapshot feature
- Erasure Coding - V2 support (offline resconstruction)
- Container balancer support for Erasure Coding
- Heat map support, more diagnose info on Recon
- Certificate auto rotation
- SCM Decommission support
- OM Decommission improvement
- New symmetric key based block/container token implementation
- Quota on FSO bucket support
|
|
1.3.0 | Grand Canyon RELEASED | - Erasure Coding - V1 support (Online reconstruction support)
- Container balancer
- Limit number of rocksdb instances to 1 per disk on high-density datanodes
- Ozone S3 Multi-tenancy Support
- S3 Grpc improvements for metadata path
- Filesystem Optimized and Object Store bucket layout types
|
|
| 1.2.0 | Glacier RELEASED | - SCM HA support for fresh installations
- Non-rolling upgrade and downgrade support
- Optimized filesystem (prefix) support for fresh installations
- Transparent data encryption for S3 buckets
|
|
| 1.1.0 | Everglades RELEASED | - Volume/Bucket Quota Support
- ofs/o3fs performance improvements with Teragen and Spark
- Ozone FS namespace
|
|
| 1.0.0 | Denali RELEASED | - Security Phase II
- HA support for Ozone Manager
- OFS (HDDS-2665), new scheme: ofs://om/volume/bucket/key
- Ozone Filesystem performance improvement (HDDS-2939)
- Ozone support security enabled Hadoop 2.x
- S3 volume/bucket mapping changes and bind mounted buckets (HDDS-3385)
- Hadoop 2.7 support / remove of Isolated class loader (HDDS-3458)
- Recon / Recon UI improvements (new management / debug screens)
| - Support upgrading / persist current versions metadata
- Support MR jobs with the new scheme
- Support fast directory list with 1 billion keys and deep hierarchy
- Testing integrations with other projects
- Hive LLAP
- Impala
- Spark (TPC-DS)
|
| 0.5.0 | Crater Lake RELEASED | - Stability improvements
- Performance and Scale
- High Availability
- Topology awareness.
- Management Console
- Disk Scanner
- Centralized Management
- UI updates to SCM and OM.
- Decommissioning
| - Long-running tests based on Apache NIFI, Hive, and Spark.
- Able to handle 1 Billion objects.
- GDPR Right to Erasure
- Network Topology awareness for block placement.
- Recon Server V1
- Disk scanner and ability to detect block corruptions.
- Hadoop Configurations are hard to manage, make it easy for ozone.
- Support Decommission.
|
| 0.4.1 | Biscayne RELEASED | - Stability improvements
- Ozone Native ACL support
- First class K8s support
| - Support Native ACLs in Ozone.
- Ozone becomes K8s aware.
|
| 0.4.0 | Badlands RELEASED | Security | - Hadoop Delegation Tokens and Block Tokens supported for Ozone.
- Transparent Data Encryption (TDE) Support - Allows data blocks to be encrypted-at-rest.
- Kerberos support for Ozone.
- Certificate Infrastructure for Ozone - Tokens use PKI instead of shared secrets.
- to communication secured via mutual TLS.
- Ability secure ozone cluster that works with Yarn, Hive, and Spark.
- Helm/ support to deploy Ozone clusters on K8s.
- Support S3 Authentication Mechanisms like - S3 v4 Authentication protocol.
- S3 Gateway supports upload.
- Support S3A file system
- Support for Tracing and Profiling for all Ozone components.
- Audit Support - including Audit Parser tools.
- Apache Ranger Support in Ozone.
|
| 0.3.0 | Arches RELEASED | S3 Protocol head | - Create an S3 protocol head that can work with Ozone.
- Ingest via S3 protocol head, process data via Ozone FS.
- Support a minimally complete S3 API set.
- Make sure that AWS CLI and AWS Java SDK works correctly against the protocol head
- Large Scale and complete testing of Application Stack. YARN, Hive, and Spark.
|
| 0.2.1 | Acadia RELEASED | Basic Ozone functionality - Ozone FS
- Command Shell
- Java SDK.
| - Be able to create ozone volumes, buckets, and Keys.
- Create a large number of keys. Millions of keys tested.
- Write large single key – 50GBs +
- Support Ozone REST and RPC protocols.
- User facing documentation
- Ship Java client Libraries for Ozone supporting both RPC and REST.
- Meet Apache Release criteria.
- Make sure YARN, Hive, and Spark applications can work against Ozone FS.
|
...