Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

ReleaseTagFeaturesExit criteria
TODOTODO??????SCM HA
  • HDFS to Ozone upgrade
  • Load Balancer Deployments for S3 gatewayUpgrade Support
  • Using NFS gateway from HDFS for Ozone
  • Limit number of rocksdb instances on high density datanodes
  • Truncate support
  • Snapshot support
  • Run Ozone tests with multiple SCM
  • This will allow HDFS clusters to upgrade to Ozone without data copies.
  • Native CSI support (ozone specific daemon)
  • Security is on by default, TDE, and Security testing with different applications.
  • Test and Document different load balancers that can with S3 gateway.
  • Test with NFS client

...

ReleaseTagFeaturesExit criteria
1.12.0EvergladesGlacier
  • SCM HA
  • Non-rolling Upgrade Support
  • Volume/Bucket Quota Support
  • ofs/o3fs performance improvements with Teragen and Spark
  • Ozone FS namespace
  • Datanode column-family change is handled upgrade
  • OptimizedFS (prefix) support


Past Releases

Ozone releases can be downloaded from https://hadoop.apache.org/ozone/downloads/

...

ReleaseTagFeaturesExit criteria
1.1.0

Everglades

RELEASED

  • Volume/Bucket Quota Support
  • ofs/o3fs performance improvements with Teragen and Spark
  • Ozone FS namespace

1.0.0

Denali

RELEASED

  • Security Phase II
  • HA support for Ozone Manager
  • OFS (HDDS-2665), new scheme:  ofs://om/volume/bucket/key
  • Ozone Filesystem performance improvement (HDDS-2939)
  • Ozone support security enabled Hadoop 2.x
  • S3 volume/bucket mapping changes and bind mounted buckets (HDDS-3385)
  • Hadoop 2.7 support / remove of Isolated class loader (HDDS-3458)
  • Recon / Recon UI improvements (new management / debug screens)
  • Support upgrading / persist current versions metadata
  • Support MR jobs with the new scheme
  • Support fast directory list with 1 billion keys and deep hierarchy
  • Testing integrations with other projects
    • Hive LLAP
    • Impala
    • Spark (TPC-DS)
0.5.0

Crater Lake

RELEASED

  • Stability improvements
  • Performance and Scale
  • High Availability
  • Topology awareness.
  • Management Console
  • Disk Scanner
  • Centralized Management
  • UI updates to SCM and OM.
  • Decommissioning
  • Long-running tests based on Apache NIFI, Hive, and Spark.
  • Able to handle 1 Billion objects.
  • GDPR Right to Erasure
  • Network Topology awareness for block placement.
  • Recon Server V1
  • Disk scanner and ability to detect block corruptions.
  • Hadoop Configurations are hard to manage, make it easy for ozone.
  • Support Decommission.
0.4.1

Biscayne

RELEASED

  • Stability improvements
  • Ozone Native ACL support
  • First class K8s support
  • Support Native ACLs in Ozone.
  • Ozone becomes K8s aware.
0.4.0

Badlands

RELEASED

Security
  • Hadoop Delegation Tokens and Block Tokens supported for Ozone.
  • Transparent Data Encryption (TDE) Support - Allows data blocks to be encrypted-at-rest.
  • Kerberos support for Ozone.
  • Certificate Infrastructure for Ozone  - Tokens use PKI instead of shared secrets.
  • to communication secured via mutual TLS.
  • Ability secure ozone cluster that works with Yarn, Hive, and Spark.
  • Helm/ support to deploy Ozone clusters on K8s.
  • Support S3 Authentication Mechanisms like - S3 v4 Authentication protocol.
  • S3 Gateway supports upload.
  • Support S3A file system
  • Support for Tracing and Profiling for all Ozone components.
  • Audit Support - including Audit Parser tools.
  • Apache Ranger Support in Ozone.
0.3.0

Arches

RELEASED

S3 Protocol head
  • Create an S3 protocol head that can work with Ozone.
  • Ingest via S3 protocol head, process data via Ozone FS.
  • Support a minimally complete S3 API set.
  • Make sure that AWS CLI and AWS Java SDK works correctly against the protocol head
  • Large Scale and complete testing of Application Stack. YARN, Hive, and Spark.
0.2.1

Acadia

RELEASED

Basic Ozone functionality 

  • Ozone FS
  • Command Shell
  • Java SDK.
  • Be able to create ozone volumes, buckets, and Keys.
  • Create a large number of keys. Millions of keys tested.
  • Write large single key – 50GBs +
  • Support Ozone REST and RPC protocols.
  • User facing documentation
  • Ship Java client Libraries for Ozone supporting both RPC and REST.
  • Meet Apache Release criteria.
  • Make sure YARN, Hive, and Spark applications can work against Ozone FS.

...