Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

The web interface should now be available at http://localhost:50070/.

Benchmarks

We ran benchmarks on a cluster of machines with:

  • 2x Quad Xeon 2.5 Ghz
  • 16GB RAM
  • 4x 7200RPM Sata disks
  • Gigabit ethernet

The benchmark we ran was NNThroughputBenchmark with a workload to create 200000 files. The number of threads was varied across the run, from 32 to 1024.

Each configuration was run 3 times and the average taken. The following configurations were used:

Key

Description

BookKeeper e3q2

BookKeeper journal manager, with a ensemble of 3 and quorum of 2, each Bookie using separate disk for journal and ledger.

BookKeeper e6q2

BookKeeper journal manager, with a ensemble of 3 and quorum of 2, each Bookie using separate disk for journal and ledger.

BookKeeper e3q2 1 disk

BookKeeper journal manager, with a ensemble of 3 and quorum of 2, each Bookie using single disk for journal and ledger.

BookKeeper e6q2 1 disk

BookKeeper journal manager, with a ensemble of 3 and quorum of 2, each Bookie using single disk for journal and ledger.

BookKeeper local (q1e1)

BookKeeper journal manager, with a single Bookie on the same machine as the namenode, using single disk for journal and ledger.

File

File journal manager with a local file on a dedicated disk

NFS

File journal manager with a file stored on enterprise NetApp Filer