Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Migrated to Confluence 5.3

...

Setting up the BookKeeper Journal Manager

http://zookeeper.apache.org/bookkeeper/docs/r4.0.0/bookkeeperConfig.htmlImage Removed covers the step necessary to set up a BookKeeper cluster. We recommend that you use at least 3 servers to ensure fault tolerance.

Once BookKeeper has been set up, you can configure the journal manager. Currently, JournalManagers are only available in trunk and 0.23.3 branches. BookKeeper JournalManager is available in trunk, but the most recent version is at https://github.com/ivankelly/hadoop-common/tree/BKJM-benchingImage Removed. All the changes in this branch are pending submission into trunk. For this guide we will use this branch.

...

The web interface should now be available at http://localhost:50070/Image Removed.

Benchmarks

We ran benchmarks on a cluster of machines with:

...

Key

Description

BookKeeper e3q2

BookKeeper journal manager, with a an ensemble of 3 and quorum of 2, each Bookie using separate disk for journal and ledger.

BookKeeper e6q2

BookKeeper journal manager, with a an ensemble of 3 and quorum of 2, each Bookie using separate disk for journal and ledger.

BookKeeper e3q2 1 disk

BookKeeper journal manager, with a an ensemble of 3 and quorum of 2, each Bookie using single disk for journal and ledger.

BookKeeper e6q2 1 disk

BookKeeper journal manager, with a an ensemble of 3 and quorum of 2, each Bookie using single disk for journal and ledger.

BookKeeper local (q1e1)

BookKeeper journal manager, with a single Bookie on the same machine as the namenode, using single disk for journal and ledger.

File

File journal manager with a local file on a dedicated disk

NFS

File journal manager with a file stored on enterprise NetApp Filer

...