Versions Compared

Old Version 4

changes.mady.by.user Bob Nettleton

Saved on

compared with

New Version 5

changes.mady.by.user Bob Nettleton

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Code Block
{
  "blueprint" : "blueprint-hdfs-ha",
  "default_password" : "default",
  "host_groups" :[
    {
      "name" : "host_group_1", 
      "hosts" : [         
        {
          "fqdn" : "c6401.ambari.apache.org"
        }
      ]
    },
    {
      "name" : "host_group_2", 
      "hosts" : [         
        {
          "fqdn" : "c6402.ambari.apache.org"
        }
      ]
    },
   {
      "name" : "host_group_3", 
      "hosts" : [         
        {
          "fqdn" : "c6403.ambari.apache.org"
        }
      ]
    } 
  ]
}

 

 

Create Cluster Instance

...

Code Block
{
  "blueprint" : "blueprint-yarn-ha",
  "default_password" : "default",
  "host_groups" :[
    {
      "name" : "host_group_1", 
      "hosts" : [         
        {
          "fqdn" : "c6401.ambari.apache.org"
        }
      ]
    },
    {
      "name" : "host_group_2", 
      "hosts" : [         
        {
          "fqdn" : "c6402.ambari.apache.org"
        }
      ]
    },
   {
      "name" : "host_group_3", 
      "hosts" : [         
        {
          "fqdn" : "c6403.ambari.apache.org"
        }
      ]
    } 
  ]
}


 

Create Cluster Instance

...

Post the cluster to the Ambari Server to provision the cluster.

Code Block
POST /api/v1/clusters/my-yarn-ha-cluster
 
...
[ Request Body is above Cluster Creation Template ]
...
 
202 - Accepted
{
  "href" : "http://c6401.ambari.apache.org:8080/api/v1/clusters/my-yarn-ha-cluster/requests/1",
  "Requests" : {
    "id" : 1,
    "status" : "InProgress"
  }
}
 
...
[ Client can then monitor the URL in the 202 response to check the status of the cluster deployment. ]
...
 

Blueprint Example: HBase RegionServer HA Cluster

Summary


HBase provides a High Availability feature for reads across HBase Region Servers.  

...

http://hbase.apache.org/book.html#arch.timelineconsistent.readsNote:

 

Note

The documentation listed here explains how to deploy an HBase RegionServer HA cluster via a Blueprint, but there are separate application-specific steps that must be taken in order to enable this feature for a specific table in HBase.  A table must be created with replication enabled, so that multiple Region Servers can handle the keys for this table. 

 

For more information on how to define an HBase table with replication enabled (after the cluster has been created), please refer to the following HBase documentation:

http://hbase.apache.org/book.html#_creating_a_table_with_region_replication


The following stack components should be included in any host group in a Blueprint that supports an HA HBase RegionServer:

...

At least two “HBASE_REGIONSERVER” components must be deployed in order to enable this feature, so that table information can be replicated across more than one Region Server.  


Example Blueprint

The following link includes an example Blueprint for a 2-node HBase RegionServer HA Cluster:

hbase_rs_ha_blueprint.json

The following JSON snippet includes the “hbase-site” configuration typically required for a cluster that utilizes the HBase RegionServer HA feature:  

 

{

 
Code Block

{
  "configurations" :
[

   {

     
 [
    {
      "hbase-site" :
{         
 {
         ...
       
 
        "hbase.regionserver.global.memstore.lowerLimit" : "0.38",
       

        "hbase.regionserver.global.memstore.upperLimit" : "0.4",
       

        "hbase.regionserver.handler.count" : "60",
       

        "hbase.regionserver.info.port" : "60030",
       "hbase.

        "hbase.regionserver.storefile.refresh.period" : "20",
       

        "hbase.rootdir" : "hdfs://%HOSTGROUP::host_group_1%:8020/apps/hbase/data",
       

        "hbase.security.authentication" : "simple",
       

        "hbase.security.authorization" : "false",
       

        "hbase.superuser" : "hbase",
       

        "hbase.tmp.dir" : "/hadoop/hbase",
       

        "hbase.zookeeper.property.clientPort" : "2181",
       

        "hbase.zookeeper.quorum" : "%HOSTGROUP::host_group_1%,%HOSTGROUP::host_group_2%",
       

        "hbase.zookeeper.useMulti" : "true",
       

        "hfile.block.cache.size" : "0.40",
       

        "zookeeper.session.timeout" : "30000",
       "zookeeper

        "zookeeper.znode.parent" : "/hbase-unsecure"

     }

   }

 

...


      }

    }
   ]
}

 

 

Note

The JSON example above is not a complete set of “hbase-site” configurations, but rather shows the configuration settings that are relevant to HBase RegionServer HA.  In particular, the “hbase.regionserver.storefile.refresh.period” setting has been highlighted, since this property must be set to a value greater than zero in order for the HA feature to be enabled.

(Insert link to full HBase RegionServer HA Blueprint here.)


Register Blueprint with Ambari Server

Post the blueprint to the "blueprint-hbase-rs-ha" resource to the Ambari Server.

 

Code Block
POST /api/v1/blueprints/blueprint-hbase-rs-ha
 
...
[ Request Body is the example blueprint defined above ]
...
 
201 - Created

 

Will use the same text from John’s earlier Blueprint examples here, since the APIs used for deploying an HA Blueprint are identical to any other Blueprint.  

  1. Example Cluster Creation Template

...