...

Info

title	Zookeeper Connect String

Once you setup zookeeper, please note down the zookeeper connect string which will be used by our Distributed Configuration Publisher to connect to zookeeper. The connect string looks like IP1:PORT1,IP2:PORT2,...,IPn:PORTn where IP is the ip address of each zookeeper node and port is the client port on which each zookeeper server is listening on.

Set the environment variable ZK_CONNECT_STRING.

Info
ex: export ZK_CONNECT_STRING=localhost:2181

Configuring configuration publisher

Now, download the latest distribution of apache OODT and extract it. There is a directory named config which contains the scripts required to publish configuration to zookeeper. Inside that directory will be conf-publisher executable and etc, examples, lib directories and config-publisher executable. Out of those, etc contains log4j.xml for logging configuration and config-publisher.xml for configuring the configuration to be stored in zookeeper. examples contains some example configuration files for resource manager and file manager. For us to publish/store configuration in zookeeper, we need to modify the config-publisher.xml in the etc directory. You will find the following default content in that file out of the box.

...

Code Block

language	xml
theme	Eclipse
title	config-publisher.xml
linenumbers	true

<beans xmlns="http://www.springframework.org/schema/beans"
       xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
       xsi:schemaLocation="http://www.springframework.org/schema/beans http://www.springframework.org/schema/beans/spring-beans-2.5.xsd">
 
    <!-- Configuration publisher for File Manager example OODTconfiguration Componentpublisher -->
    <bean id="filemgr-config-publisher" class="org.apache.oodt.config.distributed.cli.DistributedConfigurationPublisher">

        <constructor-arg value="filemgrFILE_MANAGER"/>

        <property name="propertiesFiles">
            <map <!-- An optional project name, if you want to run several instances of the same component with different configuration -->
        <!--<constructor-arg value="project-x"/>-->

        <property name="propertiesFiles">
            <map key-type="java.lang.String" value-type="java.lang.String">
                <entry key="examples/filemgr/filemgr.properties" value="/etc/filemgr.properties"/>
            </map>
        </property>
        <property name="configFiles">
            <map key-type="java.lang.String" value-type="java.lang.String"<entry key="examples/filemgr/logging.properties" value="/etc/logging.properties"/>
                <entry key="examples/filemgr/mime-typesindexer.xmlproperties" value="/etc/mime-typesindexer.xmlproperties"/>
                <entry key="examples/filemgr/cmdmime-line-actionstypes.xml" value="/policyetc/cmdmime-line-actionstypes.xml"/>
            </map>
    <entry key="examples/filemgr/cmd-line-options.xml" value="/policy/cmd-line-options.xml"/    </property>

        <property name="configFiles">
                <entry<map key-type="examples/filemgr/oodt/elements.xmljava.lang.String" value-type="/policy/oodt/elements.xml"/java.lang.String">
                <entry <!-- Examples - Core-->
                <entry key="examples/filemgr/core/elements.xml" value="/policy/core/elements.xml"/>
                <entry key="examples/filemgr/oodtcore/product-types.xml" value="/policy/oodtcore/product-types.xml"/>
                <entry key="examples/filemgr/oodtcore/product-type-element-map.xml" value="/policy/oodtcore/product-type-element-map.xml"/>
 
            </map>    <!-- Examples - Geo-->
        </property>
    </bean>

</beans>

This is a spring configuration file where beans of type DistributedConfigurationPublisher needs to be defined for each OODT component you wish to deploy with the help of distributed configuration management feature. There is only one bean defined in the above example, which is responsible fore storing configuration related to file manager OODT component. Let's look at how this should be configured.

...

Then set the constructor argument value of that bean to the name of the OODT component you wish to publish configuration for. In the above example, it is filemgr which is the shorthand name used internally for OODT File Manager. List of shorthand names that should be used per component is listed below.

Tip

title	Shorthand names for OODT components

Following shorthand names need to be used when configuring the config-publisher.xml to publish configuration for any OODT component. Using the following naming convention is mandatory because these shorthand names are being used internally for creating ZNodes in zookeeper.

OODT Component Name	Shorthand name to be used when configuring config-publisher.xml
File Manager	filemgr
Resource Manager	resmgr

...

Now, we have to set the properties files to be stored in zookeeper for our selected OODT component. Since properties files and other configuration files need to be treated in a different manner at run time, properties files are considered separately. Following fragment from our example config-publisher.xml shows how we should define the configuration files to be stored in zookeeper.

Code Block

language	xml

<property name="propertiesFiles">
    <map key-type="java.lang.String" value-type="java.lang.String">
        <entry key="examples/filemgr/filemgr.properties" value="/etc/filemgr.properties"/>
    </map>
</property>

Configuration takes a map of key value pairs where the key of each entry stands for the location (in your local machine) of the properties file to be stored in zookeeper. Value of each entry stands for the location where the corresponding properties file should be available once downloaded from zookeeper. For example,

<entry key="examples/filemgr/filemgr.properties" value="/etc/filemgr.properties"/>

says that the file located at ../examples/filemgr/filemgr.properties (relative to bin directory) needs to be available at ${OODT_COMPONENT_HOME}/etc/filemgr.properties location when being downloaded by the deployed instances.

...

Similarly we have to setup the configuration files other than properties files to be stored in zookeeper. Example configuration fragment is shown below.

Code Block

language	xml

<property name="configFiles">
    <map key-type="java.lang.String" value-type="java.lang.String">
        <entry key="examples/filemgr/mime-types.xml" value="/etc/mime-types.xml"/>
        <entry key="examples/filemgr/cmd-line-actions.xml" value="/policy/cmd-line-actions.xml"/>
        <entry key="examples/filemgr/cmd-line-options.xml" value="/policy/cmd-line-options.xml"/>
        <entry key="examples/filemgr/oodt/elements.xml" value="/policy/oodt/elements.xml"/>
        <entry key="examples/filemgr/oodt/product-types.xml" value="/policy/oodt/product-types.xml"/>
        <entry key="examples/filemgr/oodt/product-type-element-map.xml" value="/policy/oodt/product-type-element-map.xml"/>
    </map>
</property>

As explained in the previous point, we have to give a mapping of local files to be stored in zookeeper along with the desired location of those files to be available relatively to ${OODT_COMPONENT_HOME} during run time. For example,

<entry key="examples/filemgr/oodt/product-types.xml" value="/policy/oodt/product-types.xml"/>

says that the file located at examples/filemgr/oodt/product-types.xml (relative to bin directory) needs to be available at ${OODT_COMPONENT_HOME}//policy/oodt/product-types.xml location when being downloaded by the deployed instances.

...

We have now finished configuring the configuration publisher for file manager OODT component in the above steps. Similarly we can configure configuration publisher beans for other OODT components as per our requirement.

Publishing Configuration - Configuration Publisher CLI

We have now configured our config-publisher.xml with the required corresponding spring beans to match the OODT components we need to deploy with the help of distributed configuration management. Now we can use the Configuration publisher CLI to actually publish/store the contents in the configuration files in zookeeper for deployed OODT components to download. The configuration publisher executable is located in the bin directory and it is named conf-publisher. If you just run the conf-publisher as below without any arguments, it will print the usage as follows.

Code Block

language	bash

./conf-publisher
There's an error in your command
 -clear             : Unpublish any configuration which has been published
                      earlier using the same spring config file (default: false)
 -connectString VAL : Zookeeper connect string
 -publish           : Publishes configuration specified in the spring config
                      file to zookeeper. Any current similar config in
                      zookeeper will be overwritten. If not specified, command
                      will be assumed as a publish (default: false)
 -verify            : Verifies the content in the local files and the published
                      ones. Results will be printed. (default: false)
Finished

As shown above, the CLI provides 3 major functions,

publish - Stores configuration specified in the config-publisher.xml in zookeeper
verify - Verifies whether the content stored in zookeeper are identical to the content in the configuration files (original files which we just published to zookeeper) stored locally.
clear - Removes any configuration data stored in zookeeper. This will delete only the configuration stored in zookeeper using the same config-publisher.xml. Therefore, users do not have to worry about all configuration being removed from zookeeper.

Also note that we need to give the zookeeper connect string with the -connectString option to the CLI so that the CLI will know to which zookeeper ensemble to connect to. Our next step is running the conf-publisher. Executing

conf-publisher -connectString <zookeeper-connect-string> -publish

in the bin directory will execute the configuration publisher and store all the configuration specified in zookeeper. Following is the possible output you will get.

Code Block

language	text

ubuntu@ubuntu: bin$ ./conf-publisher -connectString 127.0.0.1:2181 -publish


Starting Distributed Configuration Publisher 
log4j:WARN Continuable parsing error 40 and column 23
log4j:WARN The content of element type "log4j:configuration" must match "(renderer*,appender*,(category|logger)*,root?,categoryFactory?)".
Starting configuration publishing
INFO ClassPathXmlApplicationContext - Refreshing org.springframework.context.support.ClassPathXmlApplicationContext@6ed3ef1: display name [org.springframework.context.support.ClassPathXmlApplicationContext@6ed3ef1]; startup date [Sun Jul 09 18:11:50 IST 2017]; root of context hierarchy
INFO XmlBeanDefinitionReader - Loading XML bean definitions from class path resource [etc/config-publisher.xml]
INFO ClassPathXmlApplicationContext - Bean factory for application context [org.springframework.context.support.ClassPathXmlApplicationContext@6ed3ef1]: org.springframework.beans.factory.support.DefaultListableBeanFactory@5b464ce8
INFO DefaultListableBeanFactory - Pre-instantiating singletons in org.springframework.beans.factory.support.DefaultListableBeanFactory@5b464ce8: defining beans [filemgr-config-publisher]; root of factory hierarchy
INFO DistributedConfigurationPublisher - Using zookeeper connect string : 127.0.0.1:2181
INFO DistributedConfigurationPublisher - Curator framework start operation invoked
INFO DistributedConfigurationPublisher - Waiting to connect to zookeeper, startupTimeout : 30000
INFO DistributedConfigurationPublisher - CuratorFramework client started successfully


Processing commands for component : filemgr
Publishing configuration for : filemgr
INFO DistributedConfigurationPublisher - Publishing configuration examples/filemgr/filemgr.properties - /etc/filemgr.properties
INFO DistributedConfigurationPublisher - Replaced old published configuration at /etc/filemgr.properties with content of file : examples/filemgr/filemgr.properties
INFO DistributedConfigurationPublisher - Properties files published successfully
INFO DistributedConfigurationPublisher - Publishing configuration examples/filemgr/mime-types.xml - /etc/mime-types.xml
INFO DistributedConfigurationPublisher - Replaced old published configuration at /etc/mime-types.xml with content of file : examples/filemgr/mime-types.xml
INFO DistributedConfigurationPublisher - Publishing configuration examples/filemgr/cmd-line-actions.xml - /policy/cmd-line-actions.xml
INFO DistributedConfigurationPublisher - Replaced old published configuration at /policy/cmd-line-actions.xml with content of file : examples/filemgr/cmd-line-actions.xml
INFO DistributedConfigurationPublisher - Publishing configuration examples/filemgr/cmd-line-options.xml - /policy/cmd-line-options.xml
INFO DistributedConfigurationPublisher - Replaced old published configuration at /policy/cmd-line-options.xml with content of file : examples/filemgr/cmd-line-options.xml
INFO DistributedConfigurationPublisher - Publishing configuration examples/filemgr/oodt/elements.xml - /policy/oodt/elements.xml
INFO DistributedConfigurationPublisher - Replaced old published configuration at /policy/oodt/elements.xml with content of file : examples/filemgr/oodt/elements.xml
INFO DistributedConfigurationPublisher - Publishing configuration examples/filemgr/oodt/product-types.xml - /policy/oodt/product-types.xml
INFO DistributedConfigurationPublisher - Replaced old published configuration at /policy/oodt/product-types.xml with content of file : examples/filemgr/oodt/product-types.xml
INFO DistributedConfigurationPublisher - Publishing configuration examples/filemgr/oodt/product-type-element-map.xml - /policy/oodt/product-type-element-map.xml
INFO DistributedConfigurationPublisher - Replaced old published configuration at /policy/oodt/product-type-element-map.xml with content of file : examples/filemgr/oodt/product-type-element-map.xml
INFO DistributedConfigurationPublisher - Config files published successfully
Published configuration for : filemgr
INFO DistributedConfigurationPublisher - Configuration publisher destroyed
INFO DistributedConfigurationPublisher - Exiting CLI ...
Finished

Now we have published our configuration to zookeeper successfully.

Using Distributed Configuration Management

Once the configuration is published to zookeeper, we can deploy our OODT components to corresponding servers in the cluster. At this point, if we want to use the distributed configuration management in those instances, we have to follow the following steps.

First, we should enable distributed configuration management by setting the org.apache.oodt.config.distributed system property to true.
Then, we must either specify the zookeeper connect string as the org.apache.oodt.config.zk.connectString system property or specify the properties file (file location as org.apache.oodt.config.zkProperties) in which we have set the aforementioned property for zookeeper connect string.
When the above two steps are completed, we can run any OODT component with the support of distributed configuration management.

Example with file manager. We need to add the following two properties to filemgr executable.

Code Block

language	text

-Dorg.apache.oodt.config.zk.connectString=<zookeeper-connect-string> \
-Dorg.apache.oodt.config.distributed=true \

Alternatively,

You can set the following two environment variables before executing your component. The bash script will pick those environment variables and set the above mentioned system properties accordingly.

...

language	text

...

        <entry key="examples/filemgr/geo/elements.xml" value="/policy/geo/elements.xml"/>
                <entry key="examples/filemgr/geo/product-types.xml" value="/policy/geo/product-types.xml"/>
                <entry key="examples/filemgr/geo/product-type-element-map.xml" value="/policy/geo/product-type-element-map.xml"/>
 
                <!-- Examples - Trace-->
                <entry key="examples/filemgr/trace/elements.xml" value="/policy/trace/elements.xml"/>
                <entry key="examples/filemgr/trace/product-types.xml" value="/policy/trace/product-types.xml"/>
                <entry key="examples/filemgr/trace/product-type-element-map.xml" value="/policy/trace/product-type-element-map.xml"/>
 
                <!-- Examples - DRAT-->
                <entry key="examples/filemgr/drat/elements.xml" value="/policy/drat/elements.xml"/>
                <entry key="examples/filemgr/drat/product-types.xml" value="/policy/drat/product-types.xml"/>
                <entry key="examples/filemgr/drat/product-type-element-map.xml" value="/policy/drat/product-type-element-map.xml"/>
            </map>
        </property>
    </bean>
</beans>

This is a spring configuration file where beans of type DistributedConfigurationPublisher needs to be defined for each OODT component you wish to deploy with the help of distributed configuration management feature. There is only one bean defined in the above example, which is responsible fore storing configuration related to file manager OODT component. Let's look at how this should be configured.

First define a bean of type org.apache.oodt.config.distributed.cli.DistributedConfigurationPublisher and give it a meaningful id. In the above example, we have given filemgr-config-publisher for the bean id.

Then set the constructor argument of that bean to the enum type of the OODT component you wish to publish configuration for. This value should be of enum type org.apache.oodt.config.Component. In the above example, it is org.apache.oodt.config.Component.FILE_MANAGER which stands for OODT File Manager. List of enum values that should be used per component is listed below.

Tip

title	Shorthand names for OODT components

Following enum types need to be used (as constructor argument) when configuring the config-publisher.xml to publish configuration for any OODT component.

OODT Component Name	Enum types used when configuring config-publisher.xml
File Manager	org.apache.oodt.config.Component.FILE_MANAGER
Resource Manager	org.apache.oodt.config.Component.RESOURCE_MANAGER

Now, we have to set the properties files to be stored in zookeeper for our selected OODT component. Since properties files and other configuration files need to be treated in a different manner at run time, properties files are considered separately. Following fragment from our example config-publisher.xml shows how we should define the configuration files to be stored in zookeeper.

Code Block

language	xml

<property name="propertiesFiles">
	<map key-type="java.lang.String" value-type="java.lang.String">
		<entry key="examples/filemgr/filemgr.properties" value="/etc/filemgr.properties"/>
		<entry key="examples/filemgr/logging.properties" value="/etc/logging.properties"/>
		<entry key="examples/filemgr/indexer.properties" value="/etc/indexer.properties"/>
		<entry key="examples/filemgr/mime-types.xml" value="/etc/mime-types.xml"/>
	</map>
</property>

Configuration takes a map of key value pairs where the key of each entry stands for the location (in your local machine) of the properties file to be stored in zookeeper. Value of each entry stands for the location where the corresponding properties file should be available once downloaded from zookeeper. For example,

<entry key="examples/filemgr/filemgr.properties" value="/etc/filemgr.properties"/>

says that the file located at examples/filemgr/filemgr.properties (relative to oodt-distribution/config directory) needs to be available at ${OODT_COMPONENT_HOME}/etc/filemgr.properties location when being downloaded by the deployed instances.

Similarly we have to setup the configuration files other than properties files to be stored in zookeeper. Example configuration fragment is shown below.

Code Block

language	xml

<property name="configFiles">
	<map key-type="java.lang.String" value-type="java.lang.String">
	    <!-- Examples - Core-->
	    <entry key="examples/filemgr/core/elements.xml" value="/policy/core/elements.xml"/>
	    <entry key="examples/filemgr/core/product-types.xml" value="/policy/core/product-types.xml"/>
	    <entry key="examples/filemgr/core/product-type-element-map.xml" value="/policy/core/product-type-element-map.xml"/>
	    <!-- Examples - Geo-->
	    <entry key="examples/filemgr/geo/elements.xml" value="/policy/geo/elements.xml"/>
	    <entry key="examples/filemgr/geo/product-types.xml" value="/policy/geo/product-types.xml"/>
	    <entry key="examples/filemgr/geo/product-type-element-map.xml" value="/policy/geo/product-type-element-map.xml"/>

	    <!-- Examples - Trace-->
	    <entry key="examples/filemgr/trace/elements.xml" value="/policy/trace/elements.xml"/>
	    <entry key="examples/filemgr/trace/product-types.xml" value="/policy/trace/product-types.xml"/>
	    <entry key="examples/filemgr/trace/product-type-element-map.xml"
		   value="/policy/trace/product-type-element-map.xml"/>

	    <!-- Examples - DRAT-->
	    <entry key="examples/filemgr/drat/elements.xml" value="/policy/drat/elements.xml"/>
	    <entry key="examples/filemgr/drat/product-types.xml" value="/policy/drat/product-types.xml"/>
	    <entry key="examples/filemgr/drat/product-type-element-map.xml" value="/policy/drat/product-type-element-map.xml"/>
	</map>
</property>

As explained in the previous point, we have to give a mapping of local files to be stored in zookeeper along with the desired location of those files to be available relatively to ${OODT_COMPONENT_HOME} during run time. For example,

<entry key="examples/filemgr/core/product-types.xml" value="/policy/core/product-types.xml"/>

says that the file located at examples/filemgr/oodt/product-types.xml (relative to bin directory) needs to be available at ${OODT_COMPONENT_HOME}//policy/oodt/product-types.xml location when being downloaded by the deployed instances.

We have now finished configuring the configuration publisher for file manager OODT component in the above steps. Similarly we can configure configuration publisher beans for other OODT components as per our requirement.

Publishing Configuration - Configuration Publisher CLI

We have now configured our config-publisher.xml with the required corresponding spring beans to match the OODT components we need to deploy with the help of distributed configuration management. Now we can use the Configuration publisher CLI to actually publish/store the contents in the configuration files in zookeeper for deployed OODT components to download. The configuration publisher executable is located in the main conf directory and it is named conf-publisher. If you just run the conf-publisher as below without any arguments, it will print the usage as follows.

Code Block

language	bash

./conf-publisher
Starting Configuration Publisher
-----------------------------------------------------------------------------------------------------------------
| Short | Long                                             | Description
-----------------------------------------------------------------------------------------------------------------

 -a,     --action <action-name>                             This is the name of the action to trigger
 -c,     --config <arg>                                     Configuration publisher spring configuration XML
                                                              Requirement Rules: 
                                                               [publish : OPTIONAL, clear : OPTIONAL, verify : 
                                                               OPTIONAL] 

                                                              Handler: 
                                                               Will invoke 'setConfig' on action selected, except 
                                                               for the following actions: [publish : 
                                                               setConfigFile, verify : setConfigFile, clear : 
                                                               setConfigFile] 

 -cs,    --connectString <arg>                              Connect String to Zookeeper (ip1:port1,ip2:port2,..)
                                                              Requirement Rules: 
                                                               [publish : REQUIRED, clear : REQUIRED, verify : 
                                                               REQUIRED] 

                                                              Handler: 
                                                               Will invoke 'setConnectString' on action selected, 
                                                               except for the following actions: [publish : 
                                                               setConnectString, verify : setConnectString, clear 
                                                               : setConnectString] 

 -h,     --help                                             Prints help menu
 -psa,   --printSupportedActions                            Print Supported Actions
-----------------------------------------------------------------------------------------------------------------

As shown above, the CLI provides 3 major functions,

publish - Stores configuration specified in the config-publisher.xml in zookeeper
verify - Verifies whether the content stored in zookeeper are identical to the content in the configuration files (original files which we just published to zookeeper) stored locally.
clear - Removes any configuration data stored in zookeeper. This will delete only the configuration stored in zookeeper using the same config-publisher.xml. Therefore, users do not have to worry about all configuration being removed from zookeeper.

Also note that we need to give the zookeeper connect string with the -connectString option to the CLI so that the CLI will know to which zookeeper ensemble to connect to. Our next step is running the conf-publisher. Executing

conf-publisher -connectString <zookeeper-connect-string> -a publish

in the bin directory will execute the configuration publisher and store all the configuration specified in zookeeper. Following is the possible output you will get.

Code Block

language	text

ubuntu@ubuntu: bin$ ./conf-publisher -connectString 127.0.0.1:2181 -publish

 
Starting Configuration Publisher
 
log4j:WARN Continuable parsing error 53 and column 23
log4j:WARN The content of element type "log4j:configuration" must match "(renderer*,appender*,(category|logger)*,root?,categoryFactory?)".

INFO  DistributedConfigurationPublisher - Using zookeeper connect string : localhost:2181
INFO  DistributedConfigurationPublisher - Curator framework start operation invoked
INFO  DistributedConfigurationPublisher - Waiting to connect to zookeeper, startupTimeout : 30000
INFO  DistributedConfigurationPublisher - CuratorFramework client started successfully

Publishing configuration for : FILE_MANAGER
INFO  DistributedConfigurationPublisher - Published configuration file examples/filemgr/filemgr.properties to /projects/default/components/filemgr/properties/etc/filemgr.properties
INFO  DistributedConfigurationPublisher - Published configuration file examples/filemgr/logging.properties to /projects/default/components/filemgr/properties/etc/logging.properties
INFO  DistributedConfigurationPublisher - Published configuration file examples/filemgr/indexer.properties to /projects/default/components/filemgr/properties/etc/indexer.properties
INFO  DistributedConfigurationPublisher - Published configuration file examples/filemgr/mime-types.xml to /projects/default/components/filemgr/properties/etc/mime-types.xml
INFO  DistributedConfigurationPublisher - Properties files published successfully
INFO  DistributedConfigurationPublisher - Published configuration file examples/filemgr/core/elements.xml to /projects/default/components/filemgr/configuration/policy/core/elements.xml
INFO  DistributedConfigurationPublisher - Published configuration file examples/filemgr/core/product-types.xml to /projects/default/components/filemgr/configuration/policy/core/product-types.xml
INFO  DistributedConfigurationPublisher - Published configuration file examples/filemgr/core/product-type-element-map.xml to /projects/default/components/filemgr/configuration/policy/core/product-type-element-map.xml
INFO  DistributedConfigurationPublisher - Published configuration file examples/filemgr/geo/elements.xml to /projects/default/components/filemgr/configuration/policy/geo/elements.xml
INFO  DistributedConfigurationPublisher - Published configuration file examples/filemgr/geo/product-types.xml to /projects/default/components/filemgr/configuration/policy/geo/product-types.xml
INFO  DistributedConfigurationPublisher - Published configuration file examples/filemgr/geo/product-type-element-map.xml to /projects/default/components/filemgr/configuration/policy/geo/product-type-element-map.xml
INFO  DistributedConfigurationPublisher - Published configuration file examples/filemgr/trace/elements.xml to /projects/default/components/filemgr/configuration/policy/trace/elements.xml
INFO  DistributedConfigurationPublisher - Published configuration file examples/filemgr/trace/product-types.xml to /projects/default/components/filemgr/configuration/policy/trace/product-types.xml
INFO  DistributedConfigurationPublisher - Published configuration file examples/filemgr/trace/product-type-element-map.xml to /projects/default/components/filemgr/configuration/policy/trace/product-type-element-map.xml
INFO  DistributedConfigurationPublisher - Published configuration file examples/filemgr/drat/elements.xml to /projects/default/components/filemgr/configuration/policy/drat/elements.xml
INFO  DistributedConfigurationPublisher - Published configuration file examples/filemgr/drat/product-types.xml to /projects/default/components/filemgr/configuration/policy/drat/product-types.xml
INFO  DistributedConfigurationPublisher - Published configuration file examples/filemgr/drat/product-type-element-map.xml to /projects/default/components/filemgr/configuration/policy/drat/product-type-element-map.xml
INFO  DistributedConfigurationPublisher - Config files published successfully
Published configuration for : FILE_MANAGER

INFO  DistributedConfigurationPublisher - Configuration publisher destroyed
Exiting CLI ...

OK

Now we have published our configuration to zookeeper successfully.

Using Distributed Configuration Management

Once the configuration is published to zookeeper, we can deploy our OODT components to corresponding servers in the cluster. At this point, if we want to use the distributed configuration management in those instances, we have to follow the following steps.

First, we should enable distributed configuration management by setting the OODT_DISTRIBUTED_CONF environment variable to true.
Then, we must either specify the zookeeper connect string as the ZK_CONNECT_STRING environment variable.
When the above two steps are completed, we can run any OODT component with the support of distributed configuration management.

Example with file manager. We need to set the following two environment variables.

Code Block

language	text

export OODT_DISTRIBUTED_CONF=true
export ZK_CONNECT_STRING=<zookeeper-connect-string>

When you run the file manager (complete oodt project may be) now, you will see a result similar to the following.

Code Block

language	text
linenumbers	true

Using CATALINA_BASE:   /home/imesha/drat/deploy/tomcat
Using CATALINA_HOME:   /home/imesha/drat/deploy/tomcat
Using CATALINA_TMPDIR: /home/imesha/drat/deploy/tomcat/temp
Using JRE_HOME:        /opt/jdk
Using CLASSPATH:       /home/imesha/drat/deploy/tomcat/bin/bootstrap.jar:/home/imesha/drat/deploy/tomcat/bin/tomcat-juli.jar
Resource Manager started PID file (/home/imesha/drat/deploy/resmgr/run/cas.resmgr.pid).
Workflow Manager started PID file (/home/imesha/drat/deploy/workflow/run/cas.workflow.pid).
Tomcat started.
Aug 15, 2017 10:40:48 AM org.apache.oodt.cas.resource.system.XmlRpcResourceManager <init>
INFO: Loading Resource Manager Configuration Properties from: [/home/imesha/drat/deploy/resmgr/etc/resource.properties]
Aug 15, 2017 10:40:48 AM org.apache.oodt.cas.resource.system.XmlRpcResourceManager <init>
INFO: Resource Manager started by imesha
Aug 15, 2017 10:40:48 AM org.apache.oodt.cas.workflow.system.XmlRpcWorkflowManager loadProperties
INFO: Loading Workflow Manager Configuration Properties from: [/home/imesha/drat/deploy/workflow/etc/workflow.properties]
log4j:WARN Continuable parsing error 53 and column 23
log4j:WARN The content of element type "log4j:configuration" must match "(renderer*,throwableRenderer?,appender*,plugin*,(category|logger)*,root?,(categoryFactory|loggerFactory)?)".
INFO  ConfigurationManagerFactory - Using distributed configuration management for FILE_MANAGER
INFO  DistributedConfigurationManager - Using zookeeper connect string : 127.0.0.1:2181
INFO  DistributedConfigurationManager - Curator framework start operation invoked
INFO  DistributedConfigurationManager - Waiting to connect to zookeeper, startupTimeout : 30000
INFO  DistributedConfigurationManager - CuratorFramework client started successfully
INFO  DistributedConfigurationManager - Properties loaded from ZNode at : /projects/default/components/filemgr/properties/etc/indexer.properties
WARN  DistributedConfigurationManager - Deleting already existing file at /home/imesha/drat/deploy/filemgr/etc/indexer.properties before writing new content
INFO  DistributedConfigurationManager - File from ZNode at etc/indexer.properties saved to /home/imesha/drat/deploy/filemgr/etc/indexer.properties
INFO  DistributedConfigurationManager - Properties loaded from ZNode at : /projects/default/components/filemgr/properties/etc/filemgr.properties
WARN  DistributedConfigurationManager - Deleting already existing file at /home/imesha/drat/deploy/filemgr/etc/filemgr.properties before writing new content
INFO  DistributedConfigurationManager - File from ZNode at etc/filemgr.properties saved to /home/imesha/drat/deploy/filemgr/etc/filemgr.properties
Aug 15, 2017 10:40:49 AM org.apache.oodt.cas.workflow.engine.ThreadPoolWorkflowEngineFactory getResmgrUrl
INFO: No Resource Manager URL provided or malformed URL: executing jobs locally. URL: [null]
INFO  DistributedConfigurationManager - Properties loaded from ZNode at : /projects/default/components/filemgr/properties/etc/mime-types.xml
WARN  DistributedConfigurationManager - Deleting already existing file at /home/imesha/drat/deploy/filemgr/etc/mime-types.xml before writing new content
INFO  DistributedConfigurationManager - File from ZNode at etc/mime-types.xml saved to /home/imesha/drat/deploy/filemgr/etc/mime-types.xml
INFO  DistributedConfigurationManager - Properties loaded from ZNode at : /projects/default/components/filemgr/properties/etc/logging.properties
WARN  DistributedConfigurationManager - Deleting already existing file at /home/imesha/drat/deploy/filemgr/etc/logging.properties before writing new content
INFO  DistributedConfigurationManager - File from ZNode at etc/logging.properties saved to /home/imesha/drat/deploy/filemgr/etc/logging.properties
INFO  DistributedConfigurationManager - Properties loaded for : FILE_MANAGER
WARN  DistributedConfigurationManager - Deleting already existing file at /home/imesha/drat/deploy/filemgr/policy/geo/elements.xml before writing new content
INFO  DistributedConfigurationManager - File from ZNode at policy/geo/elements.xml saved to /home/imesha/drat/deploy/filemgr/policy/geo/elements.xml
WARN  DistributedConfigurationManager - Deleting already existing file at /home/imesha/drat/deploy/filemgr/policy/geo/product-type-element-map.xml before writing new content
INFO  DistributedConfigurationManager - File from ZNode at policy/geo/product-type-element-map.xml saved to /home/imesha/drat/deploy/filemgr/policy/geo/product-type-element-map.xml
WARN  DistributedConfigurationManager - Deleting already existing file at /home/imesha/drat/deploy/filemgr/policy/geo/product-types.xml before writing new content
INFO  DistributedConfigurationManager - File from ZNode at policy/geo/product-types.xml saved to /home/imesha/drat/deploy/filemgr/policy/geo/product-types.xml
WARN  DistributedConfigurationManager - Deleting already existing file at /home/imesha/drat/deploy/filemgr/policy/core/elements.xml before writing new content
INFO  DistributedConfigurationManager - File from ZNode at policy/core/elements.xml saved to /home/imesha/drat/deploy/filemgr/policy/core/elements.xml
WARN  DistributedConfigurationManager - Deleting already existing file at /home/imesha/drat/deploy/filemgr/policy/core/product-type-element-map.xml before writing new content
INFO  DistributedConfigurationManager - File from ZNode at policy/core/product-type-element-map.xml saved to /home/imesha/drat/deploy/filemgr/policy/core/product-type-element-map.xml
WARN  DistributedConfigurationManager - Deleting already existing file at /home/imesha/drat/deploy/filemgr/policy/core/product-types.xml before writing new content
INFO  DistributedConfigurationManager - File from ZNode at policy/core/product-types.xml saved to /home/imesha/drat/deploy/filemgr/policy/core/product-types.xml
WARN  DistributedConfigurationManager - Deleting already existing file at /home/imesha/drat/deploy/filemgr/policy/trace/elements.xml before writing new content
INFO  DistributedConfigurationManager - File from ZNode at policy/trace/elements.xml saved to /home/imesha/drat/deploy/filemgr/policy/trace/elements.xml
WARN  DistributedConfigurationManager - Deleting already existing file at /home/imesha/drat/deploy/filemgr/policy/trace/product-type-element-map.xml before writing new content
INFO  DistributedConfigurationManager - File from ZNode at policy/trace/product-type-element-map.xml saved to /home/imesha/drat/deploy/filemgr/policy/trace/product-type-element-map.xml
WARN  DistributedConfigurationManager - Deleting already existing file at /home/imesha/drat/deploy/filemgr/policy/trace/product-types.xml before writing new content
INFO  DistributedConfigurationManager - File from ZNode at policy/trace/product-types.xml saved to /home/imesha/drat/deploy/filemgr/policy/trace/product-types.xml
WARN  DistributedConfigurationManager - Deleting already existing file at /home/imesha/drat/deploy/filemgr/policy/drat/elements.xml before writing new content
INFO  DistributedConfigurationManager - File from ZNode at policy/drat/elements.xml saved to /home/imesha/drat/deploy/filemgr/policy/drat/elements.xml
WARN  DistributedConfigurationManager - Deleting already existing file at /home/imesha/drat/deploy/filemgr/policy/drat/product-type-element-map.xml before writing new content
INFO  DistributedConfigurationManager - File from ZNode at policy/drat/product-type-element-map.xml saved to /home/imesha/drat/deploy/filemgr/policy/drat/product-type-element-map.xml
WARN  DistributedConfigurationManager - Deleting already existing file at /home/imesha/drat/deploy/filemgr/policy/drat/product-types.xml before writing new content
INFO  DistributedConfigurationManager - File from ZNode at policy/drat/product-types.xml saved to /home/imesha/drat/deploy/filemgr/policy/drat/product-types.xml
INFO  DistributedConfigurationManager - Configuration files saved for : FILE_MANAGER
Aug 15, 2017 10:40:50 AM org.apache.oodt.cas.workflow.system.XmlRpcWorkflowManager <init>
INFO: Workflow Manager started by imesha
Aug 15, 2017 10:40:50 AM org.apache.oodt.cas.filemgr.repository.XMLRepositoryManagerFactory <init>
FINE: Collecting XML policies from the following directories:
Aug 15, 2017 10:40:50 AM org.apache.oodt.cas.filemgr.repository.XMLRepositoryManagerFactory <init>
FINE: file:///home/imesha/drat/deploy/filemgr/policy/core
Aug 15, 2017 10:40:50 AM org.apache.oodt.cas.filemgr.repository.XMLRepositoryManagerFactory <init>
FINE: file:///home/imesha/drat/deploy/filemgr/policy/geo
Aug 15, 2017 10:40:50 AM org.apache.oodt.cas.filemgr.repository.XMLRepositoryManagerFactory <init>
FINE: file:///home/imesha/drat/deploy/filemgr/policy/trace
Aug 15, 2017 10:40:50 AM org.apache.oodt.cas.filemgr.repository.XMLRepositoryManagerFactory <init>
FINE: file:///home/imesha/drat/deploy/filemgr/policy/drat
Aug 15, 2017 10:40:50 AM org.apache.oodt.cas.filemgr.util.XmlStructFactory getProductType
WARNING: metadata node missing for product type : urn:oodt:GenericFile
Aug 15, 2017 10:40:50 AM org.apache.oodt.cas.filemgr.repository.XMLRepositoryManager loadProductTypes
FINE: XMLRepositoryManager: found product type: [GenericFile]
Aug 15, 2017 10:40:50 AM org.apache.oodt.cas.filemgr.repository.XMLRepositoryManager loadProductTypes
FINE: XMLRepositoryManager: found product type: [LocationAwareProduct]
Aug 15, 2017 10:40:50 AM org.apache.oodt.cas.filemgr.repository.XMLRepositoryManager loadProductTypes
FINE: XMLRepositoryManager: found product type: [TraceableFile]
Aug 15, 2017 10:40:50 AM org.apache.oodt.cas.filemgr.repository.XMLRepositoryManager loadProductTypes
FINE: XMLRepositoryManager: found product type: [RatLog]
Aug 15, 2017 10:40:50 AM org.apache.oodt.cas.filemgr.repository.XMLRepositoryManager loadProductTypes
FINE: XMLRepositoryManager: found product type: [RatAggregateLog]
Aug 15, 2017 10:40:50 AM org.apache.oodt.cas.filemgr.system.XmlRpcFileManagerClient <init>
INFO: Loading File Manager Configuration Properties from: [/home/imesha/drat/deploy/filemgr/etc/filemgr.properties]
Aug 15, 2017 10:40:50 AM org.apache.oodt.cas.filemgr.datatransfer.LocalDataTransferer setFileManagerUrl
INFO: Local Data Transfer to: [http://localhost:9000] enabled
Aug 15, 2017 10:40:50 AM org.apache.oodt.cas.filemgr.system.XmlRpcFileManager <init>
INFO: File Manager started by imesha

You may have noted that the logs say "replacing existing file ...." several times. That is because, if the distributed configuration manager find a file with the same name at a location where a downloaded file to be stored, it will delete the existing file and create a new file with the downloaded content.

org.apache.oodt.config

Space shortcuts

Page tree

Versions Compared

Old Version 6

New Version 7

Key

Configuring configuration publisher

Publishing Configuration - Configuration Publisher CLI

Using Distributed Configuration Management

Alternatively,

Publishing Configuration - Configuration Publisher CLI

Using Distributed Configuration Management

Space shortcuts

Page tree

Page History

Versions Compared

Old Version 6

New Version 7

Key

Configuring configuration publisher

Publishing Configuration - Configuration Publisher CLI

Using Distributed Configuration Management

Alternatively,

Publishing Configuration - Configuration Publisher CLI

Using Distributed Configuration Management