Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

NOTE: THIS FILE WILL NOT BE CHECKED IN, RATHER TRANSFORMED INTO AN APACHE WIKI PAGE
===================================================================================

GUIDE: USING OODT FILE MANAGER WITH A SOLR METADATA STORE BACK-END
==================================================================

Introduction

------------The Apache OODT File Manager and Apache Solr are in many respects two complementary technologies
that can be combined to offer a very attractive solution for managing scientific data and metadata.
The File Manager is a service for archiving and retrieving data products (files and directories),
typically used as part of a data distribution service or data processing pipeline.
Solr is a scalable, high performance search engine that provides a web based API on top of the underlying
Lucene index. By deploying an OODT File Manager backed-up by a Solr metadata store,
a scientific project can leverage the product creation and ingestion functionality of the OODT framework,
together with the fast and powerful query capabilities offered by Solr.

Architecture

...

When the File Manager is deployed with a Solr-based metadata catalog, the overall system architecture is composed of the following tiers:

File Manager (archive) clients < -- > File Manager <> Solr <->       --             Solr                             -- Solr (query) clients
                                              (default port:9000) (default ports: 80, 8080 or 8983)

...

filemgr.catalog.factory=org.apache.oodt.cas.filemgr.catalog.solr.SolrCatalogFactory
org.apache.oodt.cas.filemgr.catalog.solr.url=http://localhost:8983/solrImage Removed
#org.apache.oodt.cas.filemgr.catalog.solr.productIdGenerator=org.apache.oodt.cas.filemgr.catalog.solr.NameProductIdGenerator
#org.apache.oodt.cas.filemgr.catalog.solr.productSerializer=org.apache.oodt.cas.filemgr.catalog.solr.DefaultProductSerializer
#org.apache.oodt.cas.filemgr.catalog.solr.productDeserializer=org.apache.oodt.cas.filemgr.catalog.solr.DefaultProductDeserializer

...