Extract Transform Load (ETL) Example
The ETL (Extract, Transform, Load) example shows how to load data into a database using Camel. In this example we will poll for files, transform them and then store them in the database via the JPA component.
Overview
This example lives in the examples/camel-example-etl directory and will poll for XML files in the child src/data directory. When the files are detected, they are converted, using the fallback JAXB Type Converter to a PersonDocument class. This POJO is then transformed using a custom Type Converter into a CustomerEntity bean using the CustomerTransformer class. Then this bean is stored in the database via the JPA component.
The code for this example is as follows
Java Class |
Purpose |
---|---|
The JPA entity bean (i.e. a POJO with @Entity) |
|
The JAXB2 POJO used to parse the XML |
|
The custom Type Converter used to convert a PersonDocument into a CustomerEntity |
|
The Camel routing DSL to define the flow from the files to the converter to the JPA endpoint |
The there is the spring configuration file in src/resources/META-INF/services/camel-context.xml which defines the JPA template and tells Camel to look in the org.apache.camel.example.etl package to find its routes.
Code walkthrough
So lets start with the route definition in EtlRoutes
Running the example
To run the example we use the Camel Maven Plugin. For example from the source or binary distribution the following should work
cd examples/camel-example-etl mvn camel:run