...
The code for the extensions can be found on GitHub. (module streampipes-extensions)
Prerequisites
Install:
- Java
- Maven
- Docker + Docker-Compose
- Here we describe the setup in IntelliJ (we do provide run configuration files to ease the configuration setup), but you can use an IDE of your choice
...
Set-Up StreamPipes Services
Clone Installer Project [Link]
Code Block language bash title Prepare Installer # SSH git clone git@github.com:apache/incubator-streampipes-installer.git # HTTPS git clone https://github.com/apache/incubator-streampipes-installer.git # switch to development branch git checkout dev
Open CLI directory
Code Block language bash title Prepare Installer cd incubator-streampipes-/installer cd /cli/
Configure StreamPipes for backend development
Code Block language bash title Prepare Installer ./streampipes env --set pipeline-element # Updates the file 'pipeline-element'. All StreamPipes services required for development are selected
Start third party services (e.g. CouchDB, Kafka, ... in docker)
Code Block language bash title Prepare Installer ./streampipes up -d
Set-Up repository
Clone StreamPipes [Link]
Code Block language bash title Prepare Installer # SSH git clone git@github.com:apache/incubator-streampipes-extensions.git # HTTPS git clone https://github.com/apache/incubator-streampipes-extensions.git
- Open the project in your IDE
Set-Up for Extensions (Pipeline Elements, Connect Adapter)
...
- You should automatically have a run configuration "all-pipeline-elements-jvm" as we ship in with the repository
- (Optional) Modifiy environment variables depending on your OS (this is due to the dev setup of partly IDE and partly Docker, we need the local services to be reachable from within the Docker network)
- For Windows/Mac user: you are good to go
- For Linux user: You must change the environment variables stating host.docker.internal to you local machine's IP
- Run the service
- Navigate to "http://localhost:7023/" to see if the backend is running. You should see something similar to the following:
Where to go from here?
You can start writing own pipeline elements, that means adapters, processors, sinks.
For example, see the example of a Greeter processor https://github.com/wipatrick/apachecon-demo-processor
We also do provide maven archetypes to easily setup a Maven project skeleton for you, see https://streampipes.apache.org/docs/docs/dev-guide-archetype/