...
Remote Process Groups/Site-to-Site
| Expand |
|---|
Q: How can I send data from one NiFi instance to another? - A: There are generally two approaches to sending data between NiFi instances...
- Push: The sending instance brings data to a remote process group which is pointing at the receiving NiFi, the receiving NiFi has an input port to receive the data - Pull: The sending instance brings data to an output port, and the receiving instance has a remote process group pointing at the output port of the sending instance The advantage of the first approach (push) is that the sending instance is deciding where to send its data, as opposed to data waiting at an output port for anyone to consume
Please add questions about remote process groups/site-to-site here |
Clustering
| Expand |
|---|
Q: I am evaluating NiFi for a large project to see if NiFi would fit as the main data collector. The project I am working on would require retrieving several hundreds of millions of files per day (hundreds of TB per day) so my first question is how to achieve distribution/clustering with NiFi, if that's possible. - A: The NiFi Administrator Guide includes a quick explanation of our clustering capabilities and example configurations. This would be a great place to start and become familiar with NiFi clustering.
|
...