Page History

...

When you look at a project like NiFi, one can imagine that there are quite a few moving parts, so understanding how

all of these parts fits fit together can in itself become pretty daunting.

...

write out the state of all FlowFiles at that point in time, and delete the old write-ahead logs. This prevents the write-ahead logs from growing

indefinitely. For more information on the design and implementation of this repository, see the NiFi Write-Ahead Log Implementation page.

Note: While the FlowFile Repository is pluggable, it is considered a 'private API' and its interface could potentially be changed between

...

periodically "rolls over" the data, indexing and compressing the data. The search capabilities are provided by an embedded Lucene engine.

For more information on how this repository is designed and implemented, see the Persistent Provenance Repository Design page.

Note: While the Provenance Repository is pluggable, it is considered a 'private API' and its interface could potentially be changed between

...