Version cpp-0.99.2
Release Date: 6 October 2025
New notable features:
- Added support for compilation using the C++23 standard with the following compilers: g++ 12 or later, clang 16 or later, and MSVC 19.33 or later
- Added Linux FHS support, enabling RPM packaging with standard directory conventions
- Added FIPS compliance support
- Added support for asset path references in flow configs in the @{asset-id:id} format
- Added support for parameter providers and parameter context inheritance
- Added support for CMake4
- Dynamically find and load libpython on macOS
- Added processorBulletins C2 metric node to FlowInformation metrics
- Added option to output the full batch as a single flow file in TailFile
- Added lazy mode using the last seen value in FetchOPCProcessor
- Added state manager support for the Python NiFi API
- Extended OPC processors new properties and the OPC processors now work correctly with node id path
- Extended ConsumeKafka with a commit offset policy property for late offset commits
- Added flowStatus command to minifi.sh
New processors and controllers:
- Added RunLlamaCppInference processor
- Added PutKinesisStream processor
- Added ConvertRecord processor
- Added EvaluateJsonPath processor
- Added SplitJson processor
- Added XMLReader and XMLRecordSetWriter controller services
Changes and improvements:
- Significant code restructuring for the upcoming C API introduction
- Improved ConsumeWindowsEventLog performance by more than 60%
- Redesigned VolatileContentRepository for easier use and 2× better performance
- Improved schema generation for easier usage
- Refactored property handling for cleaner usage
- Funnels can now be used as terminators
- Improved logging for Python virtualenv initialization
- Improved MSI installer for script extensions
Upgraded dependencies:
- Upgraded expected_lite to v0.9.0
- Upgraded GCP library to v2.38.0
- Upgraded googletest to v1.17.0
- Upgraded libarchive to v3.8.1
- Upgraded cpplint to version 2.0.2
- Upgraded Azure SDK to versions: Azure Identity v1.13.0, Azure Storage Blobs v12.14.0, Azure Storage Files Datalake v12.13.0-beta.1
- Upgraded Asio library to v1.34.2
- Upgraded RocksDB library to v10.2.1
- Upgraded Catch2 library to v3.8.1
- Upgraded Couchbase library to v1.1.0
- Upgraded sol2 library to v3.5.0
- Upgraded spdlog library to v1.15.3
- Upgraded fmt library to v11.2.0
- Upgraded libxml2 library to v2.15.0
Version cpp-0.99.1
Release Date: 5 February 2025
New notable features:
- Added support for RecordSets
- Added support for parameters
- Added support for Python RecordTransform and FlowFileSource processors
New processors:
- Added Couchbase processors: GetCouchbaseKey, PutCouchbaseKey, and the corresponding CouchbaseClusterService controller service
- Added FetchModbusTCP
- Added SplitContent and SegmentContent
- Added SplitRecord
Changes and improvements:
- ExecuteProcess was moved to a new extension
- OpenSSL and cURL are no longer optional dependencies
- PDH and Lua are now on by default
- Added a config option for unsynchronized writes and checksum verification on reads in the RocksDB repositories
- Python processor API: improved error handling, fixed various bugs, added source processor support, improved dependency management, improved interpreter loading
- GetFile's Directory property now supports Expression Language
- Dropped CoAP C2 support. HTTP-based C2 can still be used.
- Deprecated 'Both' output format in ConsumeWindowsEventLog
- LogAttribute now properly handles 'Attributes to Log' and 'Attributes to Ignore'
- Dropped nanofi
- Dropped extensions: JNI, USB Camera, OpenWSMAN, Sensors, PCAP, GPS
- Cron-based scheduling now uses the Spring Cron syntax, in line with NiFi 2. (Used to be Quartz like NiFi 1.)
- Improved the performance of event-driven scheduling in high load scenarios
- Fixed an issue with the Windows MSI Installer, where it incorrectly set the install scope to perUser, now it's changed to perMachine
- Added experimental Conan2-based dependency management for a handful of dependency libraries
- Fixed memory leaks in the libarchive extension
- Added support for process group level controller services
- Metrics in Prometheus metric families are now grouped by name. This fixes compatibility with the Telegraf metric collector.
- Fixed a bug in TailFile that caused it to not pick up data after the last delimiter in rotated files
- Renamed the Kafka extension from librdkafka to kafka, but it still uses the librdkafka library internally
- Enabled lz4 and zstd support in the Kafka extension
- Adjusted default logging settings: Now the minifi logs keep 1 rotated file, and the size limit of each file is 20 MB. It used to be 3 rotated files, 5 MB each.
- Adjusted RocksDB logging settings: For each repository, the number of log rotations is now limited to 1, and the max log size is limited to 1 MiB. It used to be 1000 rotations and unlimited size, which caused disk usage problems in high volume use cases.
- ListenHTTP now only reads from the network while it's scheduled. This way, connection limits can be better enforced, and memory usage is better kept in check in failure scenarios. Make sure to set the 'scheduling period' to a reasonably low value to avoid waiting clients: 200 ms is a good starting point.
- MergeContent is now correctly restricted to a single thread. It used to be allowed to run concurrently on multiple threads, but the code is not thread-safe.
- InvokeHTTP 'Remote URL' property now supports Expression Language
- Removed an unnecessary error message about missing processors when loading Python helper files with no processor classes
- Added processorStatuses metric node to the C2 FlowInformation node
Upgraded dependencies:
- xz/liblzma to 5.6.2
- aws-sdk-cpp to 1.11.396
- OpenSSL to 3.3.2
- Abseil-cpp to 20240722
- Grpc to 1.68.0
- librdkafka to 2.6.0
- cURL to 8.11.1
Version cpp-0.99.0
Release Date: 17 May 2024
New notable features:
- Added support for using NiFi 2.0 Python processors in MiNiFi C++
- This also includes several improvements to the previous MiNiFi style python processors, like additional property options, custom relationships and virtualenv support
- Added new python based multiplatform bootstrap script
- Added encryption support for sensitive properties in flow configuration
- Releasing Windows installer now can be done (and will be done) under the Apache license
- Added support for service installation on MacOS
- Added C2 debug command to MiNiFi Controller
- Added support for setting MiNiFi properties from command line
- Added system load average field to C2 and Prometheus metrics
- Added support for manually configuring RocksDB options
- Added custom delimiter property for ListenTCP processor
- Added bandwidth limit properties to InvokeHTTP processor
- Added JSON flow configuration examples
New processors:
- Added PutSmb, FetchSmb and ListSmb processor for SMB networking protocol support
- Added PushGrafanaLokiGrpc and PushGrafanaLokiREST processors for pushing logs to Grafana Loki
- Added JoltTransform to use Jolt JSON transformations
- Added SplitText processor
- Added AttributeRollingWindow processor
Changes and improvements:
- Dropped support for disabling peer verification in InvokeHTTP
- Corrupt flow files are now filtered to avoid errors in the flow
- Using administrative yield duration instead of onschedule retry interval in scheduling adjusting to NiFi's functionality
- Fixed high disk IO usage issue with MergeContent
- Fixed the site-to-site transfer or large files
- Fixed memory leak caused by unused loggers
- Fixed yielding processors to still respect scheduling period
Upgraded dependencies:
- Upgraded OpenSSL to version 3.3.0
- Upgraded AWS SDK to version 1.11.219 with support for new AWS regions
- Upgraded libuvc to version 0.0.7
- Upgraded docker base image to alpine:3.18
- Upgraded Sol2 to version 3.3.0
Version cpp-0.15.0
Release Date: 1 September 2023
New features in this release:
ConsumeWindowsEventLog can work from log files
ConsumeWindowsEventLog resolve Security/UserID attribute
TLS v1.3 support
PutS3Object multipart upload support
Use systemd service management on Linux
Add ProcessContext::getStateManager to Lua/PythonR
Reworked GetTCP
SSL support for Prometheus reporter
Multiarch docker support
RFC3339 parsing with expression language
Reworked Minifi controller
GCC-13 support
- Fix for waking up prematurely after processor yields
- Fix system certificate store usage in SSLContextService on Linux
- Fix inconsistent naming in C2 machineArch
- Fix default CA path for S3 on CentOS
- Removed CronScheduler locale requirements
Third party dependencies upgraded
Upgraded RocksDB to v8.1.1
Upgraded LibCurl to v8.1.0
Upgraded CivetWeb to v1.16
Upgraded OpenCV to v4.7.0
Upgraded GoogleCloud SDK to v2.10.1
Upgraded Azure SDK to v12.7.0
Replaced LibreSSL with OpenSSL 3.1.1
Version cpp-0.14.0
Release Date: 17 April 2023
New features in this release:
- Several improvements on repository resource handling
- Periodically run RocksDB repository compaction
- Add compression options for RocksDB repositories
- Add synchronous flow file reloading
- Retry failed removals of unused resources
- Use Python stable ABI to support all libraries above Python 3.2+ for Python processors
- Add ProcessSession::remove to Python and Lua API
- Add support for JSON flow configuration format with option to generate JSON schema locally
- Add support for reverseDnsLookup in expression language
- Fix most issues for ARM64 support
- Improve performance of ListFile processor
- Add cache SID lookups in ConsumeWindowsEventLog processor
- Add default connection size limits of 2000 queue size and 100MB of queue data size
- Add support for MQTT 5 (mistakenly advertised for 0.13.0 release)
- Add failure relationship to SQL processors
- Add support for new AWS regions
- Add option to select processor metrics with regular expressions
- Add the UUID to the end of Processor and Controller Service log lines
- Make GetFile path attributes consistent with other processors
- Fix leaks and file lock issues on Windows
- Fix crashing in python processors
Version cpp-0.13.0
Release Date: 12 December 2022
New features in this release:
- Warn on SSL certificates about to expire
- Fix cron-based scheduling
- Improve metrics reporting and add support for Prometheus
- Improve the performance of several processors (ListenHTTP, AWS, Azure, GCS)
- Support swapping out flow files from memory to disk
- Support low-memory use cases with FileSystemRepository
- Improve the MQTT processors
- Improve communication with C2, eg. add alert capability
- Fix support of native packages in Python scripting
- Fix Python scripting on Windows
- Add SSL support to the ListenSyslog and ListenTCP processors
- Fix the 32-bit build on Windows
- Support POST/PUT of large files in InvokeHTTP
- Implement communication between process groups through ports
- Plus upgrade libraries, fix issues reported by clang-tidy, fix memory leaks etc
Build Notes:
Version cpp-0.12.0
Release Date: 01 June 2022
New features in this release:
- Log collection from Kubernetes
- improved support for Lua processors
- platform independent ListenSyslog
- property update over C2 protocol
Build Notes:
It is advised that you use the bootstrap.sh when not building on windows.
Version cpp-0.11.0
Release Date: 13 December 2021
New features in this release:
- new processors:
- AttributesToJson
- DefragmentText
- PutAzureDataLakeStorage
- DeleteAzureDataLakeStorage
- ReplaceText
- RouteText
- support for funnels
- shared RocksDB repository
- repository encryption (flow-file, content)
- support for Azure managed identity
- modularization of extensions
- ConsumeKafka security protocol
- SASL options for kafka processors
- platform independent AppendHostInfo
- agent configuration checksum in the C2 heartbeat
- We now use C++17 throughout the codebase and C++20 wherever possible.
Build Notes:
It is advised that you use the bootstrap.sh when not building on windows.
Version cpp-0.10.0
Release Date: 11 June 2021
New features in this release:
- new processors:
- ListS3
- PutAzureBlobStorage
- ConsumeKafka
- PerformanceDataMonitor
- ConsumeJournald
- add resource consumption data to heartbeats
- build with Visual Studio 2019 on Windows.
A few of the improvements and fixes:
- revive SQL processors
- fix expression language support in PublishKafka
- implement FollowRedirects and SendBody properties in InvokeHTTP
- add Initial Starting Position property to TailFile
- support credential refresh in AWSCredentialsService
- change default C2 protocol to REST
- plus bugfixes, compiler warning fixes etc.
Build Notes:
It is advised that you use the bootstrap.sh when not building on windows.
Version cpp-0.9.0
Release Date: 1 March 2021
Highlights of 0.9.0 release include:
- Added support for RocksDB-based content repository for better performance
- Added SQL extension
- Improved task scheduling
- Various C2 improvements
- Bug fixes and improvements to TailFile, ConsumeWindowsEventLog, MergeContent, CompressContent, PublishKafka, InvokeHTTP
- Implemented RetryFlowFile and smart handling of loopback connections
- Added a way to encrypt sensitive config properties and the flow configuration
- Implemented full S3 support
- Reduced memory footprint when working with many flow files
Build Notes:
It is advised that you use the bootstrap.sh when not building on windows.
Version cpp-0.7.0
Release Date: 12 January 2020
Highlights of 0.7.0 release include:
- Added several processors (OPC, SFTP and OpenCV to name a few )
- Added Windows specific processors (ConsumeEventLog for eg.)
- Improved Windows support (SiteToSite, processor features, OpenSSL support)
- Improved performance (related to usage of repositories)
- Windows build made trivial
- Fixed many issues including some security vulnerabilities
Build Notes:
It is advised that you use the bootstrap.sh when not building on windows.
Version cpp-0.6.0
Release Date: 22 March 2019
Highlights of 0.6.0 release include:
- Began structuring library known as NanoFi
- Added several processors (WEL Reader, Sensor Readers, and HashContent to name a few )
- Added JNI Support to run NiFi processors in MiNiFi C++ flows, when Java is allowed and enabled
- Added Support for Natively written Python processors
- Added a CoAP package
- Windows support through Visual Studio with appveyor build
- Added docker builds for centos, debian, fedora, and u16
- Improved static build process across distros
Build Notes:
It is advised that you use the bootstrap.sh when not building on windows.
OS X: Certain versions of OS X have an incompatible version of Bison installed. The work around is to install Bison via brew and tell the build to use that version. Those steps are.
- brew link bison --force
- echo 'export PATH="/usr/local/opt/bison/bin:$PATH"' >> ~/.bash_profile
- Allows the brew Bison version to take precedence
- source ~/.bash_profile
Ubuntu 16.X: Linking errors occur near the end of the build. A simple cmake flag can be used to ensure that the bundled version of RocksDB will be built and linked to the resulting binary
- cmake <all your desired flags> -DBUILD_ROCKSDB=true
Caveats:
This release represents an iterative developmental step in the MiNiFi C++ effort and is not considered ready for production and only provides a subset of functionality of the Java version.
A full list of issues that were resolved can be found at https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12321520&version=12343363
Version cpp-0.5.0
Release Date: 6 June 2018
Highlights of 0.5.0 release include:
- Added several functions to expression language
- Support for synchronous and asynchronous C2 control functions
- Support for UpdateAttribute
- Dynamic property support for processors
- SUSE support to bootstrap process
- Added RouteOnAttribute processor
- PutSQL (lite) implementation
- ExecuteSQL (lite) implementation
Build Notes:
OS X: Certain versions of OS X have an incompatible version of Bison installed. The work around is to install Bison via brew and tell the build to use that version. Those steps are.
- brew link bison --force
- echo 'export PATH="/usr/local/opt/bison/bin:$PATH"' >> ~/.bash_profile
- Allows the brew Bison version to take precedence
- source ~/.bash_profile
Ubuntu 16.X: Linking errors occur near the end of the build. A simple cmake flag can be used to ensure that the bundled version of RocksDB will be built and linked to the resulting binary
- cmake <all your desired flags> -DBUILD_ROCKSDB=true
Caveats:
This release represents an iterative developmental step in the MiNiFi C++ effort and is not considered ready for production and only provides a subset of functionality of the Java version.
A full list of issues that were resolved can be found at https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12321520&version=12342659
Version cpp-0.4.0
Release Date: 27 January 2018
Highlights of 0.4.0 release include:
- Introduction of Expression Language into the framework and initial functions to perform string and numeric manipulations
- Introduction of a bootstrap script to help configure desired modules for a binary build
- Several new processors to provide functionality for GPS, MQTT, USB Cameras, Handlebars templates, and Tensorflow
- A C API for interacting with the framework
- Support for version 3 of the MiNiFi YAML config format
- Scripts for interrogating the controller API to get information about the instance's operation
Caveats:
This release represents an iterative developmental step in the MiNiFi C++ effort and is not considered ready for production and only provides a subset of functionality of the Java version.
A full list of issues that were resolved can be found at https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12321520&version=12341641
Version cpp-0.3.0
Release Date: 2017 November 30
Highlights of 0.3.0 release include:
- Creation of ExecuteScript processor using Python and Lua as underlying scripting engines
- Creation of a Lib Archive module that contains the MergeContent, CompressContent, and Focus/Unfocus archive processors
- PutKafka was created to support writing directly to Kafka
- Modules extensions are facilitated via CMAKE so that features can be enabled or disabled
- Command and Control facilities were created to support base C2 capabilities
Caveats:
This release represents an iterative developmental step in the MiNiFi C++ effort and is not considered ready for production and only provides a subset of functionality of the Java version.
A full list of issues that were resolved can be found at https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12321520&version=12341640
Version cpp-0.2.0
Release Date: 2017 May 11
Highlights of 0.2.0 release include:
- Incorporation of Catch testing framework and Google linting for code quality and enhanced test coverage
- Providing support for reporting tasks and an initial implementation of Site to Site Provenance reporting
- New Processors inclusive of PutFile, LIstenHTTP
- Modularization and namespacing of codebase
Caveats:
This release represents an iterative developmental step in the MiNiFi C++ effort and is not considered ready for production and only provides a subset of functionality of the Java version.
A full list of issues that were resolved can be found at https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12338790&projectId=12319921
Version cpp-0.1.0
Release Date: 2016 December 2
Highlights of 0.1.0 release include:
- Introduction of an ExecuteProcess processor
- Conversion to the CMake build system
- Framework support for generation of provenance
Caveats:
- This release represents an iterative developmental step in the MiNiFi C++ effort and is not considered ready for production and only provides a subset of functionality of the Java version.
A full list of issues that were resolved can be found at https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12338046&projectId=12319921.
Version cpp-0.0.1
Release Date: 2016 September 2
Highlights of 0.0.1 release include:
- Initial framework implemented in C/C++
- Declarative configuration of processing flows through a YAML configuration file
- Initial set of processors consisting of
- TailFile
- GetFile
- GenerateFlowFile
- LogAttribute
- ListenSyslog
- Site to Site Client implementation in C++ for talking to NiFi instances
Caveats:
- This release represents the first of the MiNiFi C++ effort and is not considered ready for production and only provides a subset of functionality of the Java version.
A full list of issues that were resolved can be found at https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12337990&projectId=12319921.
.