Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Table of Contents
indent10 px
absoluteUrltrue
stylecircle
typeflat

MiNiFi (Java)

Version cpp-0.

...

15.0

Release Date:  2017 December 10 - In progres

Highlights of 0.2.0 release include

  • Support for MiNiFi running as a Windows service
  • Configurable repository implementations
  • Improved handling of added extension bundles and versioning
  • S3 implementation for MiNiFi C2 configuration cache 

A full list of issues that were resolved can be found at https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12338791&projectId=12319921.

Version 0.2.0

Release Date: 2017 May 18

Highlights of 0.2.0 release include

1 September 2023

New features in this release:

  • ConsumeWindowsEventLog can work from log files

  • ConsumeWindowsEventLog resolve Security/UserID attribute

  • TLS v1.3 support

  • PutS3Object multipart upload support

  • Use systemd service management on Linux

  • Add ProcessContext::getStateManager to Lua/PythonR

  • Reworked GetTCP

  • SSL support for Prometheus reporter

  • Multiarch docker support

  • RFC3339 parsing with expression language

  • Reworked Minifi controller

  • GCC-13 support

  • Fix for waking up prematurely after processor yields
  • Fix system certificate store usage in SSLContextService on Linux
  • Fix inconsistent naming in C2 machineArch
  • Fix default CA path for S3 on CentOS
  • Removed CronScheduler locale requirements
  • Third party dependencies upgraded

    • Upgraded RocksDB to v8.1.1

    • Upgraded LibCurl to v8.1.0

    • Upgraded CivetWeb to v1.16

    • Upgraded OpenCV to v4.7.0

    • Upgraded GoogleCloud SDK to v2.10.1

    • Upgraded Azure SDK to v12.7.0

    • Replaced LibreSSL with OpenSSL 3.1.1

Version cpp-0.14.0

Release Date: 17 April 2023

New features in this release:

  • Several improvements on repository resource handling
    • Periodically run RocksDB repository compaction
    • Add compression options for RocksDB repositories
    • Add synchronous flow file reloading
    • Retry failed removals of unused resources
  • Use Python stable ABI to support all libraries above Python 3.2+ for Python processors
  • Add ProcessSession::remove to Python and Lua API
  • Add support for JSON flow configuration format with option to generate JSON schema locally
  • Add support for reverseDnsLookup in expression language
  • Fix most issues for ARM64 support
  • Improve performance of ListFile processor
  • Add cache SID lookups in ConsumeWindowsEventLog processor
  • Add default connection size limits of 2000 queue size and 100MB of queue data size
  • Add support for MQTT 5 (mistakenly advertised for 0.13.0 release)
  • Add failure relationship to SQL processors
  • Add support for new AWS regions
  • Add option to select processor metrics with regular expressions
  • Add the UUID to the end of Processor and Controller Service log lines
  • Make GetFile path attributes consistent with other processors
  • Fix leaks and file lock issues on Windows
  • Fix crashing in python processors

Version cpp-0.13.0

Release Date: 12 December 2022

New features in this release:

  • Warn on SSL certificates about to expire
  • Fix cron-based scheduling
  • Improve metrics reporting and add support for Prometheus
  • Improve the performance of several processors (ListenHTTP, AWS, Azure, GCS)
  • Support swapping out flow files from memory to disk
  • Support low-memory use cases with FileSystemRepository
  • Improve the MQTT processors
  • Improve communication with C2, eg. add alert capability
  • Fix support of native packages in Python scripting
  • Fix Python scripting on Windows
  • Add SSL support to the ListenSyslog and ListenTCP processors
  • Fix the 32-bit build on Windows
  • Support POST/PUT of large files in InvokeHTTP
  • Implement communication between process groups through ports
  • Plus upgrade libraries, fix issues reported by clang-tidy, fix memory leaks etc


Build Notes:

Version cpp-0.12.0

Release Date: 01 June 2022

New features in this release:

- Log collection from Kubernetes
- improved support for Lua processors
- platform independent ListenSyslog
- property update over C2 protocol

Build Notes:

It is advised that you use the bootstrap.sh when not building on windows.

Version cpp-0.11.0

Release Date: 13 December 2021

New features in this release:

  • new processors:
    • AttributesToJson
    • DefragmentText
    • PutAzureDataLakeStorage
    • DeleteAzureDataLakeStorage
    • ReplaceText
    • RouteText
  •  support for funnels
  • shared RocksDB repository
  • repository encryption (flow-file, content)
  • support for Azure managed identity
  • modularization of extensions
  • ConsumeKafka security protocol
  • SASL options for kafka processors
  • platform independent AppendHostInfo
  • agent configuration checksum in the C2 heartbeat
  • We now use C++17 throughout the codebase and C++20 wherever possible.

Build Notes:

It is advised that you use the bootstrap.sh when not building on windows.

Version cpp-0.10.0

Release Date: 11 June 2021

New features in this release:

  • new processors:
    • ListS3
    • PutAzureBlobStorage
    • ConsumeKafka
    • PerformanceDataMonitor
    • ConsumeJournald
  • add resource consumption data to heartbeats
  • build with Visual Studio 2019 on Windows.

A few of the improvements and fixes:

  • revive SQL processors
  • fix expression language support in PublishKafka
  • implement FollowRedirects and SendBody properties in InvokeHTTP
  • add Initial Starting Position property to TailFile
  • support credential refresh in AWSCredentialsService
  • change default C2 protocol to REST
  • plus bugfixes, compiler warning fixes etc.

Build Notes:

It is advised that you use the bootstrap.sh when not building on windows.

Version cpp-0.9.0

Release Date: 1 March 2021

Highlights of 0.9.0 release include:

  • Added support for RocksDB-based content repository for better performance
  • Added SQL extension
  • Improved task scheduling
  • Various C2 improvements
  • Bug fixes and improvements to TailFile, ConsumeWindowsEventLog, MergeContent, CompressContent, PublishKafka, InvokeHTTP
  • Implemented RetryFlowFile and smart handling of loopback connections
  • Added a way to encrypt sensitive config properties and the flow configuration
  • Implemented full S3 support
  • Reduced memory footprint when working with many flow files

Build Notes:

It is advised that you use the bootstrap.sh when not building on windows.

Version cpp-0.7.0

Release Date: 12 January 2020

Highlights of 0.7.0 release include:

  • Added several processors (OPC, SFTP and OpenCV to name a few )
  • Added Windows specific processors (ConsumeEventLog for eg.)
  • Improved Windows support (SiteToSite, processor features, OpenSSL support)
  • Improved performance (related to usage of repositories)
  • Windows build made trivial
  • Fixed many issues including some security vulnerabilities

Build Notes:

It is advised that you use the bootstrap.sh when not building on windows.

Version cpp-0.6.0

Release Date: 22 March  2019

Highlights of 0.6.0 release include:

  • Began structuring library known as NanoFi
  • Added several processors (WEL Reader, Sensor Readers, and HashContent to name a few )
  • Added JNI Support to run NiFi processors in MiNiFi C++ flows,  when Java is allowed and enabled
  • Added Support for Natively written Python processors
  • Added a CoAP package
  • Windows support through Visual Studio with appveyor build
  • Added docker builds for centos, debian, fedora, and u16
  • Improved static build process across distros

Build Notes:

It is advised that you use the bootstrap.sh when not building on windows. 

OS X: Certain versions of OS X have an incompatible version of Bison installed. The work around is to install Bison via brew and tell the build to use that version. Those steps are.

  1. brew link bison --force
  2. echo 'export PATH="/usr/local/opt/bison/bin:$PATH"' >> ~/.bash_profile
    1. Allows the brew Bison version to take precedence
  3. source ~/.bash_profile

Ubuntu 16.X: Linking errors occur near the end of the build. A simple cmake flag can be used to ensure that the bundled version of RocksDB will be built and linked to the resulting binary

  • cmake <all your desired flags> -DBUILD_ROCKSDB=true

Caveats:

This release represents an iterative developmental step in the MiNiFi C++ effort and is not considered ready for production and only provides a subset of functionality of the Java version.

  • A full listing of additional caveats can be found at: https://github.com/apache/nifi-minifi-cpp#caveats
  • Upgrading of core component dependencies to NiFi 1.2.0
  • Initial command and control server capabilities
  • Increased support for NiFi features in configuration YAML inclusive of:
  • Support for HTTP Site to Site Proxy Properties
  • Controller Services
  • Binding site to site to a specific network interface

A full list of issues that were resolved can be found at https://issues.apache.org/jira/secure/ReleaseNote.jspa?versionprojectId=1233879112321520&projectIdversion=12319921.12343363


Version cpp-0.

...

5.0

Release Date:  2016 December 4 6 June 2018

Highlights of 0.15.0 release include:

  • Added several functions to expression language
  • Support for synchronous and asynchronous C2 control functions
  • Support for UpdateAttribute
  • Dynamic property support for processors
  • SUSE support to bootstrap process
  • Added RouteOnAttribute processor
  • PutSQL (lite) implementation
  • ExecuteSQL (lite) implementation

Build Notes:

OS X: Certain versions of OS X have an incompatible version of Bison installed. The work around is to install Bison via brew and tell the build to use that version. Those steps are.

  1. brew link bison --force
  2. echo 'export PATH="/usr/local/opt/bison/bin:$PATH"' >> ~/.bash_profile
    1. Allows the brew Bison version to take precedence
  3. source ~/.bash_profile

Ubuntu 16.X: Linking errors occur near the end of the build. A simple cmake flag can be used to ensure that the bundled version of RocksDB will be built and linked to the resulting binary

  • cmake <all your desired flags> -DBUILD_ROCKSDB=true

Caveats:

This release represents an iterative developmental step in the MiNiFi C++ effort and is not considered ready for production and only provides a subset of functionality of the Java version.

  • A full listing of additional caveats can be found at: https://github.com/apache/nifi-minifi-cpp#caveats
  • Upgrading of core component dependencies to the NiFi 1.x baseline
  • Inclusion of the HTTP Site to Site
  • Increased support of NiFi components within MiNiFi YAML configuration
  • Introduction of Pull mechanism for configuration changes
  • Addition of reporters from bootstrap process to solicit information from the running instance 

A full list of issues that were resolved can be found at https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=1231602012321520&version=12335482.12342659

Version cpp-0.4.0

...

Release Date: 10 July 2016 27 January 2018

Highlights of 0.4.0 .1 release include:

  • Introduction of Expression Language into the framework and initial functions to perform string and numeric manipulations
  • Introduction of a bootstrap script to help configure desired modules for a binary build
  • Several new processors to provide functionality for GPS, MQTT, USB Cameras, Handlebars templates, and Tensorflow
  • A C API for interacting with the framework
  • Support for version 3 of the MiNiFi YAML config format
  • Scripts for interrogating the controller API to get information about the instance's operation

Caveats:

This release represents an iterative developmental step in the MiNiFi C++ effort and is not considered ready for production and only provides a subset of functionality of the Java version.

  • A full listing of additional caveats can be found at: https://github.com/apache/nifi-minifi-cpp#caveats
  • Declarative configuration of processing flows through a YAML configuration file
  • Exporting of provenance events to another NiFi instance via a Reporting Task over Site to Site
  • Flow change configuration watcher implementations that provide reloading a NiFi instance when receiving an updated flow over REST or changes on a file system
  • Providing a mechanism to query an instance's status

A full list of issues that were resolved can be found at https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=1231602012321520&version=12335481.

 

...

12341641

Version cpp-0.3.0

Release Date:  2017 November 30

...

A full list of issues that were resolved can be found at https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12321520&version=12341640

Version cpp-0.2.0

Release Date:  2017 May 11

...

A full list of issues that were resolved can be found at https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12338790&projectId=12319921

Version cpp-0.1.0

Release Date:  2016 December 2

...

A full list of issues that were resolved can be found at https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12338046&projectId=12319921.

Version cpp-0.0.1

Release Date: 2016 September 2

...