You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 52 Next »

MiNiFi (Java)

The Apache MiNiFi Java codebase has been merged with the Apache NiFi codebase as of NiFi 1.14.0. Please refer to the NiFi Release Notes going forward.

Version 0.5.0

Release Date: 7 July 2018

Highlights of 0.5.0 release include

  • Provides handling of the NiFi Registry version flow format to MiNiFi YAML
  • Updates to utilize the NiFi 1.7.0 core libraries
  • Usability enhancements when ingesting new configuration

A full list of issues that were resolved can be found at https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12319921&version=12342658

Version 0.4.0

Release Date: 22 January 2018

Highlights of 0.4.0 release include

  • Support for communication with NiFi 1.5.0 Remote Process Group
  • Improved error reporting

A full list of issues that were resolved can be found at https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12319921&version=12342439.

Version 0.3.0

Release Date:  2017 December 22

Highlights of 0.3.0 release include

  • Support for MiNiFi running as a Windows service
  • Configurable repository implementations
  • Improved handling of added extension bundles and versioning
  • S3 implementation for MiNiFi C2 configuration cache 
  • Upgrade to 1.4.0 NiFi core libraries

A full list of issues that were resolved can be found at https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12338791&projectId=12319921.

Version 0.2.0

Release Date:  2017 May 18

Highlights of 0.2.0 release include

  • Upgrading of core component dependencies to NiFi 1.2.0
  • Initial command and control server capabilities
  • Increased support for NiFi features in configuration YAML inclusive of:
    • Support for HTTP Site to Site Proxy Properties
    • Controller Services
    • Binding site to site to a specific network interface

A full list of issues that were resolved can be found at https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12338791&projectId=12319921.

Version 0.1.0

Release Date:  2016 December 4

Highlights of 0.1.0 release include

  • Upgrading of core component dependencies to the NiFi 1.x baseline
  • Inclusion of the HTTP Site to Site
  • Increased support of NiFi components within MiNiFi YAML configuration
  • Introduction of Pull mechanism for configuration changes
  • Addition of reporters from bootstrap process to solicit information from the running instance 

A full list of issues that were resolved can be found at https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12316020&version=12335482.

Version 0.0.1

Release Date: 10 July 2016

Highlights of 0.0.1 release include

  • Declarative configuration of processing flows through a YAML configuration file
  • Exporting of provenance events to another NiFi instance via a Reporting Task over Site to Site
  • Flow change configuration watcher implementations that provide reloading a NiFi instance when receiving an updated flow over REST or changes on a file system
  • Providing a mechanism to query an instance's status

A full list of issues that were resolved can be found at https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12316020&version=12335481.


MiNiFi (C++)

Version cpp-0.12.0

Release Date: Pending

New features in this release:

- Log collection from Kubernetes
- improved support for Lua processors
- platform independent ListenSyslog
- property update over C2 protocol

Build Notes:

It is advised that you use the bootstrap.sh when not building on windows.

Version cpp-0.11.0

Release Date: 13 December 2021

New features in this release:

  • new processors:
    • AttributesToJson
    • DefragmentText
    • PutAzureDataLakeStorage
    • DeleteAzureDataLakeStorage
    • ReplaceText
    • RouteText
  •  support for funnels
  • shared RocksDB repository
  • repository encryption (flow-file, content)
  • support for Azure managed identity
  • modularization of extensions
  • ConsumeKafka security protocol
  • SASL options for kafka processors
  • platform independent AppendHostInfo
  • agent configuration checksum in the C2 heartbeat
  • We now use C++17 throughout the codebase and C++20 wherever possible.

Build Notes:

It is advised that you use the bootstrap.sh when not building on windows.

Version cpp-0.10.0

Release Date: 11 June 2021

New features in this release:

  • new processors:
    • ListS3
    • PutAzureBlobStorage
    • ConsumeKafka
    • PerformanceDataMonitor
    • ConsumeJournald
  • add resource consumption data to heartbeats
  • build with Visual Studio 2019 on Windows.

A few of the improvements and fixes:

  • revive SQL processors
  • fix expression language support in PublishKafka
  • implement FollowRedirects and SendBody properties in InvokeHTTP
  • add Initial Starting Position property to TailFile
  • support credential refresh in AWSCredentialsService
  • change default C2 protocol to REST
  • plus bugfixes, compiler warning fixes etc.

Build Notes:

It is advised that you use the bootstrap.sh when not building on windows.

Version cpp-0.9.0

Release Date: 1 March 2021

Highlights of 0.9.0 release include:

  • Added support for RocksDB-based content repository for better performance
  • Added SQL extension
  • Improved task scheduling
  • Various C2 improvements
  • Bug fixes and improvements to TailFile, ConsumeWindowsEventLog, MergeContent, CompressContent, PublishKafka, InvokeHTTP
  • Implemented RetryFlowFile and smart handling of loopback connections
  • Added a way to encrypt sensitive config properties and the flow configuration
  • Implemented full S3 support
  • Reduced memory footprint when working with many flow files

Build Notes:

It is advised that you use the bootstrap.sh when not building on windows.

Version cpp-0.7.0

Release Date: 12 January 2020

Highlights of 0.7.0 release include:

  • Added several processors (OPC, SFTP and OpenCV to name a few )
  • Added Windows specific processors (ConsumeEventLog for eg.)
  • Improved Windows support (SiteToSite, processor features, OpenSSL support)
  • Improved performance (related to usage of repositories)
  • Windows build made trivial
  • Fixed many issues including some security vulnerabilities

Build Notes:

It is advised that you use the bootstrap.sh when not building on windows.

Version cpp-0.6.0

Release Date: 22 March  2019

Highlights of 0.6.0 release include:

  • Began structuring library known as NanoFi
  • Added several processors (WEL Reader, Sensor Readers, and HashContent to name a few )
  • Added JNI Support to run NiFi processors in MiNiFi C++ flows,  when Java is allowed and enabled
  • Added Support for Natively written Python processors
  • Added a CoAP package
  • Windows support through Visual Studio with appveyor build
  • Added docker builds for centos, debian, fedora, and u16
  • Improved static build process across distros

Build Notes:

It is advised that you use the bootstrap.sh when not building on windows. 

OS X: Certain versions of OS X have an incompatible version of Bison installed. The work around is to install Bison via brew and tell the build to use that version. Those steps are.

  1. brew link bison --force
  2. echo 'export PATH="/usr/local/opt/bison/bin:$PATH"' >> ~/.bash_profile
    1. Allows the brew Bison version to take precedence
  3. source ~/.bash_profile

Ubuntu 16.X: Linking errors occur near the end of the build. A simple cmake flag can be used to ensure that the bundled version of RocksDB will be built and linked to the resulting binary

  • cmake <all your desired flags> -DBUILD_ROCKSDB=true

Caveats:

This release represents an iterative developmental step in the MiNiFi C++ effort and is not considered ready for production and only provides a subset of functionality of the Java version.

A full list of issues that were resolved can be found at https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12321520&version=12343363


Version cpp-0.5.0

Release Date: 6 June 2018

Highlights of 0.5.0 release include:

  • Added several functions to expression language
  • Support for synchronous and asynchronous C2 control functions
  • Support for UpdateAttribute
  • Dynamic property support for processors
  • SUSE support to bootstrap process
  • Added RouteOnAttribute processor
  • PutSQL (lite) implementation
  • ExecuteSQL (lite) implementation

Build Notes:

OS X: Certain versions of OS X have an incompatible version of Bison installed. The work around is to install Bison via brew and tell the build to use that version. Those steps are.

  1. brew link bison --force
  2. echo 'export PATH="/usr/local/opt/bison/bin:$PATH"' >> ~/.bash_profile
    1. Allows the brew Bison version to take precedence
  3. source ~/.bash_profile

Ubuntu 16.X: Linking errors occur near the end of the build. A simple cmake flag can be used to ensure that the bundled version of RocksDB will be built and linked to the resulting binary

  • cmake <all your desired flags> -DBUILD_ROCKSDB=true

Caveats:

This release represents an iterative developmental step in the MiNiFi C++ effort and is not considered ready for production and only provides a subset of functionality of the Java version.

A full list of issues that were resolved can be found at https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12321520&version=12342659

Version cpp-0.4.0

Release Date: 27 January 2018

Highlights of 0.4.0 release include:

  • Introduction of Expression Language into the framework and initial functions to perform string and numeric manipulations
  • Introduction of a bootstrap script to help configure desired modules for a binary build
  • Several new processors to provide functionality for GPS, MQTT, USB Cameras, Handlebars templates, and Tensorflow
  • A C API for interacting with the framework
  • Support for version 3 of the MiNiFi YAML config format
  • Scripts for interrogating the controller API to get information about the instance's operation

Caveats:

This release represents an iterative developmental step in the MiNiFi C++ effort and is not considered ready for production and only provides a subset of functionality of the Java version.

A full list of issues that were resolved can be found at https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12321520&version=12341641

Version cpp-0.3.0

Release Date:  2017 November 30

Highlights of 0.3.0 release include:

  • Creation of ExecuteScript processor using Python and Lua as underlying scripting engines
  • Creation of a Lib Archive module that contains the MergeContent, CompressContent, and Focus/Unfocus archive processors
  • PutKafka was created to support writing directly to Kafka
  • Modules extensions are facilitated via CMAKE so that features can be enabled or disabled 
  • Command and Control facilities were created to support base C2 capabilities

Caveats:

This release represents an iterative developmental step in the MiNiFi C++ effort and is not considered ready for production and only provides a subset of functionality of the Java version.

A full list of issues that were resolved can be found at https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12321520&version=12341640

Version cpp-0.2.0

Release Date:  2017 May 11

Highlights of 0.2.0 release include:

  • Incorporation of Catch testing framework and Google linting for code quality and enhanced test coverage
  • Providing support for reporting tasks and an initial implementation of Site to Site Provenance reporting
  • New Processors inclusive of PutFile, LIstenHTTP
  • Modularization and namespacing of codebase

Caveats:

This release represents an iterative developmental step in the MiNiFi C++ effort and is not considered ready for production and only provides a subset of functionality of the Java version.

A full list of issues that were resolved can be found at https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12338790&projectId=12319921

Version cpp-0.1.0

Release Date:  2016 December 2

Highlights of 0.1.0 release include:

  • Introduction of an ExecuteProcess processor
  • Conversion to the CMake build system
  • Framework support for generation of provenance

Caveats:

  • This release represents an iterative developmental step in the MiNiFi C++ effort and is not considered ready for production and only provides a subset of functionality of the Java version.

A full list of issues that were resolved can be found at https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12338046&projectId=12319921.

Version cpp-0.0.1

Release Date: 2016 September 2

Highlights of 0.0.1 release include:

  • Initial framework implemented in C/C++
  • Declarative configuration of processing flows through a YAML configuration file
  • Initial set of processors consisting of 
    • TailFile
    • GetFile
    • GenerateFlowFile
    • LogAttribute
    • ListenSyslog
  • Site to Site Client implementation in C++ for talking to NiFi instances

Caveats:

A full list of issues that were resolved can be found at https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12337990&projectId=12319921.

.

  • No labels