Versions Compared

Old Version 9

changes.mady.by.user Marc Parisi

Saved on

compared with

New Version 10

changes.mady.by.user Marc Parisi

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

that must be defined for each processor. When specifying connections, you will reference the success relationships and this identifier as either the source and/or destination ID. Note that if the properties do not exist

for the processor, it will fail to run. 

Processors:
    - name: GetFile
      id: 471deef6-2a6e-4a7d-912a-81cc17e3a206
      class: org.apache.nifi.processors.standard.GetFile
      max concurrent tasks: 1
      scheduling strategy: TIMER_DRIVEN
      scheduling period: 1 sec
      penalization period: 30 sec
      yield period: 1 sec
      run duration nanos: 0
      auto-terminated relationships list:
      Properties:
          Input Directory: /tmp/getfile
          Keep Source File: true


Connections

Connections define the relationships as input and output ports within the defined flow. The example, below, uses the processor defined in the previous section and passes it to a remote processing

group upon success. Options within the connection limit the maximum work queue size and the amount of time flowfiles may spend in the queue. 

Connections:
    - name: TransferFilesToRPG
      id: 471deef6-2a6e-4a7d-912a-81cc17e3a207
      source name: GetFile
      source id: 471deef6-2a6e-4a7d-912a-81cc17e3a206 
      source relationship name: success
      destination id: 471deef6-2a6e-4a7d-912a-81cc17e3a204
      max work queue size: 0
      max work queue data size: 1 MB
      flowfile expiration: 60 sec


Remote processing Groups

Remote processing groups are processors define input and output ports for a NiFi instance using the Site to Site protocol. In this example, the URL defines a local instance of NiFi and an input port. This

input port will define the UUID of the input port on the NiFi instance. In this case, properties are defined as port and host name within the input port. The number of concurrent tasks can be configured

to limit or increase the concurrency in the data being sent to NiFi.  

Remote Processing Groups:
    - name: NiFi Flow
      id: 471deef6-2a6e-4a7d-912a-81cc17e3a208
      url: http://localhost:8080/nifi
      timeout: 30 secs
      yield period: 10 sec
      Input Ports:
          - id: 471deef6-2a6e-4a7d-912a-81cc17e3a204
            name: From Node A
            max concurrent tasks: 1
            Properties:
                Port: 10001
                Host Name: localhost

...