Page History

...

1. Drag a processor to the canvas (do this by the dragging the processor icon which is the first icon on the toolbar).
2. Select the TailFile type of processor, then select Add. 
3. Right click on the processor and select Configure to display the Configure Processor dialog box. In the Settings tab change the name to "Ingest Squid Events"
   1. In the Properties tab, configure the following:
      
4. Drag another processor to the canvas.
5. Select the PutKafka type of processor, then select Add.
6. Right click on the processor and select Configure. 
7. In the Settings tab, change the name to "Stream to Metron,” then click the relationship checkboxes for failure and success.
8. In the Properties tab, set the following three properties:
   1. Known Brokers: $KAFKA_HOST:6667
   2. Topic Name: squid
   3. Client Name: nifi-squid
9. Create a connection by dragging the arrow from the Ingest Squid Events processor to the Stream to Metron processor.
10. Press the Shift key and select the entire flow, then click the play button (green arrow). You should see all of the processor icons turn into green arrows like below:
11. Generate some data using squidclient (do this for about 20+ sites).

    squidclient -h 127.0.0.1 "http://www.cnn.com"

12. You should see metrics on the processor of data being pushed into Metron.
13. Look at the Storm UI for the parser topology and you should see tuples coming in.
14. After about 5 minutes, you should see a new Elastic Search index called squid_index* in the Elastic Admin UI.

...