Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

PrioFeature/ImprovementJira IssueCreated byDiscussed on mailing listComment
1

Python Wrapper

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keySTREAMPIPES-174

PatrickyesA new python wrapper for creating data processors
2Platform Services


API to interact with live/historical data, pipelines and pipeline elements

3Pipeline Monitoring

Jira
serverASF JIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keySTREAMPIPES-245

Dominik
Get simple pipeline monitoring info, e.g., processed events per processor/sink, lag


Loose collection:

  • Edge Deployment: Allow advanced deployment options, e.g. to assign pipeline elements (standalone) to individual nodes
  • StreamPipes Client: Define/createpipelinesfrom code, which are automatically deployed in StreamPipes
  • Fault Tolerance: Better support for failure handling/resiliency/ state management and state recovery
  • Pipeline Monitoring/Statistics: Inspect current pipeline execution state, receive statistics (e.g., processed messages) and see errors
  • Unified Data Visualization: Use common API for live + historic data visualization (e.g. only using time-series DB for historical data and polling to retrieve near realtime event)
  • Event/Configuration Preview: View current events in Pipeline Editor with application logic applied based on current configuration of static properties of pipeline elements up to this point
  • Pipeline adaptation: Manipulate pipeline configurations at runtime, e.g. static properties etc, either by an API or via trigger in visualizations (Visual Analytics), e.g. slider to set new active threshold value
  • Pipeline Triggers: A pipeline can either be started manually or via a trigger. The latter can be based on a user-defined scheduled time/day, e.g. no production during night shift or based on an API call.
  • ...