Versions Compared

Old Version 1

changes.mady.by.user Philipp Zehnder

Saved on

compared with

New Version Current

changes.mady.by.user Philipp Zehnder

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

We recently created a first prototype for E2E tests, with the goal to introduce more automated tests into StreamPipes. On this page we collect structured procedures, which we will test automatically in the future. The descriptions for tests should be so detailed that we can directly implement the tests (e.g. necessary dependencies, data, expected results ...).

Integrations

e.g.

  • Kafka (Create Adapter → Pipeline (Source → Kafka Sink) → Create Kafka Adapter (validate event schema)
  • MQTT (Create Adapter → Pipeline (Source → MQTT Sink) → Create MQTT Adapter (validate event schema)
  • MySQL(Create Adapter → Pipeline (Source → MySQL Sink) → Create MySQL Adapter (validate event schema)
  • InfluxDB (Create Adapter → Pipeline (Source → InfluxDB Sink) → Create InfluxDB Adapter (validate event schema)
  • How to deal with database set adapters?

Connect

  • File Set / Stream
  • HTTP Set / Stream
  • Image Set / Stream
  • ISS Location (Can be used to test Dashboard map)
  • Machine Data Simulator
  • OPC UA
  • PLC adapters?
  • Random Data Set / Stream
  • ROS
  • Slack?
  • HTTP Server
Formate
  • XML
  • JSON
    • Array With Key
    • Array No Key
    • Object
  • GeoJson
  • CSV
  • Image
Preprocessing Rules
  •  Schema Rules
    •  Add fixed property
    •  Add timestamp
    •  Rename
    •  Add nested
    •  Move
    •  Delete
  •  Value Rules
    •  Number transformation
    •  Unit transformation
    •  Privacy transformation
    •  Timestamp transformation
      •  UNIX timestamp sec
      •  REGEX
  •  Stream Rules
    •  Aggregation
    •  Remove Duplicates
  •  Change data type
  •  Mark as timestamp

Pipeline Elements

Transformation JVM
  •  Array
    •  Count 
    •  Split
  •  Boolean
    •  Counter
    •  Edge Detection
    •  Inverter
    •  BooleanOperator
    •  BooleanToState
    •  TimeKeeping
    •  BooleanTimer
  •  CSVMetadataEnrichment
  •  FieldRenamer
  •  StateBuffer
  •  BufferLabeler
  •  NumberLabeler
  •  String
    •  Counter
    •  StringTimer
  •  TaskDuration
  •  TimestampExtractor
  •  TransformToBoolean
  •  ChangeValueDetection
  •  CalculateDuration

Dashboard

Data Explorer

  • Wait till we finished the refactoring

Notifications

File Management