Automated E2E Tests

We recently created a first prototype for E2E tests, with the goal to introduce more automated tests into StreamPipes. On this page we collect structured procedures, which we will test automatically in the future. The descriptions for tests should be so detailed that we can directly implement the tests (e.g. necessary dependencies, data, expected results ...).

Integrations

e.g.

• Kafka (Create Adapter → Pipeline (Source → Kafka Sink) → Create Kafka Adapter (validate event schema)
• MQTT (Create Adapter → Pipeline (Source → MQTT Sink) → Create MQTT Adapter (validate event schema)
• MySQL(Create Adapter → Pipeline (Source → MySQL Sink) → Create MySQL Adapter (validate event schema)
• InfluxDB (Create Adapter → Pipeline (Source → InfluxDB Sink) → Create InfluxDB Adapter (validate event schema)
• How to deal with database set adapters?

Kafka

• Precondition:
  • None
  • Use StreamPipes internal Kafka
• Before:
  • Create Adapter (Machine Data Simulator / Flow Rate)
  • Create Pipeline (Machine Data Simulator → Kafka Sink)
    • Configure Kafka Sink (Selector: kafka_publisher ) 
      • Type: input Selector: topic Value: #testname
      • Type: input Selector: host Value: kafka
      • Type: input Selector: port Value: 9092
      • Type: radio Selector: access-mode Value: Unauthenticated
• Test:
  • Create Kafka Adapter
    • (Selector: Apache_Kafka ) 
      
      • Type: input Selector: host Value: kafka
      • Type: input Selector: port Value: 9092
      • Type: radio Selector: access-mode Value: Unauthenticated
      • Type: radio Selector: topic Value: #testname
    • Format: json
    • Mark as timestamp: timestamp
    • Name: #testname
  • Validate in live preview: Contain 7 event properties
• Clean Up
  • Delete pipeline
  • Delete adapter (Kafka)
  • Delete adapter (Machine Data Simulator)

Connect

• File Set / Stream
• HTTP Set / Stream
• Image Set / Stream
• ISS Location (Can be used to test Dashboard map)
• Machine Data Simulator
• OPC UA
• PLC adapters?
• Random Data Set / Stream
• ROS
• Slack?
• HTTP Server

Formate

• XML
• JSON
  • Array With Key
  • Array No Key
  • Object
• GeoJson
• CSV
• Image

Preprocessing Rules

• Schema Rules
  • Add fixed property
  • Add timestamp
  • Rename
  • Add nested
  • Move
  • Delete
• Value Rules
  • Number transformation
  • Unit transformation
  • Privacy transformation
  • Timestamp transformation
    • UNIX timestamp sec
    • REGEX
• Stream Rules
  • Aggregation
  • Remove Duplicates

Pipeline Elements

Dashboard

Data Explorer

• Wait till we finished the refactoring

Notifications

File Management