Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

How Data is handled in StreamPipes

Real-time Example Primitive









Real-time Example List





Info


Example Missing for story telling

Any Ideas?



Data Layer


Stored as a LinkedTreeMap:

...

Code Block
key: s0::name
value: value


Warning

why s0::name?


Time

Timestamp is always required → See Time in StreamPipes

...

What happens if YYY-MM-DD as data sourceo be converted internally to Unix timestamp?


Description Layer

Event schema; describes each individual attributes of an event. The three most important and required fields are:

...

Warning

Why

 runtimeType => not Part of Class EvbentProperty Class

 measurementUnit => not Part of Class EvbentProperty Class

 valuesSpecitication =>  not Part of Class EvbentProperty Class 




Event Property Types


TypeDescription
EventPropertiyPrimitiveflat single value
EventPropertyListList of flat single values
EventPropertyNestedDeprecated?


Read Event Property

It can be called in the required Section via

Read WayDescription
EpRequirements


Warning

How to read List?


Write

Write WayDescription
EventPropertiyPrimitiveBuilder
EpProperty
Arrays.asList(EpProperties... , EpProperties... )

EventPropertiyPrimitiveBuilder


This is used to build a complex Event Schema with the runtimeName, runtimeType and domainProperty and also optional attributes.

...

Warning

Why is domainProperty not an Array List?


EpProperty

this is used to build a basic Event Schema with
the method also defines the runtimeType

Time

MethodDescription
timestampProperty(String runtimeName)

String

MethodDescription
stringEp(Label label, String runtimeName, String domainProperty, Enumeration enumeration)
stringEp(Label label, String runtimeName, String domainProperty, PropertyScope propertyScope)
stringEp(Label label, String runtimeName, String domainProperty)
stringEp(Label label, String runtimeName, List <Uri> domainProperties)

Double

MethodDescription
doubleEp(Label label, String runtimeName, String domainProperty)
doubleEp(Label label, String runtimeName, String domainProperty, Float minValue, Float maxValue, Float step)

Integer

MethodDescription
integerEp(Label label, String runtimeName, List < Uri> domainProperties)
integerEp(Label label, String runtimeName, String domainProperty, QuantitativeValue valueSpecification)
integerEp(Label label, String runtimeName, String domainProperty, Float minValue, Float maxValue, Float step)

Number

MethodDescription
numberEp(Label label, String runtimeName, String domainProperty)

General

MethodDescription
ep(Label label, String runtimeType, String runtimeName, String domainProperty)

Boolean

MethodDescription
booleanEp(Label label, String runtimeName, String domainProperty)

Long

MethodDescription
longEp(Label label, String runtimeName, String domainProperty)
longEp(Label label, String runtimeName, List< URI> domainProperty)

Image

MethodDescription
imageProperty(String runtimeName)

List

General

MethodDescription
listEp(Label label, String runtimeName, Datatypes runtimeType, String domainProperty)
listEp(Label label, String runtimeName, EventPropety eventProperty, String domainProperty)
listEp(Label label, String runtimeName, EventProperty eventProperty)

String

MethodDescription
ListStringEp(Label label, String runtimeName, String domainProperty)

Double

MethodDescription
listDoupleEp(Label label, String runtimeName, String domainProperty)

Boolean

MethodDescription
listBoolean(Label label, String runtimeName, String domainProperty))

Integer

MethodDescription
listIntegerEp(Label label, String runtimeName, String domainProperty)

Long

MethodDescription
listLongEp(Label label, String runtimeName, String domainProperty)

Nested

MethodDescription
listNestedEp(Label label, String runtimeName, List<EventProperty... eventProperties)
listNestedEp(Label label, String runtimeName, String domainProperty, List<Eventproperty> listItemProperties)

Scope

There are 4 types of scope

...

TypeDescription
HEADER_PROPERTYA property that defines meta-information about the event, for instance its occurrence time
DIMENSION_PROPERTYA property that describes the context of a measurement, e.g., the ID of a machine or a thing.
MEASUREMENT_PROPERTYA property that contains (often quantitative) measurement values
NONEThe property scope is not further described. Use this scope for defining property requirements where the data processor's functionality does not require any specific property scope (e.g., a text filter that can filter any text-based property)

Quality



DomainProperty

You can either use an own URI Link
or use a variety of StreamPipes implemented vocabularies.
A full list can be found under the vocabulary package:

...

https://github.com/apache/streampipes/tree/dev/streampipes-vocabulary/src/main/java/org/apache/streampipes/vocabulary



Labels

Code Block
Labels.withID(String internalID)
Labels.empty()

...