Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  1. Source: is the source of the message. It indicates the origin of this message.

    1. Example: for messages coming from Samza job’s task source is the task name, for coordinator messages source is “SamzaContainer”, for checkpoint messages source is task name, for diagnostics messges it is “DiagnosticManager”, for metrics related messages it is either “ApplicationMaster” or “StreamProcessor” and so on.

  2. ome.systemStream: 

    1. SystemStream.system: Azure container name. Azure account name is provided as a config.

    2. SystemStream.stream: Azure blob name prefix.

    3. ome.partition : empty or partition. If not empty, then blob name is “ome.stream/ome.partition/timestamp” else it is “ome.stream/timestamp". 
    4. Example: to send message to SSP system = Azure container name = “azure-container”, Stream = “azure-stream”, the blob with name “azure-stream/..” is created in Azure container “azure-container”. The blob can be found at https://<azure-account-name>.blob.core.windows.net/azure-container/azure-stream/.../timestamp where the blob name itself is azure-stream/../timestamp.avro

  3. ome.keySerializerName: no-op serde

  4. ome.messageSerializerName: no-op serde

  5. Ome.message: supports a single message. 

  6. Ome.key: this will be ignored. 

...