Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  • Checkpoints [doc]
  • A New DoFn [doc], [slides]
  • Proposed Splittable DoFn API changes [doc]
  • Splittable DoFn (Obsoletes Source API) [doc]
    • Reimplementing Beam API classes on top of Splittable DoFn on top of Source API [doc]
    • New TextIO features based on SDF [doc]
    • Watch transform [doc]
    • Bundles w/ SplittableDoFns [doc]
    • Custom Runner-issued Checkpoint [doc]
  • State and Timers for DoFn [doc]
  • ContextFn [doc]
  • Static Display Data [doc]
  • Lateness (and Panes) in Apache Beam [doc]
  • Triggers in Apache Beam [doc]
  • Triggering is for sinks [doc] (not implemented)
  • Guard against “Trigger Finishing” [doc]
  • Pipeline Drain [doc]
  • Pipelines Considered Harmful [doc]
  • Side-Channel Inputs [doc]
  • Dynamic Pipeline Options [doc]
  • SDK Support for Reading Dynamic PipelineOptions [doc]
  • Fine-grained Resource Configuration in Beam [doc]
  • External Join with KV Stores [doc]
  • Error Reporting Callback (WIP) [doc]
  • Snapshotting and Updating Beam Pipelines [doc]
  • Requiring PTransform to set a coder on its resulting collections [mail]
  • Support of @RequiresStableInput annotation [doc], [mail]
  • [PROPOSAL] @onwindowexpiration [mail]
  • AutoValue Coding and Row Support [doc]
  • HyperLogLog++ Integration with Apache Beam [doc]
  • Retractions [doc]
  • @RequiresTimeSortedInput annotation for stateful DoFns [doc]
  • GroupIntoBatches with Runner Determined Sharding [doc]

IO / Filesystem

  • IOChannelFactory Redesign [doc]
  • Configurable BeamFileSystem [doc]
  • New API for writing files in Beam [doc]
  • Dynamic file-based sinks [doc]
  • Beam GCP Debuggability Metrics [doc]
  • KafkaIO
    • Event Time and Watermarks in KafkaIO [doc]
    • Exactly-once Kafka sink [doc]
    • KafkaIO Dynamic Read [doc]

...