THIS IS A TEST INSTANCE. ALL YOUR CHANGES WILL BE LOST!!!!
...
- Checkpoints [doc]
- A New DoFn [doc], [slides]
- Proposed Splittable DoFn API changes [doc]
- Splittable DoFn (Obsoletes Source API) [doc]
- State and Timers for DoFn [doc]
- ContextFn [doc]
- Static Display Data [doc]
- Lateness (and Panes) in Apache Beam [doc]
- Triggers in Apache Beam [doc]
- Triggering is for sinks [doc] (not implemented)
- Guard against “Trigger Finishing” [doc]
- Pipeline Drain [doc]
- Pipelines Considered Harmful [doc]
- Side-Channel Inputs [doc]
- Dynamic Pipeline Options [doc]
- SDK Support for Reading Dynamic PipelineOptions [doc]
- Fine-grained Resource Configuration in Beam [doc]
- External Join with KV Stores [doc]
- Error Reporting Callback (WIP) [doc]
- Snapshotting and Updating Beam Pipelines [doc]
- Requiring PTransform to set a coder on its resulting collections [mail]
- Support of @RequiresStableInput annotation [doc], [mail]
- [PROPOSAL] @onwindowexpiration [mail]
- AutoValue Coding and Row Support [doc]
- HyperLogLog++ Integration with Apache Beam [doc]
- Retractions [doc]
- @RequiresTimeSortedInput annotation for stateful DoFns [doc]
...
- IOChannelFactory Redesign [doc]
- Configurable BeamFileSystem [doc]
- New API for writing files in Beam [doc]
- Dynamic file-based sinks [doc]
- Beam GCP Debuggability Metrics [doc]
- KafkaIO
- Beam GCP Debuggability Metrics [doc]
- KafkaIO Dynamic Read [doc]
Metrics
- Defining and Adding SDK Metrics via FN API [doc]
- Histogram Style Metrics - [doc]
- Get Metrics API: Metric Extraction via proto RPC API. [doc]
- Metrics API [doc]
- I/O Metrics [doc]
- Metrics extraction independent from runners / execution engines [doc]
- Watermark Metrics [doc]
- Support Dropwizard Metrics in Beam [doc]
- Beam GCP Debuggability Metrics [doc]
...
- Runner Authoring Guide [doc] (obsoletes [doc] and [doc])
- Composite PInputs, POutputs, and the Runner API [doc]
- Side Input Architecture for Apache Beam [doc]
- Runner supported features plugin [doc]
- Structured streaming Spark Runner [doc]
- SDF Self-checkpoint Support on Portable Flink [doc]
SQL / Schema
- Streams and Tables [doc]
- Streaming SQL [doc]
- Schema-Aware PCollections [doc]
- Pubsub to Beam SQL [doc]
- Apache Beam Proposal: design of DSL SQL interface [doc]
- Calcite/Beam SQL Windowing [doc]
- Reject Unsupported Windowing Strategies in JOIN [doc]
- Beam DSL_SQL branch API review [doc]
- Complex Types Support for Beam SQL DDL [mail]
- [SQL] Reject unsupported inputs to Joins [mail]
- Integrating runners & IO [doc]
- Beam SQL Pipeline Options [doc]
- Unbounded limit [doc]
- Portable Beam Schemas [doc]
- Cost Based Optimizer [doc1, doc2]
- ZetaSQL as a dialect in BeamSQL [doc]
- Project and predicate push-down [doc]
...