Page History

...

• (Large) State Handling / Recovery:

  • Incremental / lightweight snapshots for checkpoints (FLINK-5053)

  • Asynchronous snapshots for heap-based state backends (FLINK-6048, FLINK-5715)

  • Allow upgrades to state serializers (FLINK-6178)

  • Recover job state at the granularity of operator (FLINK-5892)

  • Fine-grained recovery (beta) (FLINK-4256)

• Streaming APIs:

  • Expose Broadcast Operator State through public APIs (FLINK-5991)

  • Side Outputs (FLINK-4460)

  • Extending AllWindow Function Metadata (FLINK-5157, FLINK-4997)

  • Access to Per-Window state in ProcessWindowFunction (FLINK-5929)

  • Add support for "Distributed Cache" in streaming applications (FLINK-6177)

• Deployment & Tooling:

  • Flink History Server (FLINK-1579)

  • Flink automatically manages TM network buffer (FLINK-4545)

  • Add Datadog HTTP metrics reporter (FLINK-6013)

  • Add watermark monitoring to JobManager web frontend (FLINK-3427)

• Table API / SQL:

  • Support for Retraction in Table API / SQL (FLINK-6047)

  • Support for non-windowed aggregations in streaming Table API / SQL (FLINK-6216)
  • Support for append, upsert and retraction StreamTableSinks (FLINK-6093)

  • Integrate time indicators for Table API & SQL (FLINK-5884)

  • Support for group windows in (batch + streaming) SQL (TUMBLE, HOP, SESSION) (FLINK-6261,FLINK-6011)
  • Support for OVER windows in streaming Table API and SQL (FLINK-4557)
  • Support for QueryConfig for streaming queries to specify state retention interval (FLINK-6491)
  • Support for user-defined aggregation functions (FLINK-5564)
  • Support for standard deviation and variance aggregation functions (FLINK-4604)

  • Support for TableSources with filter push down (FLINK-3849,

  • Support for external catalogs (FLINK-5570)

  • Add KafkaAvroTableSource (FLINK-3871)

  • Add HBaseTableSource (FLINK-2168)

  • Add CUBE/ROLLUP/GROUPING SETS operator in batch SQL (FLINK-5303)

  • Support for DISTINCT GROUP BY aggregates for batch SQL (FLINK-3849)
  • Add flink-table.jar to ./opt folder (FLINK-6247)
• Connectors:

  • Elasticsearch 5.x support (FLINK-4988)

  • Implement rescalable non-partitioned state for Kinesis Connector (FLINK-4821)

  • Transparent shard discovery for Kinesis Consumer (FLINK-4577)

  • Allow Kinesis Consumer to start from specific timestamp / Date (FLINK-4523)

  • Allow setting custom start-offsets for the Kafka consumer (FLINK-3123)

  • Allow out-opt from offset committing for the Kafka consumer (FLINK-3398)

• CEP library improvements:

  • Make CEP operators rescalable (FLINK-5420)

  • Late element handling (FLINK-6205)

  • Support for quantifiers (*,+,?) to CEP's pattern API (FLINK-3318)

  • Support for different continuity requirements (FLINK-6208)

  • Add support for iterative conditions (FLINK-6197)

• Gelly Library:

  • PageRank algorithm for directed graphs (FLINK-4896)

  • Add Evenly Graph Generator to Flink Gelly (FLINK-6393)

    
    

...