Page History

...

• (Large) State Handling / Recovery:

  • Incremental / lightweight snapshots for checkpoints (FLINK-5053)

  • Asynchronous snapshots for heap-based operator state backends (FLINK-6048)

  • Allow upgrades to state serializers (FLINK-6178)

  • Recover job state at the granularity of operator (FLINK-5892)

  • Fine-grained recovery (beta) (FLINK-4256)

• Streaming APIs:

  • Expose Broadcast Operator State through public APIs (FLINK-5991)

  • Side Outputs (FLINK-4460)

  • Extending AllWindow Function Metadata (FLINK-5157, FLINK-4997)

  • Add support for "Distributed Cache" in streaming applications (FLINK-6177)

• Deployment & Tooling:

  • Flink History Server (FLINK-1579)

  • Flink automatically manages TM network buffer (FLINK-4545)

  • Add Datadog HTTP metrics reporter (FLINK-6013)

  • Add watermark monitoring to JobManager web frontend (FLINK-3427)

• Table API / SQL:

  • Add support for Retraction in Table API / SQL (FLINK-6047)

  • Integrate time indicators for Table API & SQL (FLINK-5884)

  • Support tumbling window on streaming tables in the SQL API (FLINK-5624)

  • Add HBaseTableSource (FLINK-2168)

  • Add CUBE/ROLLUP/GROUPING SETS operator in SQL (FLINK-5303)

• Connectors:

  • Elasticsearch 5.x support (FLINK-4988)

  • Implement rescalable non-partitioned state for Kinesis Connector (FLINK-4821)

  • Allow Kinesis Consumer to start from specific timestamp / Date (FLINK-4523)

  • Allow setting custom start-offsets for the Kafka consumer (FLINK-3123)

• CEP library improvements:

  • Make CEP operators rescalable (FLINK-5420)

  • Late elements in side output (FLINK-6205)

  •  Support for quantifiers (*,+,?) to CEP's pattern API (FLINK-3318)

  • Add support for iterative conditions (FLINK-6197)

• Gelly Library:

  • PageRank algorithm for directed graphs (FLINK-4896)

  • Add Evenly Graph Generator to Flink Gelly (FLINK-6393)

    
    

...