Versions Compared

Old Version 19

changes.mady.by.user Maximilian Michels

Saved on

compared with

New Version 20

changes.mady.by.user Rui Fan

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Update the discussion and vote thread

Status

Discussion threadhttps://lists.apache.org/thread/pvfb3fw99mj8r1x8zzyxgvk4dcppwssz
Vote threadhttps://lists.apache.org/thread/75dz0opdz9l8trv7spvjvfdv7j8ny3kr
JIRA


Release

Motivation

One of the most challenging aspects of running always-on streaming pipeline is the correct sizing of Flink deployments. Too few resources lead to unstable Flink jobs which requires users to scale up their deployments manually. On the other hand, a surplus of resources can become very costly to users over time. Even once optimized, the resource demands can change depending on the time of the day or due to seasonal patterns. Clearly, it would be desirable to automatically adjust the resources for Flink deployments. This process is referred to as autoscaling.

...