Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

The current approach is easy to set up, but may not have optimal performance and resource utilityutilisation

  • Tasks may have different parallelisms, thus not all of the slots contains an entire pipeline of tasks. For slots with fewer tasks, the slot resource predefined for an entire pipeline might be wasteful.
  • It could be hard to align slot resource with tasks requirements in all resource aspects (heap, network, managed, etc.). 

We propose fine grained resource management, which optimizes resource utility optimises resource utilisation in conditions where resource requirements of individual tasks are known or can be tuned.

...