...
The TaskMainThread will add records to the ExternalSorter, which is a multi-way merge sorter for sorting large amounts of data that cannot totally fit into memory. The ExternalSorter will sort the records according to the Order and send the sorted records to output at the end of inputs. The following diagram illustrates the interaction between the TaskMainThread and the ExternalSorterto output at the end of inputs. The following diagram illustrates the interaction between the TaskMainThread and the ExternalSorter:
Aggregate
We introduce the aggregate
API in the PartitionWindowedStream.
...