...

EXCHANGE_OPERATOR的Active时间为575.846us，等待上游数据的时间为56.122ms

4

...

User Interface

Add 3 SessionVariable knobs.增加了三个SessionVariable开关
enable_pipeline_x_engine
是否开启pipelineX

enable_local_shuffle
是否开启local exchange。默认为true。不开启local exchange时执行模型和老的pipeline几乎一致。打开local exchange时会在必要的地方插入local exchange节点，这样可以很大程度避免数据倾斜导致的性能问题。

ignore_storage_data_distribution
是否忽略存储层数据分布。默认为true。在老的执行模型上，当tablet数量小于并发数时，实际执行并发受tablet数量制约，最大也只能和tablet数量一致。当打开这个开关后，执行并发不再受tablet数量制约。详细设计见文末参考文档4。Ignore storage data distribution or not. If turn on, execution concurrency will not be restricted by tablet num. Please refer to Further Reading 4 for more details.

A new http 增加了一个http api：http://{host}:{web_server_port}/api/running_pipeline_tasks
详情见文末参考文档3。

参考文档

Please refer to Further Reading 3 for more details.

Further Reading

1. LocalExchanger Rules

2. PipelineX Dependency Details
3. pipelineX Debug Manual
4. PipelineX Parallel Execution Design

5. LocalExchange规划规则：LocalExchanger规划规则

6. dependency逻辑梳理：PipelineX中dependency逻辑梳理

7. debug手册：pipelineX debug手册

8. 执行并发设计：pipelineX执行并发设计