Page History

...

The Gluten project utilizes JVM-based SQL engines' (like currently Apache Spark) plugin mechanism to intercept and send query plans to native engines for execution, bypassing the original engine's less efficient execution path. The project supports multiple native engines as backends, including Velox, ClickHouse, and Apache Arrow. For operations that the native engines cannot handle, Gluten falls back to the SQL engine's normal execution path. In terms of thread models, Gluten utilizes JNI (Java Native Interface) library calls to invoke native code directly within original engine's executor task threads, avoiding the introduction of complex thread models.

...