...
Efficient Caching and Spilling on Nemo
In-memory caching and spilling are essential features in in-memory big data processing frameworks, and Nemo needs one.
- Identify and persist frequently used data and unpersist it when its usage ended
- Spill in-memory data to disk upon memory pressure
Apache RocketMQ
RocketMQ
Streaming Sink to-Connect Apache Doris
The Apache Doris Sink in RocketMQ allows moving data from RocketMQ to Doris. It writes data from topics in RocketMQ to tables in Doris.
So, in this project, you need to implement a sink based on RocketMQ Streams API, and will executed on RocketMQ Streams runtime.
You should learn before applying for this topic
Difficulty: Medium
Project size: ~350 hour (large)
Potential mentors:
Tigerlee, mail: tigerlee (at) apache.org
RocketMQ
Streaming Sink to-Connect Clickhouse
The Clickhouse Sink in RocketMQ allows moving data from RocketMQ to Clickhouse. It writes data from topics in RocketMQ to tables in Clickhouse.
So, in this project, you need to implement a sink based on RocketMQ Streams API, and will executed on RocketMQ Streams runtime.
You should learn before applying for this topic
Difficulty: Medium
Project size: ~350 hour (large)
Potential mentors:
Tigerlee, mail: tigerlee (at) apache.org
...