...
Efficient Caching and Spilling on Nemo
In-memory caching and spilling are essential features in in-memory big data processing frameworks, and Nemo needs one.
- Identify and persist frequently used data and unpersist it when its usage ended
- Spill in-memory data to disk upon memory pressure
RocketMQ
RocketMQ-Connect Apache Doris
The Apache Doris Sink in RocketMQ allows moving data from RocketMQ to Doris. It writes data from topics in RocketMQ to tables in Doris.
So, in this project, you need to implement a sink based on RocketMQ Streams API, and will executed on RocketMQ Streams runtime.
You should learn before applying for this topic
Difficulty: Medium
Project size: ~350 hour (large)
Potential mentors:
Tigerlee, mail: tigerlee (at) apache.org
RocketMQ-Connect Clickhouse
The Clickhouse Sink in RocketMQ allows moving data from RocketMQ to Clickhouse. It writes data from topics in RocketMQ to tables in Clickhouse.
So, in this project, you need to implement a sink based on RocketMQ Streams API, and will executed on RocketMQ Streams runtime.
You should learn before applying for this topic
Difficulty: Medium
Project size: ~350 hour (large)
Potential mentors:
Tigerlee, mail: tigerlee (at) apache.org
...