THIS IS A TEST INSTANCE. ALL YOUR CHANGES WILL BE LOST!!!!
...
For the basic index class in Spark context, we can create a HoodieSparkIndex, the definition is:
Code Block | ||
---|---|---|
| ||
public class HoodieSparkIndex<T extends HoodieRecordPayload>
extends HoodieGeneralIndex<
T,
JavaRDD<HoodieRecord<T>>,
JavaRDD<WriteStatus>,
JavaRDD<HoodieKey>,
JavaPairRDD<HoodieKey, Option<Pair<String, String>>>> {
@Override
public JavaPairRDD<HoodieKey, Option<Pair<String, String>>> fetchRecordLocation(
JavaRDD<HoodieKey> hoodieKeys, HoodieTable<T> hoodieTable) {
//...
}
@Override
public JavaRDD<HoodieRecord<T>> tagLocation(JavaRDD<HoodieRecord<T>> recordRDD,
HoodieTable<T> hoodieTable) throws HoodieIndexException {
//...
}
@Override
public JavaRDD<WriteStatus> updateLocation(JavaRDD<WriteStatus> writeStatusRDD,
HoodieTable<T> hoodieTable) throws HoodieIndexException {
//...
}
} |
For the basic index class in Flink context, we can create a HoodieFlinkIndex, the definition is:
Rollout/Adoption Plan
None
...