THIS IS A TEST INSTANCE. ALL YOUR CHANGES WILL BE LOST!!!!
...
Unless Hive sync is enabled, the dataset written by Hudi using one of the methods above can simply be queries via the Spark datasource like any other source.
Code Block | ||||||
---|---|---|---|---|---|---|
| ||||||
val hoodieROView = spark.read.format("org.apache.hudi").load(basePath + "/path/to/partitions/*") val hoodieIncViewDF = spark.read().format("org.apache.hudi") .option(DataSourceReadOptions.VIEW_TYPE_OPT_KEY(), DataSourceReadOptions.VIEW_TYPE_INCREMENTAL_OPT_VAL()) .option(DataSourceReadOptions.BEGIN_INSTANTTIME_OPT_KEY(), <beginInstantTime>) .load(basePath); |
...