...
3. When using HoodieDeltaStreamer tool to ingest, you can set the configs in properties file and pass the file as the cmdline argument "--props
"
How to create Hive style partition folder structure?
By default Hudi creates the partition folders with just the partition values, but if would like to create partition folders similar to the way Hive will generate the structure, with paths that contain key value pairs, like country=us/… or datestr=2021-04-20. This is Hive style (or format) partitioning. The paths include both the names of the partition keys and the values that each path represents.
To enable hive style partitioning, you need to add this hoodie config when you write your data:
Code Block |
---|
hoodie.datasource.write.hive_style_partitioning: true |
How do I pass hudi configurations to my beeline Hive queries?
...