...
CarbonData 1.5.1 intention was to move more closer to unified analytics. We want to enable CarbonData files to be read from more engines/libraries to support various use cases. In this regard we have added support to read write CarbonData files from c++ libraries. Additionally CarbonData files can be read using Java SDK, Spark FileFormat interface, Spark, Presto.
CarbonData added multiple optimisations to reduce the store size so that query can take advantage of lesser IO. Several enhancements have been made to Streaming support from CarbonData.improve query and compaction performance.
In this version of CarbonData, more than 150 JIRA tickets related to new features, improvements, and bugs has been resolved. Following are the summary.
...
Please find the detailed JIRA list: https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12320220&version=12341006
Sub-task
...
...
Bug
...
...
New Feature
- [CARBONDATA-2896] - Adaptive encoding for primitive data types
- [CARBONDATA-2916] - Support CarbonCli tool for data summary
- [CARBONDATA-2919] - StreamSQL support ingest from Kafka
- [CARBONDATA-2945] - Support JSON record in StreamSQL
- [CARBONDATA-2965] - Support scan performance benchmark tool
- [CARBONDATA-2976] - Support dumping column chunk meta in CarbonCli
Improvement
...
...
Task
...