Apache Kylin : Analytical Data Warehouse for Big Data
Welcome to Kylin Wiki.
In this pages, I would like to list all new feature and break changes. Some features are in the status of IN PROGRESS, means Kylin team is going to implement this feature, and we will obey its priority. So if you have your suggestion/opinion on current priority, please let us know.
Basic feature
IN PROGRESS SOURCE IN PROGRESS SOURCE P1 FUTURE IN PROGRESS SOURCE P2 FUTURE IN PROGRESS SOURCE P2 FUTURE DELETED BUILD ENGINE READY BUILD ENGINE P0 4.0.0-ALPHA N/A BUILD ENGINE DELETED STORAGE ENGINE READY STORAGE ENGINE P0 4.0.0-ALPHA READY QUERY ENGINE P0 4.0.0-ALPHA READY MEASURE P0 4.0.0-ALPHA READY MEASURE P0 4.0.0-ALPHA IN PROGRESS MEASURE P0 4.0.0-BETA READY MEASURE 4.0.0-ALPHA READY QUERY ENGINE BEFORE 4.0 DEPRECATED METASTORE P2 BEFORE 4.0 READY METASTORE P0 BEFORE 4.0 IN PROGRESS TOOL P1 4.0.0-BETA READY TOOL P0 4.0.0-ALPHA READY SOURCE P1 4.0.0-ALPHA IN PROGRESS QUERY ENGINE P0 4.0.0-BETA N/A ADVENCED IN PROGRESS ADVENCED P0 4.0.0-BETA IN PROGRESS ADVENCED P0 4.0.0-BETA READY ADVENCED P0 4.0.0-ALPHA READY ADVENCED P0 4.0.0-ALPHA DELETE ADVENCED DELETE ADVENCED IN PROGRESS ENV P0 4.0.0-BETA IN PROGRESS ENV P0 4.0.0-ALPHA IN PROGRESS ENV P0 4.0.0-BETA IN PROGRESS ENV P2 FUTURE IN PROGRESS ENV P2 FUTUREFeature Description Comment Status Component Priority Expected Kafka Source(NRT) In design phase, did not have a conclusion of how to implement. Kafka Source(Real-time OLAP) In design phase, did not have a conclusion of how to implement. JDBC Source(Original version) In design phase, did not have a conclusion of how to implement. JDBC Source(Datasource SDK) In design phase, did not have a conclusion of how to implement. MapReduce Build Engine This feature maybe useless Spark Build Engine New implementation provided Flink Build Engine N/A HBase Storage Discussion in mailing list Parquet Storage Discussion in mailing list Distributed Query Engine New implementation provided Advanced Measure - Bitmap Advanced Measure - HLL Advanced Measure - TopN Advanced Measure - Percentile P0 Query Cache Not change HBase Metastore Should be removed in the future. RDBMS Metastore Cardinality Computation Planning Storage Cleanup New implementation CSV Source New implementation SQL Standard New implementation Global Dictionary(Hive) New global dictionary will replace this feature. Cube Planner In design phase, did not have a conclusion of how to implement. System Cube and Dashboard Not well tested, planning Read write Seperatation New implementation provided Pushdown Engine New pushdown engine will only support SparkSQL. Shrunken Dictionary This feature maybe useless UHC dictionary This feature maybe useless Deploy on AWS EMR Planning Containerization Planning Hadoop3 support Going to support Hadoop3 + Hive2 in 2020-Q4. Not sure when to suppoort Hive 3. Hive3 support Spark3 support