Apache Kylin : Analytical Data Warehouse for Big Data
Welcome to Kylin Wiki.
In this pages, I would like to list all new feature and break changes. Some features are in the status of IN PROGRESS, means Kylin team is going to implement this feature, and we will obey its priority. So if you have your suggestion/opinion on current priority, please let us know.
Basic feature
IN PROGRESS SOURCE IN PROGRESS SOURCE P1 IN PROGRESS SOURCE P2 IN PROGRESS SOURCE P2 DELETED BUILD ENGINE N/A READY BUILD ENGINE P0 N/A BUILD ENGINE N/A DELETED STORAGE ENGINE N/A READY STORAGE ENGINE P0 READY QUERY ENGINE P0 READY MEASURE P0 READY QUERY ENGINE DEPRECATED METASTORE P2 READY METASTORE P0 IN PROGRESS TOOL P1 READY TOOL P0 READY SOURCE P1 IN PROGRESS QUERY ENGINE P0Feature Description Status Component Priority Expected Date Kafka Source(NRT) In design phase, did not have a conclusion of how to implement. 2021-Q2 Kafka Source(Real-time OLAP) In design phase, did not have a conclusion of how to implement. JDBC Source(Original version) In design phase, did not have a conclusion of how to implement. JDBC Source(Datasource SDK) In design phase, did not have a conclusion of how to implement. MapReduce Build Engine This feature maybe useless Spark Build Engine New implementation provided 2020-Q1 Flink Build Engine N/A HBase Storage Discussion in mailing list Parquet Storage Discussion in mailing list 2020-Q1 Distributed Query Engine New implementation provided 2020-Q2 Advanced Measure Raw measure and Extended_Column will be removed, COUNT_DISTINCT, TopN, PERCENTILE will still be supported. 2020-Q1 Query Cache Not change HBase Metastore Should be removed in the future. RDBMS Metastore Cardinality Computation Planning 2020-Q4 Storage Cleanup New implementation 2020-Q4 CSV Source New implementation 2020-Q2 SQL Standard New implementation 2020-Q4 ~ 2021-Q1
Advanced feature
N/A N/A IN PROGRESS P0 IN PROGRESS P0 READY P0 READY P0 REMOVED N/A REMOVED N/A IN PROGRESS P0 IN PROGRESS P0 IN PROGRESS P0Feature Description Status Priority Global Dictionary(Hive) New global dictionary will replace this feature. Cube Planner In design phase, did not have a conclusion of how to implement. 2020-Q4 System Cube and Dashboard Not well tested, planning 2020-Q4 Read write Seperatation New implementation provided 2020-Q3 Pushdown Engine New pushdown engine will only support SparkSQL. 2020-Q2 Shrunken Dictionary This feature maybe useless UHC dictionary This feature maybe useless Deploy on AWS EMR Planning 2020-Q4 Containerization Planning Hadoop 3 support Going to support Hadoop3 + Hive2 in 2020-Q4. Not sure when to suppoort Hive 3. 2020-Q4