THIS IS A TEST INSTANCE. ALL YOUR CHANGES WILL BE LOST!!!!
...
| 压缩方式 | GZIP | LZ4 | SNAPPY | UNCOMPRESSED | ||
| dataset | /disk/rl/zc_data/ZT11529.csv | /disk/rl/zc_data/ZT11529.csv | /disk/rl/zc_data/ZT11529.csv | /disk/rl/zc_data/ZT11529.csv | ||
| pagePointNum(ppn) | 10000 | 10000 | 10000 | 10000 | ||
| numOfPagesInChunk(pic) | 100 | 100 | 100 | 100 | ||
| chunksWritten(cw) | 13 | 13 | 13 | 13 | ||
| timeEncoding(te) | TS_2DIFF | TS_2DIFF | TS_2DIFF | TS_2DIFF | ||
| valueDataType(vt) | DOUBLE | DOUBLE | DOUBLE | DOUBLE | ||
| valueEncoding(ve) | GORILLA | GORILLA | GORILLA | GORILLA | ||
| compression(co) | GZIP | LZ4 | SNAPPY | UNCOMPRESSED | ||
| totalPointNum | 12780287 | 12780287 | 12780287 | 12780287 | ||
| tsfileSize(MB) | 19.34862614 | 23.77741051 | 23.15641212 | 36.30773735 | ||
| chunkDataSize_stats_mean(MB) | 1.515139659 | 1.86007007 | 1.813184341 | 2.837062438 | ||
| compressedPageSize_stats_mean(B) | 15824.16667 | 19440.275 | 18948.69 | 29684.7575 | ||
| uncompressedPageSize_stats_mean(B) | 29684.7575 | 29684.7575 | 29684.7575 | 29684.7575 | ||
| timeBufferSize_stats_mean(B) | 11461.4625 | 11461.4625 | 11461.4625 | 11461.4625 | ||
| valueBufferSize_stats_mean(B) | 18221.26833 | 18221.26833 | 18221.26833 | 18221.26833 | ||
| [1] each step | ||||||
| [Avg&Per] (A)1_index_read_deserialize_MagicString_FileMetadataSize(us) | 10294.8866 us - 0.9666637540862395% | 17480.267 us - 2.1945906166045948% | 10013.4112 us - 1.2534900973847278% | 12118.2366 us - 1.4111012934589997% | ||
| [Avg&Per] (A)2_index_read_deserialize_IndexRootNode_MetaOffset_BloomFilter(us) | 5024.5339 us - 0.4717909959598364% | 8883.9004 us - 1.115344774578661% | 4736.353 us - 0.5929020055841159% | 5782.8723 us - 0.6733833355290506% | ||
| [Avg&Per] (A)3_2_index_read_deserialize_IndexRootNode_exclude_to_TimeseriesMetadata_forExactGet(us) | 71997.4296 us - 6.760376125143112% | 73925.4742 us - 9.281102628888053% | 74716.8403 us - 9.353138261607208% | 70859.6681 us - 8.251214480330036% | ||
| [Avg&Per] (B)4_data_read_deserialize_ChunkHeader(us) | 8457.0026 us - 0.7940911055429293% | 4862.6532 us - 0.6104902793831642% | 4758.252799999999 us - 0.5956434472253724% | 2203.0548 us - 0.25653348589027036% | ||
| [Avg&Per] (B)5_data_read_ChunkData(us) | 152242.5999 us - 14.295194193900432% | 171922.22919999997 us - 21.584276200590327% | 101044.6856 us - 12.648887603152982% | 189315.798 us - 22.04477237472181% | ||
| [Avg&Per] (C)6_data_deserialize_PageHeader(us) | 2436.5129999999995 us - 0.22878239411203669% | 2198.3668000000007 us - 0.27599779517870476% | 2319.9517000000005 us - 0.29041416798711567% | 3134.228800000001 us - 0.3649635223062446% | ||
| [Avg&Per] (D-1)7_data_decompress_PageData(us) | 356587.5454999999 us - 33.482666568996265% | 31158.160799999983 us - 3.911805656191469% | 115629.7179 us - 14.474658381255693% | 29640.983400000016 us - 3.4515277590088287% | ||
| [Avg&Per] (D-2)8_data_decode_PageData(us) | 457950.96670000016 us - 43.000434862259155% | 486085.0215000002 us - 61.02639204858503% | 485623.25309999986 us - 60.790866035802786% | 545723.8052999998 us - 63.54650374875476% | ||
| [2] category: (A)get ChunkStatistic->(B)load on-disk Chunk->(C)get PageStatistics->(D)load in-memory PageData | ||||||
| [Avg&Per] (A)get_chunkMetadatas | 87316.85010000001 us - 8.19883087518919% | 100289.6416 us - 12.59103802007131% | 89466.6045 us - 11.199530364576052% | 88760.777 us - 10.335699109318087% | ||
| [Avg&Per] (B)load_on_disk_chunk | 160699.6025 us - 15.089285299443361% | 176784.88239999997 us - 22.19476647997349% | 105802.9384 us - 13.244531050378352% | 191518.85280000002 us - 22.301305860612082% | ||
| [Avg&Per] (C)get_pageHeader | 2436.5129999999995 us - 0.22878239411203669% | 2198.3668000000007 us - 0.27599779517870476% | 2319.9517000000005 us - 0.29041416798711567% | 3134.228800000001 us - 0.3649635223062446% | ||
| [Avg&Per] (D_1)decompress_pageData | 356587.5454999999 us - 33.482666568996265% | 31158.160799999983 us - 3.911805656191469% | 115629.7179 us - 14.474658381255693% | 29640.983400000016 us - 3.4515277590088287% | ||
| [Avg&Per] (D_2)decode_pageData | 457950.96670000016 us - 43.000434862259155% | 486085.0215000002 us - 61.02639204858503% | 485623.25309999986 us - 60.790866035802786% | 545723.8052999998 us - 63.54650374875476% | ||
| [3] D_1 compare each step inside | ||||||
| [Avg&Per] (D-1)7_1_data_ByteBuffer_to_ByteArray(us) | 1269.7615999999996 us - 0.36377892330196115% | 1808.5776999999991 us - 7.207505165727991% | 1687.9916000000003 us - 1.412377327892232% | 3197.6313 us - 41.86667970732365% | ||
| [Avg&Per] (D-1)7_2_data_decompress_PageDataByteArray(us) | 345856.23130000004 us - 99.08569249502276% | 21247.39440000001 us - 84.67466169480036% | 116100.69619999993 us - 97.14384305311928% | 2432.4552000000012 us - 31.84820675254647% | ||
| [Avg&Per] (D-1)7_3_data_ByteArray_to_ByteBuffer(us) | [Avg&Per] (D-1)7_43_data_splitByteArray_timeto_value_BufferByteBuffer(us) | |||||
| [3] D_2 compare each step inside | ||||||
| 374.18470000000025 us - 0.10720162531460037% | 442.10720000000003 us - 1.761876157051776% | 424.26030000000026 us - 0.35498732863644405% | 421.1930000000002 us - 5.51469221169019% | |||
| [Avg&Per] (D-1)7_4_data_split_time_value_Buffer(us) | 1547.4220999999993 us - 0.443326956360674% | 1594.8989000000004 us - 6.355956982419887% | 1301.2614999999998 us - 1.0887922903520593% | 1586.372500000001 us - 20.770421328439692% | ||
| [3] D_2 compare each step inside | ||||||
| [Avg&Per] (D-2)8_1_createBatchData(us) | 3430.8672 us - 0.22855030377902266% | 4174.8958 us - 0.275155541260775% | 3438.1465 us - 0.22874736939899784% | 3730.6205 us - 0.24721094086707432% | ||
| [Avg&Per] (D-2)8_2_timeDecoder_hasNext(us) | 234016.77980000002 us - 15.589238228946503% | 236135.9462 us - 15.56305048087338% | 235278.4135 us - 15.65358490817499% | 234469.6457 us - 15.537217392727715% | ||
| [Avg&Per] (D-2)8_3_timeDecoder_readLong(us) | 357893.9434 us - 23.841426880277478% | 360253.1425 us - 23.743262865502565% | 358341.1524 us - 23.84121675993312% | 363063.0738 us - 24.058508247673558% | ||
| [Avg&Per] (D-2)8_4_valueDecoder_read(us) | 353821.6809 us - 23.570149451806063% | 359477.8899 us - 23.692168165422427% | 356440.4841 us - 23.714761161335133% | 355773.1939 us - 23.5754416723178%[Avg&Per] (D-2)8_1_createBatchData(us) | ||
| [Avg&Per] (D-2)8_25_timeDecoder_hasNextcheckValueSatisfyOrNot(us) | [Avg&Per] (D-2)8_3_timeDecoder_readLong(us) | [Avg&Per] (D-2)8_4_valueDecoder_read(us) | 223758.3096 us - 14.905861011513531% | 224938.2721 us - 14.825043539994219% | 224282.1638 us - 14.921980483485841% | 226053.6587 us - 14.979528915812129%[Avg&Per] (D-2)8_5_checkValueSatisfyOrNot(us) |
| [Avg&Per] (D-2)8_6_putIntoBatchData(us) | 328221.5562 us - 21.864774123677403% | 332305.597 us - 21.90131940694663% | 325251.7878 us - 21.639709317671908% | 325993.7043 us - 21.602092830601723% | ||
改变编码方式
人工数据实验结果
RLValueEncodingSynExpScripts.sh
...