...
Metric Name | Description | Type | Unit | Update at |
lastCommitDuration | The time it took to complete the last commit. | Gauge | Ms | Timer starts before commit starting, update commit duration after the last commit finished. |
commitDuration | Distributions of the time taken by the last few commits. | Histogram | Ms | Timer starts before commit starting, update commit duration after each commit finished. |
lastCommitAttempts | The number of attempts the last commit made. | Counter | Number | Increment by 1 when trying to commit once, clear the counter after the last commit finished. |
numTableFilesAddedlastTableFilesAdded | Number of added table files in last commit, including newly created data files and compacted after. | Gauge | Number | Collecting changes from committables |
numTableFilesDeletedlastTableFilesDeleted | Number of deleted table files in last commit, which comes from compacted before. | Gauge | Number | Collecting changes from committables |
numTableFilesAppendedlastTableFilesAppended | Number of appended table files in last commit, which means the newly created data files. | Gauge | Number | Collecting changes from committables |
numTableFilesCompatedlastTableFilesCommitCompated | Number of compacted table files in last commit, including compacted before and after. | Gauge | Number | Collecting changes from committables |
numChangelogFilesAppendedlastChangelogFilesAppended | Number of appended changelog files in last commit | Gauge | Number | Collecting changes from committables |
numChangelogFileCompactedlastChangelogFileCommitCompacted | Number of compacted changelog files in last commit | Gauge | Number | Collecting changes from committables |
totalTablesFiles | Number of total data files currently maintained on storage. | Counter | Number | Collecting changes from committables |
totalChangelogFiles | Number of total changelog files currently maintained on storage. | Counter | Number | Collecting changes from committables |
numGeneratedSnapshotslastGeneratedSnapshots | Number of snapshot files generated in last commit, maybe 1 snapshot or 2 snapshots. | Gauge | Number | After collecting changes from committables |
totalSnapshots | Number of currently retained total snapshots. | Counter | Number | When trying to commit, the counter will increment by the number of snapshots generated When expiring snapshots, the counter will decrement by the number of expiring snapshots. |
numTotalRecordsAppendedlastTotalRecordsAppended | Total records count in last commit with APPEND commit kind | Gauge | Number | Preparing snapshot file with APPEND commit kind |
numDeltaRecordsAppendedlastDeltaRecordsAppended | Delta records count in last commit with APPEND commit kind | Gauge | Number | Preparing snapshot file with APPEND commit kind |
numChangelogRecordsAppendedlastChangelogRecordsAppended | Changelog records count in last commit with APPEND commit kind | Gauge | Number | Preparing snapshot file with APPEND commit kind |
numTotalRecordsCompatedlastTotalRecordsCommitCompated | Total records count in last commit with COMPACT commit kind | Gauge | Number | Preparing snapshot file with COMPACT commit kind |
numDeltaRecordsCompatedlastDeltaRecordsCommitCompated | Delta records count in last commit with COMPACT commit kind | Gauge | Number | Preparing snapshot file with COMPACT commit kind |
numChangelogRecordsCompatedlastChangelogRecordsCommitCompated | Changelog records count in last commit with COMPACT commit kind | Gauge | Number | Preparing snapshot file with COMPACT commit kind |
numPartitionsWrittenlastPartitionsWritten | Number of partitions written in last commit | Gauge | Number | After collecting changes from committables |
numBucketsWrittenlastBucketsWritten | Number of buckets written in last commit | Gauge | Number | After collecting changes from committables |
...
Metric Name | Description | Type | Unit | Update at |
lastScanDuration | The time it took to complete the last scan planning. | Gauge | Ms | Timer starts before the scan planning starts, update after the last scan planning operation finished |
scanDuration | Distributions of the time taken by the last few scan planning operations. | Histogram | Ms | Timer starts before the scan planning starts, update after each planning finished |
numScannedManifestslastScannedManifests | Number of scanned manifests files in the last scan planning. | Gauge | Number | Scan planning |
numSkippedManifestslastScanSkippedManifests | Number of skipped manifests files in the last scan planning. | Gauge | Number | Scan planning |
numResultTableFileslastScanResultTableFiles | Number of result table files in the last scan planning. | Gauge | Number | Scan planning |
numGenerateSplitslastScanGenerateSplits | Number of splits generated by the last scan planning. | Gauge | Number | Scan planning |
...
Metric Name | Description | Type | Unit | Update at |
lastCompactionDuration | The time it took to complete the last compaction. | Gauge | Ms | Timer starts before compaction, update after the last compaction finished |
compactionDuration | Distributions of the time taken by the last few compactions. | Histogram | Ms | Timer starts before compaction, update after each compaction finished |
numTableFilesCompactedBeforelastTableFilesCompactedBefore | Number of deleted files in last compaction | Gauge | Number | After getting compaction result. |
numTableFilesCompactedAfterlastTableFilesCompactedAfter | Number of added files in last compaction | Gauge | Number | After getting compaction result. |
numChangelogFilesCompactedlastChangelogFilesCompacted | Number of changelog files compacted in last compaction | Gauge | Number | After getting compaction result. |
numSortedRunslastSortedRuns | Current number Number of total sorted runs of all levels at last compaction | Gauge | Number | Updating levels after getting compaction result. |
numLevel0FileslastLevel0Files | Current number Number of files at level 0 at last compaction | Gauge | Number | Updating levels after getting compaction result. |
...