Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Metric Name

Description

Type

Unit

Update at

lastCommitDuration

The time it took to complete the last commit.

Gauge

Ms

Timer starts before commit starting, update commit duration after the last commit finished.

commitDuration

Distributions of the time taken by the last few commits.

Histogram

Ms

Timer starts before commit starting, update commit duration after each commit finished.

lastCommitAttempts

The number of attempts the last commit made.

Counter

Number

Increment by 1 when trying to commit once, clear the counter after the last commit finished.

numTableFilesAddedlastTableFilesAdded

Number of added table files in last commit, including newly created data files and compacted after.

Gauge

Number

Collecting changes from committables

numTableFilesDeletedlastTableFilesDeleted

Number of deleted table files in last commit, which comes from compacted before.

Gauge

Number

Collecting changes from committables

numTableFilesAppendedlastTableFilesAppended

Number of appended table files in last commit, which means the newly created data files.

Gauge

Number

Collecting changes from committables

numTableFilesCompatedlastTableFilesCommitCompated

Number of compacted table files in last commit, including compacted before and after.

Gauge

Number

Collecting changes from committables

numChangelogFilesAppendedlastChangelogFilesAppended

Number of appended changelog files in last commit

Gauge

Number

Collecting changes from committables

numChangelogFileCompactedlastChangelogFileCommitCompacted

Number of compacted changelog files in last commit

Gauge

Number

Collecting changes from committables

totalTablesFiles

Number of total data files currently maintained on storage.

Counter

Number

Collecting changes from committables

totalChangelogFiles

Number of total changelog files currently maintained on storage.

Counter

Number

Collecting changes from committables

numGeneratedSnapshotslastGeneratedSnapshots

Number of snapshot files generated in last commit, maybe 1 snapshot or 2 snapshots.

Gauge

Number

After collecting changes from committables

totalSnapshots

Number of currently retained total snapshots.

Counter

Number

When trying to commit, the counter will increment by the number of snapshots generated

When expiring snapshots, the counter will decrement by the number of expiring snapshots.

numTotalRecordsAppendedlastTotalRecordsAppended

Total records count in last commit with APPEND commit kind

Gauge

Number

Preparing snapshot file with APPEND commit kind

numDeltaRecordsAppendedlastDeltaRecordsAppended

Delta records count in last commit with APPEND commit kind

Gauge

Number

Preparing snapshot file with APPEND commit kind

numChangelogRecordsAppendedlastChangelogRecordsAppended

Changelog records count in last commit with APPEND commit kind

Gauge

Number

Preparing snapshot file with APPEND commit kind

numTotalRecordsCompatedlastTotalRecordsCommitCompated

Total records count in last commit with COMPACT commit kind

Gauge

Number

Preparing snapshot file with COMPACT commit kind

numDeltaRecordsCompatedlastDeltaRecordsCommitCompated

Delta records count in last commit with COMPACT commit kind

Gauge

Number

Preparing snapshot file with COMPACT commit kind

numChangelogRecordsCompatedlastChangelogRecordsCommitCompated

Changelog records count in last commit with COMPACT commit kind

Gauge

Number

Preparing snapshot file with COMPACT commit kind

numPartitionsWrittenlastPartitionsWritten

Number of partitions written in last commit

Gauge

Number

After collecting changes from committables

numBucketsWrittenlastBucketsWritten

Number of buckets written in last commit

Gauge

Number

After collecting changes from committables

...

Metric Name

Description

Type

Unit

Update at

lastScanDuration

The time it took to complete the last scan planning.

Gauge

Ms

Timer starts before the scan planning starts, update after the last scan planning operation finished

scanDuration

Distributions of the time taken by the last few scan planning operations.

Histogram

Ms

Timer starts before the scan planning starts, update after each planning finished

numScannedManifestslastScannedManifests

Number of scanned manifests files in the last scan planning.

Gauge

Number

Scan planning

numSkippedManifestslastScanSkippedManifests

Number of skipped manifests files in the last scan planning.

Gauge

Number

Scan planning

numResultTableFileslastScanResultTableFiles

Number of result table files in the last scan planning.

Gauge

Number

Scan planning

numGenerateSplitslastScanGenerateSplits

Number of splits generated by the last scan planning.

Gauge

Number

Scan planning

...

Metric Name

Description

Type

Unit

Update at

lastCompactionDuration

The time it took to complete the last compaction.

Gauge

Ms

Timer starts before compaction, update after the last compaction finished

compactionDuration

Distributions of the time taken by the last few compactions.

Histogram

Ms

Timer starts before compaction, update after each compaction finished

numTableFilesCompactedBeforelastTableFilesCompactedBefore

Number of deleted files in last compaction

Gauge

Number

After getting compaction result.

numTableFilesCompactedAfterlastTableFilesCompactedAfter

Number of added files in last compaction

Gauge

Number

After getting compaction result.

numChangelogFilesCompactedlastChangelogFilesCompacted

Number of changelog files compacted in last compaction

Gauge

Number

After getting compaction result.

numSortedRunslastSortedRuns

Current number Number of total sorted runs of all levels at last compaction

Gauge

Number

Updating levels after getting compaction result.

numLevel0FileslastLevel0Files

Current number Number of files at level 0 at last compaction

Gauge

Number

Updating levels after getting compaction result.

...