Motivation

Currently Paimon runs without monitoring and metrics out of box. Users need to know how their Paimon Table behaves like what is the commit duration, how many files each commit generated, the performance of scan query and so on. So we need to introduce more metrics for Paimon.  

Public Interfaces

Gauge / Counter / Timer

MetricsContext

CommitMetrics / ScanMetrics / CompactionMetrics

MetricRegistry

MetricsReporter

Proposed Changes

Architecture

Metrics Register

Metrics value update 

Metrics report

Metrics list

Commit Metrics

Scan Metrics

Compaction Metrics

Compatibility, Deprecation, and Migration Plan

There are no changes to the public interface and no impact to existing users.

Test Plan

Will add unit tests and integration tests for metrics.

Rejected Alternatives

None