Comments (1)
Without huge refactor and code changes, we can add following metrics to tidb-operator that are similar to the ones supported by controller-runtime:
➜ ~ curl localhost:6060/metrics
# HELP controller_runtime_active_workers Number of currently used workers per controller
# TYPE controller_runtime_active_workers gauge
controller_runtime_active_workers{controller="backup"} 200
controller_runtime_active_workers{controller="dmcluster"} 100
controller_runtime_active_workers{controller="restore"} 100
controller_runtime_active_workers{controller="tidb-dashboard"} 100
controller_runtime_active_workers{controller="tidb-ng-monitoring"} 100
controller_runtime_active_workers{controller="tidbcluster"} 100
controller_runtime_active_workers{controller="tidbcluster-pod"} 100
controller_runtime_active_workers{controller="tidbinitializer"} 100
controller_runtime_active_workers{controller="tidbmonitor"} 100
# HELP go_gc_duration_seconds A summary of the pause duration of garbage collection cycles.
# TYPE go_gc_duration_seconds summary
go_gc_duration_seconds{quantile="0"} 5.1564e-05
go_gc_duration_seconds{quantile="0.25"} 6.441e-05
go_gc_duration_seconds{quantile="0.5"} 0.000139065
go_gc_duration_seconds{quantile="0.75"} 0.000214783
go_gc_duration_seconds{quantile="1"} 0.000406482
go_gc_duration_seconds_sum 0.002603721
go_gc_duration_seconds_count 15
# HELP go_goroutines Number of goroutines that currently exist.
# TYPE go_goroutines gauge
go_goroutines 1244
# HELP go_info Information about the Go environment.
# TYPE go_info gauge
go_info{version="go1.19.3"} 1
# HELP go_memstats_alloc_bytes Number of bytes allocated and still in use.
# TYPE go_memstats_alloc_bytes gauge
go_memstats_alloc_bytes 4.2361808e+07
# HELP go_memstats_alloc_bytes_total Total number of bytes allocated, even if freed.
# TYPE go_memstats_alloc_bytes_total counter
go_memstats_alloc_bytes_total 1.49225176e+08
# HELP go_memstats_buck_hash_sys_bytes Number of bytes used by the profiling bucket hash table.
# TYPE go_memstats_buck_hash_sys_bytes gauge
go_memstats_buck_hash_sys_bytes 1.493425e+06
# HELP go_memstats_frees_total Total number of frees.
# TYPE go_memstats_frees_total counter
go_memstats_frees_total 543136
# HELP go_memstats_gc_cpu_fraction The fraction of this program's available CPU time used by the GC since the program started.
# TYPE go_memstats_gc_cpu_fraction gauge
go_memstats_gc_cpu_fraction 0.0011690751561914288
# HELP go_memstats_gc_sys_bytes Number of bytes used for garbage collection system metadata.
# TYPE go_memstats_gc_sys_bytes gauge
go_memstats_gc_sys_bytes 1.0227312e+07
# HELP go_memstats_heap_alloc_bytes Number of heap bytes allocated and still in use.
# TYPE go_memstats_heap_alloc_bytes gauge
go_memstats_heap_alloc_bytes 4.2361808e+07
# HELP go_memstats_heap_idle_bytes Number of heap bytes waiting to be used.
# TYPE go_memstats_heap_idle_bytes gauge
go_memstats_heap_idle_bytes 8.282112e+06
# HELP go_memstats_heap_inuse_bytes Number of heap bytes that are in use.
# TYPE go_memstats_heap_inuse_bytes gauge
go_memstats_heap_inuse_bytes 5.312512e+07
# HELP go_memstats_heap_objects Number of allocated objects.
# TYPE go_memstats_heap_objects gauge
go_memstats_heap_objects 195763
# HELP go_memstats_heap_released_bytes Number of heap bytes released to OS.
# TYPE go_memstats_heap_released_bytes gauge
go_memstats_heap_released_bytes 2.424832e+06
# HELP go_memstats_heap_sys_bytes Number of heap bytes obtained from system.
# TYPE go_memstats_heap_sys_bytes gauge
go_memstats_heap_sys_bytes 6.1407232e+07
# HELP go_memstats_last_gc_time_seconds Number of seconds since 1970 of last garbage collection.
# TYPE go_memstats_last_gc_time_seconds gauge
go_memstats_last_gc_time_seconds 1.6764060751465487e+09
# HELP go_memstats_lookups_total Total number of pointer lookups.
# TYPE go_memstats_lookups_total counter
go_memstats_lookups_total 0
# HELP go_memstats_mallocs_total Total number of mallocs.
# TYPE go_memstats_mallocs_total counter
go_memstats_mallocs_total 738899
# HELP go_memstats_mcache_inuse_bytes Number of bytes in use by mcache structures.
# TYPE go_memstats_mcache_inuse_bytes gauge
go_memstats_mcache_inuse_bytes 4800
# HELP go_memstats_mcache_sys_bytes Number of bytes used for mcache structures obtained from system.
# TYPE go_memstats_mcache_sys_bytes gauge
go_memstats_mcache_sys_bytes 15600
# HELP go_memstats_mspan_inuse_bytes Number of bytes in use by mspan structures.
# TYPE go_memstats_mspan_inuse_bytes gauge
go_memstats_mspan_inuse_bytes 514216
# HELP go_memstats_mspan_sys_bytes Number of bytes used for mspan structures obtained from system.
# TYPE go_memstats_mspan_sys_bytes gauge
go_memstats_mspan_sys_bytes 571200
# HELP go_memstats_next_gc_bytes Number of heap bytes when next garbage collection will take place.
# TYPE go_memstats_next_gc_bytes gauge
go_memstats_next_gc_bytes 7.250072e+07
# HELP go_memstats_other_sys_bytes Number of bytes used for other system allocations.
# TYPE go_memstats_other_sys_bytes gauge
go_memstats_other_sys_bytes 1.042615e+06
# HELP go_memstats_stack_inuse_bytes Number of bytes in use by the stack allocator.
# TYPE go_memstats_stack_inuse_bytes gauge
go_memstats_stack_inuse_bytes 5.701632e+06
# HELP go_memstats_stack_sys_bytes Number of bytes obtained from system for stack allocator.
# TYPE go_memstats_stack_sys_bytes gauge
go_memstats_stack_sys_bytes 5.701632e+06
# HELP go_memstats_sys_bytes Number of bytes obtained from system.
# TYPE go_memstats_sys_bytes gauge
go_memstats_sys_bytes 8.0459016e+07
# HELP go_threads Number of OS threads created.
# TYPE go_threads gauge
go_threads 10
# HELP process_cpu_seconds_total Total user and system CPU time spent in seconds.
# TYPE process_cpu_seconds_total counter
process_cpu_seconds_total 0.74
# HELP process_max_fds Maximum number of open file descriptors.
# TYPE process_max_fds gauge
process_max_fds 1.048576e+06
# HELP process_open_fds Number of open file descriptors.
# TYPE process_open_fds gauge
process_open_fds 11
# HELP process_resident_memory_bytes Resident memory size in bytes.
# TYPE process_resident_memory_bytes gauge
process_resident_memory_bytes 1.0930176e+08
# HELP process_start_time_seconds Start time of the process since unix epoch in seconds.
# TYPE process_start_time_seconds gauge
process_start_time_seconds 1.67640605692e+09
# HELP process_virtual_memory_bytes Virtual memory size in bytes.
# TYPE process_virtual_memory_bytes gauge
process_virtual_memory_bytes 8.03979264e+08
# HELP process_virtual_memory_max_bytes Maximum amount of virtual memory available in bytes.
# TYPE process_virtual_memory_max_bytes gauge
process_virtual_memory_max_bytes 1.8446744073709552e+19
# HELP promhttp_metric_handler_requests_in_flight Current number of scrapes being served.
# TYPE promhttp_metric_handler_requests_in_flight gauge
promhttp_metric_handler_requests_in_flight 1
# HELP promhttp_metric_handler_requests_total Total number of scrapes by HTTP status code.
# TYPE promhttp_metric_handler_requests_total counter
promhttp_metric_handler_requests_total{code="200"} 0
promhttp_metric_handler_requests_total{code="500"} 0
promhttp_metric_handler_requests_total{code="503"} 0
# HELP workqueue_adds_total Total number of adds handled by workqueue
# TYPE workqueue_adds_total counter
workqueue_adds_total{name="backup"} 0
workqueue_adds_total{name="backupSchedule"} 0
workqueue_adds_total{name="dmcluster"} 0
workqueue_adds_total{name="restore"} 0
workqueue_adds_total{name="tidb-dashboard"} 0
workqueue_adds_total{name="tidb-ng-monitoring"} 0
workqueue_adds_total{name="tidbcluster"} 0
workqueue_adds_total{name="tidbcluster pods"} 38
workqueue_adds_total{name="tidbinitializer"} 0
workqueue_adds_total{name="tidbmonitor"} 0
# HELP workqueue_depth Current depth of workqueue
# TYPE workqueue_depth gauge
workqueue_depth{name="backup"} 0
workqueue_depth{name="backupSchedule"} 0
workqueue_depth{name="dmcluster"} 0
workqueue_depth{name="restore"} 0
workqueue_depth{name="tidb-dashboard"} 0
workqueue_depth{name="tidb-ng-monitoring"} 0
workqueue_depth{name="tidbcluster"} 0
workqueue_depth{name="tidbcluster pods"} 0
workqueue_depth{name="tidbinitializer"} 0
workqueue_depth{name="tidbmonitor"} 0
# HELP workqueue_longest_running_processor_seconds How many seconds has the longest running processor for workqueue been running.
# TYPE workqueue_longest_running_processor_seconds gauge
workqueue_longest_running_processor_seconds{name="backup"} 0
workqueue_longest_running_processor_seconds{name="backupSchedule"} 0
workqueue_longest_running_processor_seconds{name="dmcluster"} 0
workqueue_longest_running_processor_seconds{name="restore"} 0
workqueue_longest_running_processor_seconds{name="tidb-dashboard"} 0
workqueue_longest_running_processor_seconds{name="tidb-ng-monitoring"} 0
workqueue_longest_running_processor_seconds{name="tidbcluster"} 0
workqueue_longest_running_processor_seconds{name="tidbcluster pods"} 0
workqueue_longest_running_processor_seconds{name="tidbinitializer"} 0
workqueue_longest_running_processor_seconds{name="tidbmonitor"} 0
# HELP workqueue_queue_duration_seconds How long in seconds an item stays in workqueue before being requested
# TYPE workqueue_queue_duration_seconds histogram
workqueue_queue_duration_seconds_bucket{name="backup",le="1e-08"} 0
workqueue_queue_duration_seconds_bucket{name="backup",le="1e-07"} 0
workqueue_queue_duration_seconds_bucket{name="backup",le="1e-06"} 0
workqueue_queue_duration_seconds_bucket{name="backup",le="9.999999999999999e-06"} 0
workqueue_queue_duration_seconds_bucket{name="backup",le="9.999999999999999e-05"} 0
workqueue_queue_duration_seconds_bucket{name="backup",le="0.001"} 0
workqueue_queue_duration_seconds_bucket{name="backup",le="0.01"} 0
workqueue_queue_duration_seconds_bucket{name="backup",le="0.1"} 0
workqueue_queue_duration_seconds_bucket{name="backup",le="1"} 0
workqueue_queue_duration_seconds_bucket{name="backup",le="10"} 0
workqueue_queue_duration_seconds_bucket{name="backup",le="+Inf"} 0
workqueue_queue_duration_seconds_sum{name="backup"} 0
workqueue_queue_duration_seconds_count{name="backup"} 0
workqueue_queue_duration_seconds_bucket{name="backupSchedule",le="1e-08"} 0
workqueue_queue_duration_seconds_bucket{name="backupSchedule",le="1e-07"} 0
workqueue_queue_duration_seconds_bucket{name="backupSchedule",le="1e-06"} 0
workqueue_queue_duration_seconds_bucket{name="backupSchedule",le="9.999999999999999e-06"} 0
workqueue_queue_duration_seconds_bucket{name="backupSchedule",le="9.999999999999999e-05"} 0
workqueue_queue_duration_seconds_bucket{name="backupSchedule",le="0.001"} 0
workqueue_queue_duration_seconds_bucket{name="backupSchedule",le="0.01"} 0
workqueue_queue_duration_seconds_bucket{name="backupSchedule",le="0.1"} 0
workqueue_queue_duration_seconds_bucket{name="backupSchedule",le="1"} 0
workqueue_queue_duration_seconds_bucket{name="backupSchedule",le="10"} 0
workqueue_queue_duration_seconds_bucket{name="backupSchedule",le="+Inf"} 0
workqueue_queue_duration_seconds_sum{name="backupSchedule"} 0
workqueue_queue_duration_seconds_count{name="backupSchedule"} 0
workqueue_queue_duration_seconds_bucket{name="dmcluster",le="1e-08"} 0
workqueue_queue_duration_seconds_bucket{name="dmcluster",le="1e-07"} 0
workqueue_queue_duration_seconds_bucket{name="dmcluster",le="1e-06"} 0
workqueue_queue_duration_seconds_bucket{name="dmcluster",le="9.999999999999999e-06"} 0
workqueue_queue_duration_seconds_bucket{name="dmcluster",le="9.999999999999999e-05"} 0
workqueue_queue_duration_seconds_bucket{name="dmcluster",le="0.001"} 0
workqueue_queue_duration_seconds_bucket{name="dmcluster",le="0.01"} 0
workqueue_queue_duration_seconds_bucket{name="dmcluster",le="0.1"} 0
workqueue_queue_duration_seconds_bucket{name="dmcluster",le="1"} 0
workqueue_queue_duration_seconds_bucket{name="dmcluster",le="10"} 0
workqueue_queue_duration_seconds_bucket{name="dmcluster",le="+Inf"} 0
workqueue_queue_duration_seconds_sum{name="dmcluster"} 0
workqueue_queue_duration_seconds_count{name="dmcluster"} 0
workqueue_queue_duration_seconds_bucket{name="restore",le="1e-08"} 0
workqueue_queue_duration_seconds_bucket{name="restore",le="1e-07"} 0
workqueue_queue_duration_seconds_bucket{name="restore",le="1e-06"} 0
workqueue_queue_duration_seconds_bucket{name="restore",le="9.999999999999999e-06"} 0
workqueue_queue_duration_seconds_bucket{name="restore",le="9.999999999999999e-05"} 0
workqueue_queue_duration_seconds_bucket{name="restore",le="0.001"} 0
workqueue_queue_duration_seconds_bucket{name="restore",le="0.01"} 0
workqueue_queue_duration_seconds_bucket{name="restore",le="0.1"} 0
workqueue_queue_duration_seconds_bucket{name="restore",le="1"} 0
workqueue_queue_duration_seconds_bucket{name="restore",le="10"} 0
workqueue_queue_duration_seconds_bucket{name="restore",le="+Inf"} 0
workqueue_queue_duration_seconds_sum{name="restore"} 0
workqueue_queue_duration_seconds_count{name="restore"} 0
workqueue_queue_duration_seconds_bucket{name="tidb-dashboard",le="1e-08"} 0
workqueue_queue_duration_seconds_bucket{name="tidb-dashboard",le="1e-07"} 0
workqueue_queue_duration_seconds_bucket{name="tidb-dashboard",le="1e-06"} 0
workqueue_queue_duration_seconds_bucket{name="tidb-dashboard",le="9.999999999999999e-06"} 0
workqueue_queue_duration_seconds_bucket{name="tidb-dashboard",le="9.999999999999999e-05"} 0
workqueue_queue_duration_seconds_bucket{name="tidb-dashboard",le="0.001"} 0
workqueue_queue_duration_seconds_bucket{name="tidb-dashboard",le="0.01"} 0
workqueue_queue_duration_seconds_bucket{name="tidb-dashboard",le="0.1"} 0
workqueue_queue_duration_seconds_bucket{name="tidb-dashboard",le="1"} 0
workqueue_queue_duration_seconds_bucket{name="tidb-dashboard",le="10"} 0
workqueue_queue_duration_seconds_bucket{name="tidb-dashboard",le="+Inf"} 0
workqueue_queue_duration_seconds_sum{name="tidb-dashboard"} 0
workqueue_queue_duration_seconds_count{name="tidb-dashboard"} 0
workqueue_queue_duration_seconds_bucket{name="tidb-ng-monitoring",le="1e-08"} 0
workqueue_queue_duration_seconds_bucket{name="tidb-ng-monitoring",le="1e-07"} 0
workqueue_queue_duration_seconds_bucket{name="tidb-ng-monitoring",le="1e-06"} 0
workqueue_queue_duration_seconds_bucket{name="tidb-ng-monitoring",le="9.999999999999999e-06"} 0
workqueue_queue_duration_seconds_bucket{name="tidb-ng-monitoring",le="9.999999999999999e-05"} 0
workqueue_queue_duration_seconds_bucket{name="tidb-ng-monitoring",le="0.001"} 0
workqueue_queue_duration_seconds_bucket{name="tidb-ng-monitoring",le="0.01"} 0
workqueue_queue_duration_seconds_bucket{name="tidb-ng-monitoring",le="0.1"} 0
workqueue_queue_duration_seconds_bucket{name="tidb-ng-monitoring",le="1"} 0
workqueue_queue_duration_seconds_bucket{name="tidb-ng-monitoring",le="10"} 0
workqueue_queue_duration_seconds_bucket{name="tidb-ng-monitoring",le="+Inf"} 0
workqueue_queue_duration_seconds_sum{name="tidb-ng-monitoring"} 0
workqueue_queue_duration_seconds_count{name="tidb-ng-monitoring"} 0
workqueue_queue_duration_seconds_bucket{name="tidbcluster",le="1e-08"} 0
workqueue_queue_duration_seconds_bucket{name="tidbcluster",le="1e-07"} 0
workqueue_queue_duration_seconds_bucket{name="tidbcluster",le="1e-06"} 0
workqueue_queue_duration_seconds_bucket{name="tidbcluster",le="9.999999999999999e-06"} 0
workqueue_queue_duration_seconds_bucket{name="tidbcluster",le="9.999999999999999e-05"} 0
workqueue_queue_duration_seconds_bucket{name="tidbcluster",le="0.001"} 0
workqueue_queue_duration_seconds_bucket{name="tidbcluster",le="0.01"} 0
workqueue_queue_duration_seconds_bucket{name="tidbcluster",le="0.1"} 0
workqueue_queue_duration_seconds_bucket{name="tidbcluster",le="1"} 0
workqueue_queue_duration_seconds_bucket{name="tidbcluster",le="10"} 0
workqueue_queue_duration_seconds_bucket{name="tidbcluster",le="+Inf"} 0
workqueue_queue_duration_seconds_sum{name="tidbcluster"} 0
workqueue_queue_duration_seconds_count{name="tidbcluster"} 0
workqueue_queue_duration_seconds_bucket{name="tidbcluster pods",le="1e-08"} 0
workqueue_queue_duration_seconds_bucket{name="tidbcluster pods",le="1e-07"} 0
workqueue_queue_duration_seconds_bucket{name="tidbcluster pods",le="1e-06"} 0
workqueue_queue_duration_seconds_bucket{name="tidbcluster pods",le="9.999999999999999e-06"} 0
workqueue_queue_duration_seconds_bucket{name="tidbcluster pods",le="9.999999999999999e-05"} 0
workqueue_queue_duration_seconds_bucket{name="tidbcluster pods",le="0.001"} 0
workqueue_queue_duration_seconds_bucket{name="tidbcluster pods",le="0.01"} 0
workqueue_queue_duration_seconds_bucket{name="tidbcluster pods",le="0.1"} 0
workqueue_queue_duration_seconds_bucket{name="tidbcluster pods",le="1"} 38
workqueue_queue_duration_seconds_bucket{name="tidbcluster pods",le="10"} 38
workqueue_queue_duration_seconds_bucket{name="tidbcluster pods",le="+Inf"} 38
workqueue_queue_duration_seconds_sum{name="tidbcluster pods"} 14.521632903000002
workqueue_queue_duration_seconds_count{name="tidbcluster pods"} 38
workqueue_queue_duration_seconds_bucket{name="tidbinitializer",le="1e-08"} 0
workqueue_queue_duration_seconds_bucket{name="tidbinitializer",le="1e-07"} 0
workqueue_queue_duration_seconds_bucket{name="tidbinitializer",le="1e-06"} 0
workqueue_queue_duration_seconds_bucket{name="tidbinitializer",le="9.999999999999999e-06"} 0
workqueue_queue_duration_seconds_bucket{name="tidbinitializer",le="9.999999999999999e-05"} 0
workqueue_queue_duration_seconds_bucket{name="tidbinitializer",le="0.001"} 0
workqueue_queue_duration_seconds_bucket{name="tidbinitializer",le="0.01"} 0
workqueue_queue_duration_seconds_bucket{name="tidbinitializer",le="0.1"} 0
workqueue_queue_duration_seconds_bucket{name="tidbinitializer",le="1"} 0
workqueue_queue_duration_seconds_bucket{name="tidbinitializer",le="10"} 0
workqueue_queue_duration_seconds_bucket{name="tidbinitializer",le="+Inf"} 0
workqueue_queue_duration_seconds_sum{name="tidbinitializer"} 0
workqueue_queue_duration_seconds_count{name="tidbinitializer"} 0
workqueue_queue_duration_seconds_bucket{name="tidbmonitor",le="1e-08"} 0
workqueue_queue_duration_seconds_bucket{name="tidbmonitor",le="1e-07"} 0
workqueue_queue_duration_seconds_bucket{name="tidbmonitor",le="1e-06"} 0
workqueue_queue_duration_seconds_bucket{name="tidbmonitor",le="9.999999999999999e-06"} 0
workqueue_queue_duration_seconds_bucket{name="tidbmonitor",le="9.999999999999999e-05"} 0
workqueue_queue_duration_seconds_bucket{name="tidbmonitor",le="0.001"} 0
workqueue_queue_duration_seconds_bucket{name="tidbmonitor",le="0.01"} 0
workqueue_queue_duration_seconds_bucket{name="tidbmonitor",le="0.1"} 0
workqueue_queue_duration_seconds_bucket{name="tidbmonitor",le="1"} 0
workqueue_queue_duration_seconds_bucket{name="tidbmonitor",le="10"} 0
workqueue_queue_duration_seconds_bucket{name="tidbmonitor",le="+Inf"} 0
workqueue_queue_duration_seconds_sum{name="tidbmonitor"} 0
workqueue_queue_duration_seconds_count{name="tidbmonitor"} 0
# HELP workqueue_retries_total Total number of retries handled by workqueue
# TYPE workqueue_retries_total counter
workqueue_retries_total{name="backup"} 0
workqueue_retries_total{name="backupSchedule"} 0
workqueue_retries_total{name="dmcluster"} 0
workqueue_retries_total{name="restore"} 0
workqueue_retries_total{name="tidb-dashboard"} 0
workqueue_retries_total{name="tidb-ng-monitoring"} 0
workqueue_retries_total{name="tidbcluster"} 0
workqueue_retries_total{name="tidbcluster pods"} 0
workqueue_retries_total{name="tidbinitializer"} 0
workqueue_retries_total{name="tidbmonitor"} 0
# HELP workqueue_unfinished_work_seconds How many seconds of work has been done that is in progress and hasn't been observed by work_duration. Large values indicate stuck threads. One can deduce the number of stuck threads by observing the rate at which this increases.
# TYPE workqueue_unfinished_work_seconds gauge
workqueue_unfinished_work_seconds{name="backup"} 0
workqueue_unfinished_work_seconds{name="backupSchedule"} 0
workqueue_unfinished_work_seconds{name="dmcluster"} 0
workqueue_unfinished_work_seconds{name="restore"} 0
workqueue_unfinished_work_seconds{name="tidb-dashboard"} 0
workqueue_unfinished_work_seconds{name="tidb-ng-monitoring"} 0
workqueue_unfinished_work_seconds{name="tidbcluster"} 0
workqueue_unfinished_work_seconds{name="tidbcluster pods"} 0
workqueue_unfinished_work_seconds{name="tidbinitializer"} 0
workqueue_unfinished_work_seconds{name="tidbmonitor"} 0
# HELP workqueue_work_duration_seconds How long in seconds processing an item from workqueue takes.
# TYPE workqueue_work_duration_seconds histogram
workqueue_work_duration_seconds_bucket{name="backup",le="1e-08"} 0
workqueue_work_duration_seconds_bucket{name="backup",le="1e-07"} 0
workqueue_work_duration_seconds_bucket{name="backup",le="1e-06"} 0
workqueue_work_duration_seconds_bucket{name="backup",le="9.999999999999999e-06"} 0
workqueue_work_duration_seconds_bucket{name="backup",le="9.999999999999999e-05"} 0
workqueue_work_duration_seconds_bucket{name="backup",le="0.001"} 0
workqueue_work_duration_seconds_bucket{name="backup",le="0.01"} 0
workqueue_work_duration_seconds_bucket{name="backup",le="0.1"} 0
workqueue_work_duration_seconds_bucket{name="backup",le="1"} 0
workqueue_work_duration_seconds_bucket{name="backup",le="10"} 0
workqueue_work_duration_seconds_bucket{name="backup",le="+Inf"} 0
workqueue_work_duration_seconds_sum{name="backup"} 0
workqueue_work_duration_seconds_count{name="backup"} 0
workqueue_work_duration_seconds_bucket{name="backupSchedule",le="1e-08"} 0
workqueue_work_duration_seconds_bucket{name="backupSchedule",le="1e-07"} 0
workqueue_work_duration_seconds_bucket{name="backupSchedule",le="1e-06"} 0
workqueue_work_duration_seconds_bucket{name="backupSchedule",le="9.999999999999999e-06"} 0
workqueue_work_duration_seconds_bucket{name="backupSchedule",le="9.999999999999999e-05"} 0
workqueue_work_duration_seconds_bucket{name="backupSchedule",le="0.001"} 0
workqueue_work_duration_seconds_bucket{name="backupSchedule",le="0.01"} 0
workqueue_work_duration_seconds_bucket{name="backupSchedule",le="0.1"} 0
workqueue_work_duration_seconds_bucket{name="backupSchedule",le="1"} 0
workqueue_work_duration_seconds_bucket{name="backupSchedule",le="10"} 0
workqueue_work_duration_seconds_bucket{name="backupSchedule",le="+Inf"} 0
workqueue_work_duration_seconds_sum{name="backupSchedule"} 0
workqueue_work_duration_seconds_count{name="backupSchedule"} 0
workqueue_work_duration_seconds_bucket{name="dmcluster",le="1e-08"} 0
workqueue_work_duration_seconds_bucket{name="dmcluster",le="1e-07"} 0
workqueue_work_duration_seconds_bucket{name="dmcluster",le="1e-06"} 0
workqueue_work_duration_seconds_bucket{name="dmcluster",le="9.999999999999999e-06"} 0
workqueue_work_duration_seconds_bucket{name="dmcluster",le="9.999999999999999e-05"} 0
workqueue_work_duration_seconds_bucket{name="dmcluster",le="0.001"} 0
workqueue_work_duration_seconds_bucket{name="dmcluster",le="0.01"} 0
workqueue_work_duration_seconds_bucket{name="dmcluster",le="0.1"} 0
workqueue_work_duration_seconds_bucket{name="dmcluster",le="1"} 0
workqueue_work_duration_seconds_bucket{name="dmcluster",le="10"} 0
workqueue_work_duration_seconds_bucket{name="dmcluster",le="+Inf"} 0
workqueue_work_duration_seconds_sum{name="dmcluster"} 0
workqueue_work_duration_seconds_count{name="dmcluster"} 0
workqueue_work_duration_seconds_bucket{name="restore",le="1e-08"} 0
workqueue_work_duration_seconds_bucket{name="restore",le="1e-07"} 0
workqueue_work_duration_seconds_bucket{name="restore",le="1e-06"} 0
workqueue_work_duration_seconds_bucket{name="restore",le="9.999999999999999e-06"} 0
workqueue_work_duration_seconds_bucket{name="restore",le="9.999999999999999e-05"} 0
workqueue_work_duration_seconds_bucket{name="restore",le="0.001"} 0
workqueue_work_duration_seconds_bucket{name="restore",le="0.01"} 0
workqueue_work_duration_seconds_bucket{name="restore",le="0.1"} 0
workqueue_work_duration_seconds_bucket{name="restore",le="1"} 0
workqueue_work_duration_seconds_bucket{name="restore",le="10"} 0
workqueue_work_duration_seconds_bucket{name="restore",le="+Inf"} 0
workqueue_work_duration_seconds_sum{name="restore"} 0
workqueue_work_duration_seconds_count{name="restore"} 0
workqueue_work_duration_seconds_bucket{name="tidb-dashboard",le="1e-08"} 0
workqueue_work_duration_seconds_bucket{name="tidb-dashboard",le="1e-07"} 0
workqueue_work_duration_seconds_bucket{name="tidb-dashboard",le="1e-06"} 0
workqueue_work_duration_seconds_bucket{name="tidb-dashboard",le="9.999999999999999e-06"} 0
workqueue_work_duration_seconds_bucket{name="tidb-dashboard",le="9.999999999999999e-05"} 0
workqueue_work_duration_seconds_bucket{name="tidb-dashboard",le="0.001"} 0
workqueue_work_duration_seconds_bucket{name="tidb-dashboard",le="0.01"} 0
workqueue_work_duration_seconds_bucket{name="tidb-dashboard",le="0.1"} 0
workqueue_work_duration_seconds_bucket{name="tidb-dashboard",le="1"} 0
workqueue_work_duration_seconds_bucket{name="tidb-dashboard",le="10"} 0
workqueue_work_duration_seconds_bucket{name="tidb-dashboard",le="+Inf"} 0
workqueue_work_duration_seconds_sum{name="tidb-dashboard"} 0
workqueue_work_duration_seconds_count{name="tidb-dashboard"} 0
workqueue_work_duration_seconds_bucket{name="tidb-ng-monitoring",le="1e-08"} 0
workqueue_work_duration_seconds_bucket{name="tidb-ng-monitoring",le="1e-07"} 0
workqueue_work_duration_seconds_bucket{name="tidb-ng-monitoring",le="1e-06"} 0
workqueue_work_duration_seconds_bucket{name="tidb-ng-monitoring",le="9.999999999999999e-06"} 0
workqueue_work_duration_seconds_bucket{name="tidb-ng-monitoring",le="9.999999999999999e-05"} 0
workqueue_work_duration_seconds_bucket{name="tidb-ng-monitoring",le="0.001"} 0
workqueue_work_duration_seconds_bucket{name="tidb-ng-monitoring",le="0.01"} 0
workqueue_work_duration_seconds_bucket{name="tidb-ng-monitoring",le="0.1"} 0
workqueue_work_duration_seconds_bucket{name="tidb-ng-monitoring",le="1"} 0
workqueue_work_duration_seconds_bucket{name="tidb-ng-monitoring",le="10"} 0
workqueue_work_duration_seconds_bucket{name="tidb-ng-monitoring",le="+Inf"} 0
workqueue_work_duration_seconds_sum{name="tidb-ng-monitoring"} 0
workqueue_work_duration_seconds_count{name="tidb-ng-monitoring"} 0
workqueue_work_duration_seconds_bucket{name="tidbcluster",le="1e-08"} 0
workqueue_work_duration_seconds_bucket{name="tidbcluster",le="1e-07"} 0
workqueue_work_duration_seconds_bucket{name="tidbcluster",le="1e-06"} 0
workqueue_work_duration_seconds_bucket{name="tidbcluster",le="9.999999999999999e-06"} 0
workqueue_work_duration_seconds_bucket{name="tidbcluster",le="9.999999999999999e-05"} 0
workqueue_work_duration_seconds_bucket{name="tidbcluster",le="0.001"} 0
workqueue_work_duration_seconds_bucket{name="tidbcluster",le="0.01"} 0
workqueue_work_duration_seconds_bucket{name="tidbcluster",le="0.1"} 0
workqueue_work_duration_seconds_bucket{name="tidbcluster",le="1"} 0
workqueue_work_duration_seconds_bucket{name="tidbcluster",le="10"} 0
workqueue_work_duration_seconds_bucket{name="tidbcluster",le="+Inf"} 0
workqueue_work_duration_seconds_sum{name="tidbcluster"} 0
workqueue_work_duration_seconds_count{name="tidbcluster"} 0
workqueue_work_duration_seconds_bucket{name="tidbcluster pods",le="1e-08"} 0
workqueue_work_duration_seconds_bucket{name="tidbcluster pods",le="1e-07"} 0
workqueue_work_duration_seconds_bucket{name="tidbcluster pods",le="1e-06"} 0
workqueue_work_duration_seconds_bucket{name="tidbcluster pods",le="9.999999999999999e-06"} 0
workqueue_work_duration_seconds_bucket{name="tidbcluster pods",le="9.999999999999999e-05"} 36
workqueue_work_duration_seconds_bucket{name="tidbcluster pods",le="0.001"} 38
workqueue_work_duration_seconds_bucket{name="tidbcluster pods",le="0.01"} 38
workqueue_work_duration_seconds_bucket{name="tidbcluster pods",le="0.1"} 38
workqueue_work_duration_seconds_bucket{name="tidbcluster pods",le="1"} 38
workqueue_work_duration_seconds_bucket{name="tidbcluster pods",le="10"} 38
workqueue_work_duration_seconds_bucket{name="tidbcluster pods",le="+Inf"} 38
workqueue_work_duration_seconds_sum{name="tidbcluster pods"} 0.0012629189999999997
workqueue_work_duration_seconds_count{name="tidbcluster pods"} 38
workqueue_work_duration_seconds_bucket{name="tidbinitializer",le="1e-08"} 0
workqueue_work_duration_seconds_bucket{name="tidbinitializer",le="1e-07"} 0
workqueue_work_duration_seconds_bucket{name="tidbinitializer",le="1e-06"} 0
workqueue_work_duration_seconds_bucket{name="tidbinitializer",le="9.999999999999999e-06"} 0
workqueue_work_duration_seconds_bucket{name="tidbinitializer",le="9.999999999999999e-05"} 0
workqueue_work_duration_seconds_bucket{name="tidbinitializer",le="0.001"} 0
workqueue_work_duration_seconds_bucket{name="tidbinitializer",le="0.01"} 0
workqueue_work_duration_seconds_bucket{name="tidbinitializer",le="0.1"} 0
workqueue_work_duration_seconds_bucket{name="tidbinitializer",le="1"} 0
workqueue_work_duration_seconds_bucket{name="tidbinitializer",le="10"} 0
workqueue_work_duration_seconds_bucket{name="tidbinitializer",le="+Inf"} 0
workqueue_work_duration_seconds_sum{name="tidbinitializer"} 0
workqueue_work_duration_seconds_count{name="tidbinitializer"} 0
workqueue_work_duration_seconds_bucket{name="tidbmonitor",le="1e-08"} 0
workqueue_work_duration_seconds_bucket{name="tidbmonitor",le="1e-07"} 0
workqueue_work_duration_seconds_bucket{name="tidbmonitor",le="1e-06"} 0
workqueue_work_duration_seconds_bucket{name="tidbmonitor",le="9.999999999999999e-06"} 0
workqueue_work_duration_seconds_bucket{name="tidbmonitor",le="9.999999999999999e-05"} 0
workqueue_work_duration_seconds_bucket{name="tidbmonitor",le="0.001"} 0
workqueue_work_duration_seconds_bucket{name="tidbmonitor",le="0.01"} 0
workqueue_work_duration_seconds_bucket{name="tidbmonitor",le="0.1"} 0
workqueue_work_duration_seconds_bucket{name="tidbmonitor",le="1"} 0
workqueue_work_duration_seconds_bucket{name="tidbmonitor",le="10"} 0
workqueue_work_duration_seconds_bucket{name="tidbmonitor",le="+Inf"} 0
workqueue_work_duration_seconds_sum{name="tidbmonitor"} 0
workqueue_work_duration_seconds_count{name="tidbmonitor"} 0
from tidb-operator.
Related Issues (20)
- ebs br: support supress option for scheduled volume backup HOT 1
- br: support backup manifest
- Backup spec does not have nodeSelector field
- volumeback failed. reason is "Pod backup-fed-ebs-tidb-operator-ebs-1-init-w5glk has failed, original reason " HOT 1
- ebs br: VolumeBackup failed due to resuming GC and scheduling
- 7.1.1 Upgrade to version 7.4.0 upgrade failure HOT 1
- Release v1.5.1
- Doesn't work on K8s version 1.27 due to out of date KubeSchedulerConfiguration HOT 2
- ArgoCD sync loops caused by tikv config rewrite HOT 4
- ebs br: volumerestore status is not accurate
- ebs br: volumebackup failed calculating snapshot size HOT 1
- tikv start with error: connect to pd failed, but check network is ok. HOT 2
- Tidb running in kubernetes cluster with non-default domain does not start with TLS enabled between tidb component HOT 14
- How does the tidb-operator deploy a pd cluster? HOT 3
- ebs br: list backup/restore elapsed time of each data plane in the control plane's CR HOT 1
- ebs br: remove the cluster name from the name of scheduled backup pod
- ebs br: quickly timeout the ebs br operation
- ebs br: use minimum warmup to speed up the restore RTO
- ebs br: volume back schedule fail if the backup schedule is activated after being paused for a long time
- Support FIPS build
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from tidb-operator.