Skip to content

Commit 9016850

Browse files
add ceph pool full warning alert
add ceph pool full warning alert
1 parent cff66dc commit 9016850

1 file changed

Lines changed: 13 additions & 0 deletions

File tree

charts/ceph-operations/alerts/pools.yaml

Lines changed: 13 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -45,4 +45,17 @@ groups:
4545
A pool has exceeded the warning (percent full) threshold, or OSDs supporting the pool have reached the NEARFULL threshold. Writes may continue, but you are at risk of the pool going read-only if more capacity isn't made available. Determine the affected pool with `ceph df detail`, looking at QUOTA BYTES and STORED. Increase the pool's quota, or add capacity to the cluster first then increase the pool's quota (e.g. `ceph osd pool set quota <pool_name> max_bytes <bytes>`). Also ensure that the balancer is active.
4646
summary: "One or more Ceph pools are nearly full"
4747
{{- end }}
48+
49+
{{- if not (.Values.prometheusRules.disabled.CephPoolGrowthWarning | default false) }}
50+
- alert: "CephPoolGrowthWarning"
51+
expr: "(predict_linear(ceph_pool_percent_used[2d], 3600 * 24 * 5) * on(pool_id, instance, pod) group_right() ceph_pool_metadata) >= 95"
52+
for: 5m
53+
labels:
54+
oid: "1.3.6.1.4.1.50495.1.2.1.9.2"
55+
severity: "warning"
56+
type: "ceph_default"
57+
annotations:
58+
description: "Pool '{{ $labels.name }}' will be full in less than 5 days assuming the average fill-up rate of the past 48 hours."
59+
summary: "Pool growth rate may soon exceed capacity"
60+
{{- end }}
4861
{{- end }}

0 commit comments

Comments
 (0)