eblume/blumeops
1
1
Fork 0
Code Issues Pull requests Projects Releases 83 Packages Wiki Activity Actions
blumeops/docs/reference/operations
History
Erich Blume 549c57ab82 C2(deploy-infra-alerting): impl add first alert rule and runbook 
- Add ServiceProbeFailure alert rule to Grafana alerting provisioning
  - Queries probe_success metric from Alloy blackbox exporter
  - Extracts service name from job label via label_replace
  - Fires after 2 minutes of failure, noDataState=Alerting
  - Annotations include summary with service name and runbook URL
- Add runbook at docs/how-to/alerts/runbook-service-probe-failure.md
  - Covers all 5 probed services (miniflux, kiwix, transmission, devpi, argocd)
  - Diagnostic steps, common causes, silencing instructions
- Add alerting section to observability.md reference doc

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-22 10:57:23 -07:00
..
backup.md Fix frontmatter field name for Quartz date display (#158) 2026-02-11 16:45:12 -08:00
disaster-recovery.md Fix frontmatter field name for Quartz date display (#158) 2026-02-11 16:45:12 -08:00
observability.md C2(deploy-infra-alerting): impl add first alert rule and runbook 2026-03-22 10:57:23 -07:00