eblume/blumeops
1
1
Fork 0
Code Issues Pull requests Projects Releases 83 Packages Wiki Activity Actions
blumeops/docs/how-to/alerts
History
Erich Blume 549c57ab82 C2(deploy-infra-alerting): impl add first alert rule and runbook 
- Add ServiceProbeFailure alert rule to Grafana alerting provisioning
  - Queries probe_success metric from Alloy blackbox exporter
  - Extracts service name from job label via label_replace
  - Fires after 2 minutes of failure, noDataState=Alerting
  - Annotations include summary with service name and runbook URL
- Add runbook at docs/how-to/alerts/runbook-service-probe-failure.md
  - Covers all 5 probed services (miniflux, kiwix, transmission, devpi, argocd)
  - Diagnostic steps, common causes, silencing instructions
- Add alerting section to observability.md reference doc

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-22 10:57:23 -07:00
..
configure-grafana-alerting-pipeline.md C2(deploy-infra-alerting): close configure-grafana-alerting-pipeline 2026-03-22 10:51:02 -07:00
deploy-infra-alerting.md C2(deploy-infra-alerting): plan add alerting pipeline cards 2026-03-22 10:28:31 -07:00
first-alert-and-runbook.md C2(deploy-infra-alerting): plan add alerting pipeline cards 2026-03-22 10:28:31 -07:00
port-services-check-alerts.md C2(deploy-infra-alerting): plan add alerting pipeline cards 2026-03-22 10:28:31 -07:00
refactor-services-check-to-query-alerts.md C2(deploy-infra-alerting): plan add alerting pipeline cards 2026-03-22 10:28:31 -07:00
runbook-service-probe-failure.md C2(deploy-infra-alerting): impl add first alert rule and runbook 2026-03-22 10:57:23 -07:00