blumeops/docs/how-to
Erich Blume 6d65e6928c C2: Deploy infrastructure alerting pipeline (#303)
## Summary

Mikado chain to replace `mise run services-check` with Grafana Unified Alerting backed by ntfy push notifications.

**Design:**
- Grafana Unified Alerting evaluates rules against Prometheus/Loki
- ntfy webhook contact point delivers iOS notifications
- Anti-noise policy: page once per 24h per alert group
- Every alert links to a runbook in `docs/how-to/alerts/`
- services-check eventually queries the alerting API instead of doing its own probes

**Chain (bottom-up):**
1. `configure-grafana-alerting-pipeline` — enable alerting, ntfy contact point, notification policy
2. `first-alert-and-runbook` — end-to-end proof of concept with blackbox probe failure
3. `port-services-check-alerts` — migrate all services-check probes to alert rules + runbooks
4. `refactor-services-check-to-query-alerts` — rewrite services-check to query Grafana API
5. `deploy-infra-alerting` — goal card

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Reviewed-on: #303
2026-03-22 14:52:56 -07:00
..
authentik Restructure docs: consolidate, recategorize, and extract 2026-03-15 19:55:59 -07:00
configuration Restructure docs: consolidate, recategorize, and extract 2026-03-15 19:55:59 -07:00
dagger Add how-to guide for upgrading Dagger 2026-03-06 20:31:30 -08:00
deployment Restructure docs: consolidate, recategorize, and extract 2026-03-15 19:55:59 -07:00
forgejo-runner Remove mikado frontmatter from closed chains, clarify finalization rules 2026-03-04 20:43:19 -08:00
grafana Restructure docs: consolidate, recategorize, and extract 2026-03-15 19:55:59 -07:00
jobsync Review deploy-jobsync doc: add missing env var, update tag example 2026-03-13 15:45:07 -07:00
knowledgebase Review build-jobsync-container, refine docs-preview tooling 2026-03-11 18:11:34 -07:00
mealie Fix plan-a-meal random recipe API queries 2026-03-17 11:10:48 -07:00
operations Review operations docs: add last-reviewed dates and improve troubleshooting 2026-03-16 07:38:02 -07:00
ringtail Update ringtail flake inputs, add flake-update pipeline (#240) 2026-02-22 08:17:52 -08:00
runbooks C2: Deploy infrastructure alerting pipeline (#303) 2026-03-22 14:52:56 -07:00
zot Remove mikado frontmatter from closed chains, clarify finalization rules 2026-03-04 20:43:19 -08:00