Erich Blume
ce1f696bd8
Phase 2 of documentation restructuring. Creates docs/reference/ with: Services (16): - alloy, argocd, borgmatic, 1password, forgejo, grafana - jellyfin, kiwix, loki, miniflux, navidrome, postgresql - prometheus, teslamate, transmission, zot Infrastructure (3): - hosts - Device inventory - tailscale - ACLs, groups, tags - routing - DNS domains and port mappings Kubernetes (2): - cluster - Minikube specs - apps - ArgoCD application registry Storage (2): - sifaka - Synology NAS configuration - backups - Backup policy All cards use wiki-links for cross-referencing and include YAML frontmatter with title and tags for Quartz. Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
54 lines
1.2 KiB
Markdown
54 lines
1.2 KiB
Markdown
---
|
|
title: Prometheus
|
|
tags:
|
|
- service
|
|
- observability
|
|
---
|
|
|
|
# Prometheus
|
|
|
|
Metrics storage and querying for BlumeOps infrastructure.
|
|
|
|
## Quick Reference
|
|
|
|
| Property | Value |
|
|
|----------|-------|
|
|
| **URL** | https://prometheus.ops.eblu.me |
|
|
| **Tailscale URL** | https://prometheus.tail8d86e.ts.net |
|
|
| **Namespace** | `monitoring` |
|
|
| **Image** | `prom/prometheus:v3.2.1` |
|
|
| **Storage** | 50Gi PVC |
|
|
|
|
## Data Sources
|
|
|
|
### Remote Write (from Alloy)
|
|
- Indri system metrics via [[alloy\|Alloy]] remote_write
|
|
- Textfile metrics: minikube, borgmatic, zot, jellyfin
|
|
|
|
### Scrape Targets
|
|
| Target | Metrics |
|
|
|--------|---------|
|
|
| `sifaka:9100` | [[storage/sifaka\|Sifaka]] NAS (node_exporter) |
|
|
| `cnpg-metrics.tail8d86e.ts.net:9187` | [[postgresql\|CloudNativePG]] metrics |
|
|
| `kube-state-metrics.monitoring.svc:8080` | Kubernetes resource metrics |
|
|
|
|
## Query API
|
|
|
|
```bash
|
|
# Check targets
|
|
curl -s https://prometheus.ops.eblu.me/api/v1/targets | jq '.data.activeTargets[].scrapeUrl'
|
|
```
|
|
|
|
## ArgoCD Management
|
|
|
|
```bash
|
|
argocd app sync prometheus
|
|
```
|
|
|
|
Manifests: `argocd/manifests/prometheus/`
|
|
|
|
## Related
|
|
|
|
- [[alloy\|Alloy]] - Metrics collector
|
|
- [[grafana\|Grafana]] - Visualization
|
|
- [[loki\|Loki]] - Logs counterpart
|