eblume/blumeops
1
1
Fork 0
Code Issues Pull requests Projects Releases 83 Packages Wiki Activity Actions
blumeops/argocd/manifests
History
Erich Blume 31d925814f Deploy Ollama LLM server on ringtail (#277) 
## Summary
- Deploy Ollama as a new ArgoCD-managed service on ringtail's k3s cluster with GPU acceleration
- Declarative model management via `models.txt` + sidecar sync script (mirrors kiwix torrent pattern)
- Initial models: `qwen2.5:14b`, `deepseek-r1:14b`, `phi4:14b`, `gemma3:12b`
- hostPath PV on `/mnt/storage1/ollama` for fast local model storage (200Gi)
- Tailscale ingress at `ollama.ops.eblu.me` for API access from tailnet
- Enable GPU time-slicing (`replicas: 2`) on nvidia-device-plugin so Frigate and Ollama share the RTX 4080

## Deployment and Testing
- [ ] Deploy nvidia-device-plugin changes first: `argocd app sync nvidia-device-plugin`
- [ ] Verify GPU time-slicing: `kubectl describe node ringtail --context=k3s-ringtail` shows `nvidia.com/gpu: 2`
- [ ] Sync `apps` app with `--revision feature/ollama-ringtail`
- [ ] Set ollama app to branch: `argocd app set ollama --revision feature/ollama-ringtail && argocd app sync ollama`
- [ ] Verify model-sync sidecar pulls models: `kubectl logs -n ollama deploy/ollama -c model-sync --context=k3s-ringtail`
- [ ] Test API: `curl https://ollama.ops.eblu.me/api/tags`
- [ ] Test inference: `curl https://ollama.ops.eblu.me/api/generate -d '{"model":"qwen2.5:14b","prompt":"Hello"}'`
- [ ] Verify Frigate still works after GPU sharing change
- [ ] After merge: `argocd app set ollama --revision main && argocd app sync ollama`

Reviewed-on: https://forge.ops.eblu.me/eblume/blumeops/pulls/277
2026-03-02 20:39:51 -08:00
..
1password-connect Fix 1Password Connect credentials for chart 2.3.0 2026-02-13 17:30:45 -08:00
alloy-k8s Add multi-cluster observability with ringtail metrics and dashboards (#270) 2026-02-25 22:01:00 -08:00
alloy-ringtail Add multi-cluster observability with ringtail metrics and dashboards (#270) 2026-02-25 22:01:00 -08:00
argocd Add explicit ExternalSecret defaults for SSA sync parity 2026-02-26 07:02:54 -08:00
authentik Deploy authentik 2026.2.0 with migration ordering fix 2026-03-01 16:32:10 -08:00
cloudnative-pg Port CloudNative-PG off Helm to direct release manifest (#268) 2026-02-25 17:37:53 -08:00
cv Add HA for CV and Docs: zero-downtime deploys (#273) 2026-02-26 07:53:21 -08:00
databases Pin blumeops-pg to PostgreSQL 18.3 2026-02-27 16:25:32 -08:00
devpi Add kustomize images: and configMapGenerator: across services (#264) 2026-02-24 14:25:19 -08:00
docs Update docs release to v1.12.1 2026-03-02 18:17:07 -08:00
external-secrets Add External Secrets Operator with 1Password Connect (#66) (#66) 2026-01-28 19:30:10 -08:00
forgejo-runner Add kustomize images: and configMapGenerator: across services (#264) 2026-02-24 14:25:19 -08:00
frigate Sync Frigate zone coordinates from live API 2026-02-27 07:52:09 -08:00
grafana Fix Grafana ConfigMap labels lost in configMapGenerator migration 2026-02-24 14:46:20 -08:00
grafana-config Add Transmission metrics exporter and Grafana dashboard (#271) 2026-02-25 22:23:33 -08:00
homepage Update homepage, navidrome, ntfy, miniflux image tags after mirror migration 2026-02-24 21:06:08 -08:00
immich Fix mirror org refs in ArgoCD apps and widen credential template (#266) 2026-02-25 06:55:53 -08:00
kiwix Add kustomize images: and configMapGenerator: across services (#264) 2026-02-24 14:25:19 -08:00
kube-state-metrics Add kustomize images: and configMapGenerator: across services (#264) 2026-02-24 14:25:19 -08:00
kube-state-metrics-ringtail Add multi-cluster observability with ringtail metrics and dashboards (#270) 2026-02-25 22:01:00 -08:00
loki Add kustomize images: and configMapGenerator: across services (#264) 2026-02-24 14:25:19 -08:00
miniflux Update homepage, navidrome, ntfy, miniflux image tags after mirror migration 2026-02-24 21:06:08 -08:00
mosquitto Add kustomize images: and configMapGenerator: across services (#264) 2026-02-24 14:25:19 -08:00
navidrome Update homepage, navidrome, ntfy, miniflux image tags after mirror migration 2026-02-24 21:06:08 -08:00
ntfy Update homepage, navidrome, ntfy, miniflux image tags after mirror migration 2026-02-24 21:06:08 -08:00
nvidia-device-plugin Deploy Ollama LLM server on ringtail (#277) 2026-03-02 20:39:51 -08:00
ollama Deploy Ollama LLM server on ringtail (#277) 2026-03-02 20:39:51 -08:00
prometheus Add Transmission metrics exporter and Grafana dashboard (#271) 2026-02-25 22:23:33 -08:00
tailscale-operator Deploy Tailscale operator on ringtail k3s cluster (#215) 2026-02-19 09:33:05 -08:00
tailscale-operator-base Add kustomize images: and configMapGenerator: across services (#264) 2026-02-24 14:25:19 -08:00
tailscale-operator-ringtail Deploy Tailscale operator on ringtail k3s cluster (#215) 2026-02-19 09:33:05 -08:00
teslamate Update prometheus and teslamate image tags after mirror migration 2026-02-24 21:18:15 -08:00
torrent Add Transmission metrics exporter and Grafana dashboard (#271) 2026-02-25 22:23:33 -08:00