blumeops/docs/reference/services
Erich Blume 4f0476a851
All checks were successful
Build Container / detect (push) Successful in 3s
Build Container (Nix) / detect (push) Successful in 1s
Build Container (Nix) / build (quartz) (push) Successful in 1s
Build Container / build (quartz) (push) Successful in 10s
Fix spider trap: disable SPA mode, remove index files, relax wiki-links (#290)
## Summary

Fixes the Facebook crawler spider trap that's been generating infinite recursive URLs like `/how-to/tutorials/tutorials/how-to/explanation/...` for several days.

**Root cause:** Quartz SPA mode + nginx `try_files` fallback to `index.html` meant any fabricated URL returned the root HTML shell with HTTP 200. Crawlers followed relative links from those fake URLs, creating infinite recursion.

**Fix:**
- Disable Quartz SPA mode (`enableSPA: false`) — all pages are now fully static HTML
- Replace nginx SPA fallback with `=404` + Quartz's static `404.html`
- Remove `robots.txt` exclusions (no longer needed)

**Docs cleanup (Obsidian.nvim compat no longer needed):**
- Delete hand-curated category index files (`tutorials.md`, `reference.md`, `how-to.md`, `explanation.md`) — Quartz auto-generates folder pages
- Delete `postgresql-storage.md` (redirect stub) and `migrate-forgejo-from-brew.md` (stale history)
- Drop `docs-check-index` and `docs-check-filenames` prek hooks
- Rewrite `docs-check-links` to allow path-based wiki-links (`[[path/to/file]]`) and only error on true ambiguity
- Add `ai-docs` doc tree listing to replace index files for AI context
- Add natural cross-links from reference cards to fix orphan docs

## Deployment and Testing

- [ ] Merge and let the build pipeline run
- [ ] Verify docs.eblu.me serves pages correctly with full page loads
- [ ] Verify non-existent URLs return 404
- [ ] Monitor crawler traffic — should drop to near zero for fabricated URLs

Reviewed-on: #290
2026-03-09 11:59:43 -07:00
..
1password.md Fix frontmatter field name for Quartz date display (#158) 2026-02-11 16:45:12 -08:00
alloy.md Fix frontmatter field name for Quartz date display (#158) 2026-02-11 16:45:12 -08:00
argocd.md Add reference/tools/ category with Dagger, ArgoCD CLI, Ansible, and Pulumi cards (#178) 2026-02-12 19:18:46 -08:00
authentik.md Fix spider trap: disable SPA mode, remove index files, relax wiki-links (#290) 2026-03-09 11:59:43 -07:00
automounter.md Fix frontmatter field name for Quartz date display (#158) 2026-02-11 16:45:12 -08:00
borgmatic.md Fix frontmatter field name for Quartz date display (#158) 2026-02-11 16:45:12 -08:00
caddy.md Add CV service reference card and docs updates (#171) 2026-02-12 11:45:32 -08:00
cv.md Add CV service reference card and docs updates (#171) 2026-02-12 11:45:32 -08:00
devpi.md Fix frontmatter field name for Quartz date display (#158) 2026-02-11 16:45:12 -08:00
docs.md Fix frontmatter field name for Quartz date display (#158) 2026-02-11 16:45:12 -08:00
flyio-proxy.md Add spider-trap guards to docs.eblu.me Quartz nginx config 2026-03-06 09:43:41 -08:00
forgejo.md Fix spider trap: disable SPA mode, remove index files, relax wiki-links (#290) 2026-03-09 11:59:43 -07:00
frigate.md Retire plans directory, convert migrate-forgejo-from-brew to mikado card 2026-03-04 20:28:14 -08:00
grafana.md Fix spider trap: disable SPA mode, remove index files, relax wiki-links (#290) 2026-03-09 11:59:43 -07:00
immich.md Fix frontmatter field name for Quartz date display (#158) 2026-02-11 16:45:12 -08:00
jellyfin.md Fix frontmatter field name for Quartz date display (#158) 2026-02-11 16:45:12 -08:00
jobsync.md Add JobSync reference card, observability docs, and RAPIDAPI_KEY plumbing (#289) 2026-03-08 15:06:52 -07:00
kiwix.md Bump kiwix-serve from 3.8.1 to 3.8.2 2026-03-05 08:12:32 -08:00
loki.md Fix frontmatter field name for Quartz date display (#158) 2026-02-11 16:45:12 -08:00
miniflux.md Fix frontmatter field name for Quartz date display (#158) 2026-02-11 16:45:12 -08:00
navidrome.md No navidrome authentikation 2026-02-21 20:33:48 -08:00
ntfy.md Review ntfy: upgrade to v2.17.0 and add reference docs (#201) 2026-02-17 09:51:40 -08:00
ollama.md Add Ollama reference card and update indexes 2026-03-04 19:43:14 -08:00
postgresql.md Doc review: connect-to-postgres, create-release-artifact-workflow, deploy-k8s-service (#191) 2026-02-15 07:42:01 -08:00
prometheus.md Fix frontmatter field name for Quartz date display (#158) 2026-02-11 16:45:12 -08:00
tempo.md Add OpenTelemetry distributed tracing (Tempo + Beyla eBPF) (#286) 2026-03-05 10:51:07 -08:00
teslamate.md Fix frontmatter field name for Quartz date display (#158) 2026-02-11 16:45:12 -08:00
transmission.md Upgrade Transmission to 4.1.1 (#282) 2026-03-04 07:44:33 -08:00
zot.md Fix spider trap: disable SPA mode, remove index files, relax wiki-links (#290) 2026-03-09 11:59:43 -07:00