Admin console improvements

[lucaspar]

Merged as #326

• Admin console
  • Added a service health overview to the home console, if possible
  • Fixed 500 errors when searching things
  • More useful columns in admin console tables
  • Health dashboard and system overview as admin home
  • Safeguards to prevent operators from being locked out in case the dashboard fails to render
• Observability
  • Production config preserves logs in a Docker volume

---

Note

Medium Risk
Touches production compose and logging plus admin index monkey-patching and heavier dashboard queries on every admin home load; failures are mitigated by fallback context but deploy still needs the new volume and writable /app/logs.

Overview
Replaces the default Django admin index with a Gateway Dashboard that surfaces file/capture/dataset/user counts, soft-delete cleanup candidates, recent signups, staff listings, top storage users, and system health from SystemHealthSnapshot. Dashboard data is assembled in sds_gateway/admin.py (monkey-patched admin.site.index) with a DB-error fallback so a failed query does not block admin access.

Admin changelists across api_methods, users, and visualizations gain richer columns (counts, formatted sizes, owner emails) and queryset tuning (select_related / annotate). Search is adjusted to use valid relations (e.g. owner__email, sum_blake3 on File) to avoid admin search 500s.

Production observability: compose.production.yaml adds a shared sds-gateway-prod-app-logs volume at /app/logs for app and Celery services; production.py creates that path and writes rotating logs to /app/logs/gateway.log alongside console output.

Minor: static_cache_busting caches version.json at startup; missing version file logs at debug in dev.

^{Reviewed by Cursor Bugbot for commit 5842ebb. Configure here.}

[cursor]

Cursor Bugbot has reviewed your changes using high effort and found 4 potential issues.

^{❌ Bugbot Autofix is OFF. To automatically fix reported issues with cloud agents, enable autofix in the Cursor dashboard.}

Want reviews to match your repository better? Bugbot Learning can learn team-specific rules from PR activity. A team admin can enable Learning in the Cursor dashboard.

^{Reviewed by Cursor Bugbot for commit 5842ebb. Configure here.}