Kubernetes Deployment¶

Kubernetes manifests live under k8s/ and are managed with Kustomize overlays.

Quick start¶

# Development
kubectl apply -k k8s/overlays/dev

# Staging
kubectl apply -k k8s/overlays/staging

# Production
kubectl apply -k k8s/overlays/production

See the repo’s Kubernetes guide:

k8s/README.md

E2E on KIND¶

A local + CI-friendly end-to-end script is provided:

scripts/e2e_kind.sh

It builds/loads the image into KIND, applies the k8s/overlays/e2e-kind overlay, waits for migrations + rollout, then runs a small OAuth2 smoke test.

See Testing for details.

Local observability with KIND¶

You can reuse the local observability stack (Prometheus + Grafana + Jaeger) while running the server inside a KIND cluster.

Option A (simple): Prometheus scrapes via port-forward¶

Bring up the KIND environment (see scripts/e2e_kind.sh).
In a separate terminal, port-forward the Kubernetes service:

kubectl -n oauth2-server port-forward svc/oauth2-server 18080:80

Start the observability stack with the KIND Prometheus config override:

docker compose -f docker-compose.observability.yml \
  -f docker-compose.observability.kind.yml up -d

This uses observability/prometheus/prometheus.kind.yml, which scrapes host.docker.internal:18080.

Note: host.docker.internal works out of the box on macOS/Windows. On Linux you may need a different host gateway setup.

One-command local dev (KIND + in-cluster observability)¶

If you want a single command that brings up everything (oauth2-server + Postgres + migrations + Prometheus/Grafana/Jaeger/OTEL inside KIND) and leaves the UIs available locally:

Run: make kind-observability-up

This will:

Create/recreate a KIND cluster (by default) and deploy k8s/overlays/e2e-kind-observability
Port-forward Grafana and Jaeger to random free local ports (printed in the output)

Then generate demo traffic:

Run: make kind-observability-traffic

To clean up:

Run: make kind-observability-down

Option B (recommended): run Prometheus + Grafana + Jaeger inside KIND¶

If you prefer not to run Prometheus/Grafana/Jaeger via Docker Compose, you can deploy an in-cluster observability stack.

Apply the overlay:

kubectl apply -k k8s/overlays/e2e-kind-observability

This overlay includes:

Prometheus (scrapes svc/oauth2-server directly in-cluster)
Grafana (provisioned dashboards + Prometheus datasource)
Jaeger UI
OpenTelemetry Collector

To access the UIs from your laptop:

kubectl -n oauth2-server port-forward svc/grafana 3000:3000
kubectl -n oauth2-server port-forward svc/jaeger 16686:16686

Then open:

Generating demo traffic (for dashboards/SLOs)¶

To generate synthetic traffic inside the cluster (so Prometheus/Grafana have something to show), run:

./scripts/kind_generate_traffic.sh --duration 10m

This creates a short-lived Kubernetes Job that hits POST /oauth/token (success + invalid secret) and GET /health/GET /ready.