Rules that will bite you
Five things that are not obvious and have each cost someone time.
- Public hostnames, never internal DNS. From a workspace,
https://litellm.k8s.semanticscience.org— notlitellm.litellm-prod.svc.cluster.local. Internal names are blocked by policy. It looks like the service is down; it is not.
- GPU workspaces: keep
cpu≤ 6. g1 has 32 cores for three cards, and every VM costs one more. The template does not enforce this yet; the scheduler does, by leaving an oversized request Pending with no message. If a GPU workspace will not start, lowercpufirst; if it still will not, it is waiting on a *card* — check who holds the three.
- Stop GPU workspaces you are not using. Running holds the card, idle or not.
/mntis ephemeral. Only/home/codersurvives a rebuild.
- No scale-to-zero on models. A served model occupies its hardware until removed. New models are swaps.
Two smaller ones:
- The
modelfield is the gateway name.gemma4-g1, not the HF repo. - Prefix nomic inputs with
search_query:/search_document:.