Kubernetes

LLMs on homelab Kubernetes: llm-d, vLLM, HAMi and Kaito

GPU sharing, vLLM and cache-aware routing on hardware you own, and how much of the production AI inference stack you can learn at home.