guymguym/llm-d

llm-d is a Kubernetes-native high-performance distributed LLM inference framework