Marcin Swiniarski

Community maintained hardware plugin for vLLM on Intel Gaudi

A high-throughput and memory-efficient inference and serving engine for LLMs

Large Language Model Text Generation Inference on Habana Gaudi