Nir David

Community maintained hardware plugin for vLLM on Intel Gaudi

A high-throughput and memory-efficient inference and serving engine for LLMs

Easy and lightning fast training of 🤗 Transformers on Habana Gaudi processor (HPU)