Top Repositories
Repositories
122No description provided.
No description provided.
No description provided.
A high-throughput and memory-efficient inference and serving engine for LLMs
A safetensors extension to efficiently store sparse quantized tensors on disk
llm-d enables high-performance distributed LLM inference on Kubernetes
A tiny Python library and CLI for managing sailing marks and courses.
This repo hosts code for vLLM CI & Performance Benchmark infrastructure.
Space shooter game by @clear-code-projects
A simple GUI application written in python using tkinter module
TY blog Site Repo
FlashInfer: Kernel Library for LLM Serving
Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM
Kubernetes integration for OVN
Design documents that for InstructLab
InstructLab Command-Line Interface. Use this to chat with a model and execute the InstructLab workflow to train a model using custom taxonomy data.
Python library for Synthetic Data Generation
Taxonomy tree that will allow you to create models tuned with your data
Examples for building and running LLM services and applications locally with Podman
Red Hat Enterprise Linux AI -- Developer Preview
FB (Facebook) + GEMM (General Matrix-Matrix Multiplication) - https://code.fb.com/ml-applications/fbgemm/
Tensors and Dynamic neural networks in Python with strong GPU acceleration
No description provided.
No description provided.
Experience the power of Clarifai’s AI platform with the python SDK. 🌟 Star to support our work!
No description provided.
A tool for installing and managing Python packages
You like pytorch? You like micrograd? You love tinygrad! ❤️
Install and Run Python Applications in Isolated Environments
Chaos and resiliency testing tool for Kubernetes and OpenShift