Universal LLM Deployment Engine with ML Compilation

High-performance In-browser LLM Inference Engine

Open Machine Learning Compiler Framework

Bringing stable diffusion models to web browsers. Everything runs inside the browser with no server support.

TVM Documentation in Chinese Simplified / TVM 中文文档

No description provided.

AutoKernel 是一个简单易用，低门槛的自动算子优化工具，提高深度学习算法部署效率。

yolort is a runtime stack for yolov5 on specialized accelerators such as tensorrt, libtorch, onnxruntime, tvm and ncnn.

🗣️ Chat with LLM like Vicuna totally in your browser with WebGPU, safely, privately, and with no server. Powered by web llm.

TON Foundation invites talent to imagine and realize projects that have the potential to integrate with the daily lives of users.

🚀🚀🚀 This repository lists some awesome public CUDA, cuda-python, cuBLAS, cuDNN, CUTLASS, TensorRT, TensorRT-LLM, Triton, TVM, MLIR, PTX and High Performance Computing (HPC) projects.

Quantization library for PyTorch. Support low-precision and mixed-precision quantization, with hardware implementation through TVM.

Open, Modular, Deep Learning Accelerator

Golang SDK for from Tonkeeper team

No description provided.

Optimizing Mobile Deep Learning on ARM GPU with TVM

Solidity compiler for TVM

A home for the final text of all TVM RFCs.

convert torch module to tensorrt network or tvm function

Reimplement RetinaFace using PyTorch.

Benchmark scripts for TVM

A curated list of awesome inference deployment framework of artificial intelligence (AI) models. OpenVINO, TensorRT, MediaPipe, TensorFlow Lite, TensorFlow Serving, ONNX Runtime, LibTorch, NCNN, TNN, MNN, TVM, MACE, Paddle Lite, MegEngine Lite, OpenPPL, Bolt, ExecuTorch.

DietCode Code Release

动手学习TVM核心原理教程

TVM stack: exploring the incredible explosion of deep-learning frameworks and how to bring them together

TVM Relay IR Visualization Tool (TVM 可视化工具)

Large input size REAL-TIME Face Detector on Cpp. It can also support face verification using MobileFaceNet+Arcface with real-time inference. 480P Over 30FPS on CPU

Reference implementation of Tycho protocol.

Streamline Ethereum, Solana, Cardano, Aptos, Sui and Tron operations. Effortlessly create transactions, interact with smart contracts, sign, and send transactions for a seamless blockchain experience.

Machine Learning Compiler Road Map