Repos
20
Stars
0
Forks
1
Top Language
Python
Loading contributions...
Repositories
20A high-throughput and memory-efficient inference and serving engine for LLMs
Pytorch domain library for recommendation systems
🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
torch::deploy (multipy for non-torch uses) is a system that lets you get around the GIL problem by running multiple Python interpreters in a single C++ process.
FlashInfer: Kernel Library for LLM Serving
AI Tensor Engine for ROCm
No description provided.
Datasets, Transforms and Models specific to Computer Vision
No description provided.
No description provided.
No description provided.
A web application helps manage patients
Pytorch domain library for recommendation systems
PyTorch/TorchScript compiler for NVIDIA GPUs using TensorRT
FB (Facebook) + GEMM (General Matrix-Matrix Multiplication) - https://code.fb.com/ml-applications/fbgemm/
benchmark transformations on TensorRT
Transformer related optimization, including BERT, GPT
Tensors and Dynamic neural networks in Python with strong GPU acceleration
A natural language modeling framework based on PyTorch
Compiler for Neural Network hardware accelerators