Zhenzhong Xu
Zhenzhong1
ML Engineer, OPEA Contributor, ITREX & NeuralSpeed Developer, Major in HPC & AI, Working in Intel, Graduated from the University of Edinburgh
Languages
Repos
12
Stars
1
Forks
0
Top Language
Python
Loading contributions...
Top Repositories
PPL Quantization Tool (PPQ) is a powerful offline neural network quantization tool.
A high-throughput and memory-efficient inference and serving engine for LLMs
Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.
Generative AI Examples is a collection of GenAI examples such as ChatQnA, Copilot, which illustrate the pipeline capabilities of the Open Platform for Enterprise AI (OPEA) project.
GenAI components at micro-service level; GenAI service composer to create mega-service
Evaluation, benchmark, and scorecard, targeting for performance on throughput and latency, accuracy on popular evaluation harness, safety, and hallucination
Repositories
12A high-throughput and memory-efficient inference and serving engine for LLMs
Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.
Generative AI Examples is a collection of GenAI examples such as ChatQnA, Copilot, which illustrate the pipeline capabilities of the Open Platform for Enterprise AI (OPEA) project.
GenAI components at micro-service level; GenAI service composer to create mega-service
Evaluation, benchmark, and scorecard, targeting for performance on throughput and latency, accuracy on popular evaluation harness, safety, and hallucination
PPL Quantization Tool (PPQ) is a powerful offline neural network quantization tool.
https://github.com/Zhenzhong1/sg-d76dd0dd
No description provided.
https://github.com/Zhenzhong1/sg-a9c880e4
Extending Hugging Face transformers APIs for Transformer-based models and improve the productivity of inference deployment. With extremely compressed models, the toolkit can greatly improve the inference efficiency on Intel platforms.
🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch
Open standard for machine learning interoperability