omniserve

Project information

[MLSys'25] QServe: W4A8KV4 Quantization and System Co-design for Efficient LLM Serving; [MLSys'25] LServe: Efficient Long-sequence LLM Serving with Unified Sparse Attention

25 Commits
1 Branch
0 Tags

README
Apache License 2.0

Created on

July 11, 2025

Copy SSH clone URLgit@git.qcjzai.cn:lizhengxian/omniserve.git
Copy HTTPS clone URLhttps://git.qcjzai.cn/lizhengxian/omniserve.git