← Back to Home

Tag: 稀疏专家模型 (1 articles)

A Preview of Production-Scale Kimi K3 Support on vLLM

vLLM, together with Moonshot AI, NVIDIA, and AMD, is racing to bring day-0 serving support for Kimi K3 by reinventing prefix caching for KDA attention and fusing kernels across hardware stacks.

vLLM Blog · Jul 22, 2026