vLLM
The de-facto open-source engine for high-throughput LLM serving.
开源高吞吐推理引擎,自建大模型服务首选
Visit site访问官网 ↗vllm.aiLink active链接活跃Probed today今日探测 · 335 ms · 100% up · HTTP 200 · Together AIFast inference and fine-tuning cloud for leading open-source models.GroqBlazing-fast LPU inference serving popular open models at record speed.Fireworks AIProduction-grade, ultra-fast inference platform for open generative models.SiliconFlow 硅基流动One-stop inference cloud for open models, tuned for Chinese developers.
?
Quick answers常见问答
Is vLLM free?vLLM 是免费的吗?
vLLM is open source — free to self-host.vLLM 开源,可自行部署免费。
Does vLLM work in China?国内能直接用 vLLM 吗?
Yes, vLLM is directly accessible from mainland China without a proxy.可以,vLLM 国内可直连,无需代理。
Is vLLM's link verified?vLLM 的链接核验过吗?
Yes — we probed vLLM's link today (HTTP 200, 335 ms) and it's live.是——我们今日探测 vLLM 链接(HTTP 200, 335 ms),状态活跃。