Company research
Hacker News mentions increased 30.5% over the last 30 days. Hacker News is discussion volume, not adoption.
Fast LLM inference engine. High-throughput serving for LLMs.
AI InfrastructureFounded January 2023#9 of 54 in AI Infrastructure
Follow this company
Follow this company to revisit its latest research cards from your account.
Company profile
vLLM is a fast LLM inference engine. High-throughput serving for LLMs. Used by many AI applications.
Hacker News mentions increased 30.5% over the last 30 days. Hacker News is discussion volume, not adoption.
History
3 research updates
vLLM: Hacker News mentions increased 30.5% over the last 30 days
LatestvLLM: Hacker News mentions increased 83.3% over the last 30 days
1 metricvLLM: Hacker News mentions increased 90.9% over the last 30 days
1 metricPrimary data point
6.0M/30d
Tracked package: PyPI vllm
Other data points
697
Projects depending on tracked packages in npm and PyPI
81.3K
Main repository stars
92/30d
Position #6 in category discussion
Maintenance data from the main open-source repository.
Public repositories and source files importing packages tied to vLLM.
vLLM is a fast LLM inference engine. High-throughput serving for LLMs. Used by many AI applications.
1 PyPI
vllm
Fast LLM inference engine. High-throughput serving for LLMs.