Skip to main content
vLLM logo

vLLM

Fast LLM inference engine. High-throughput serving for LLMs.

AI InfrastructureFounded January 2023#9 of 54 in AI Infrastructure

Company data checked

Follow this company

Follow this company to revisit its latest research cards from your account.

Company research

Current company data

No company research card is published for vLLM yet. The current company data below lists package, repository, and discussion metrics AI-Buzz can inspect today; AI-Buzz publishes a card when recent public metrics show a measured change with dated evidence and cited sources.

Package downloads (30d)

5.3M/30d

Dependent projects

770

dependents · latest

GitHub stars

86.1K

Hacker News

127/30d

Note: Public metrics are incomplete, and current data alone does not prove a trend; they do not show private usage, paid use, customer count, or product quality.

Company profile

What is vLLM?

vLLM is a fast LLM inference engine. High-throughput serving for LLMs. Used by many AI applications.

Latest company data

Metric dates vary by source

Metric dates
PyPI downloads
PyPI dependents
GitHub stars
Hacker News mentions

Key metric

Package downloads (30d)

5.3M/30d

Tracked package: PyPI vllm

▼ -18%

Additional metrics

3 metrics

Metric

Dependent projects

770

Projects depending on tracked package: PyPI vllm

Metric

GitHub stars

86.1K

Main repository stars

Metric

Hacker News

127/30d

Position #6 in category discussion

Repository health

Maintenance data from the main open-source repository.

Key-person risk
7
External contributors
26
% of recent contributors outside the core team
Releases (30d)
0

Repository usage

Public repositories and source files importing packages tied to vLLM.

Repos importing
50%

About vLLM

vLLM is a fast LLM inference engine. High-throughput serving for LLMs. Used by many AI applications.

FounderWoosuk Kwon

Tracked packages (1)

1 PyPI

vllm

PyPIMain PyPI package

vllm

Fast LLM inference engine. High-throughput serving for LLMs.