vllm - A high-throughput and memory-efficient inference and serving engine for LLMs #178

Open

Labels

libraryresourcetoolbox

opened

https://github.com/vllm-project/vllm

Metadata

Assignees

No one assigned

Labels

libraryresourcetoolbox

Type

No type

Fields

No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests