Skip to content

speculative config with vllm backend #8699

@geraldstanje

Description

@geraldstanje

hi,

is it possible to have a speculative config with vllm backend? if yes are there any examples to run it?

Thanks

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions