Skip to content

add run_async for LlamaCppChatGenerator #1890

@sjrl

Description

@sjrl

We should add a run_async implementation for LlamaCppChatGenerator since we have AsyncPipeline available.

Metadata

Metadata

Assignees

Type

No type
No fields configured for issues without a type.

Projects

Status

In Progress

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions