Skip to content

ROCm SGLang: make env vars default #290

@cquil11

Description

@cquil11

Certain environment variables are set in https://github.com/InferenceMAX/InferenceMAX/pull/247.

Since these give optimal performance, these should simply be set by default.

Metadata

Metadata

Assignees

Labels

Type

No fields configured for Task.

Projects

Status
Todo

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions