Skip to content

feature: add Uvicorn logging parameters to vllm_router #967

Description

@quachc

Describe the feature

We notice a lot of liveness-/readinessProbe logging in the router container, for the "model containers" we can use --disable-access-log-for-endpoints /health,/metrics,/ping to suppress this logging.

It would be really nice if we could suppress the logging of vllm_router in a similar matter.

Why do you need this feature?

Prevent excessive logging for vllm_router and preserve important logging (e.g. --log-stats)

Additional context

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions