Skip to content

Add exploration-exploitation score picker to address stale scores #18

Description

@Mohammad-nassar10

Scorers like avg-ttft-scorer use an EMA that freezes when a model receives no traffic, when a model has a low score (near 0) stays there indefinitely because it gets no new requests to update its average.

Add an exploration-max-score-picker that wraps max-score exploitation with controlled exploration. On each request, with probability explorationRatio, it probes a model whose score has been unchanged for longer than stalenessThreshold instead of picking the top-scored model.

Metadata

Metadata

Labels

No labels
No labels

Type

No type

Fields

No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions