Skip to content

Update avg-ttft-scorer with inflight-aware scoring with excess-load penalty#46

Open
Mohammad-nassar10 wants to merge 11 commits into
ms-llmd:mainfrom
Mohammad-nassar10:inflight-aware-scorer
Open

Update avg-ttft-scorer with inflight-aware scoring with excess-load penalty#46
Mohammad-nassar10 wants to merge 11 commits into
ms-llmd:mainfrom
Mohammad-nassar10:inflight-aware-scorer

Conversation

@Mohammad-nassar10

@Mohammad-nassar10 Mohammad-nassar10 commented Jun 14, 2026

Copy link
Copy Markdown
Contributor

What type of PR is this?
/kind feature

What this PR does / why we need it:
Stacked on #37.

Which issue(s) this PR fixes:

Fixes #45.

Release note (write NONE if no user-facing change):

NONE

Mohammad-nassar10 and others added 7 commits June 7, 2026 12:51
Signed-off-by: Mohammad <mohammad.nassar@ibm.com>
Signed-off-by: Mohammad Nassar <mohammad.nassar@ibm.com>
Signed-off-by: Mohammad Nassar <mohammad.nassar@ibm.com>
Signed-off-by: Mohammad Nassar <mohammad.nassar@ibm.com>
Signed-off-by: Mohammad Nassar <mohammad.nassar@ibm.com>
Signed-off-by: Mohammad Nassar <mohammad.nassar@ibm.com>
@github-actions

Copy link
Copy Markdown

⚠️ Large PR detected

Your PR is large. Please consider breaking it into multiple PRs.

The do-not-merge/hold label has been added and can be removed by the reviewers based on their judgement.

1 similar comment
@github-actions

Copy link
Copy Markdown

⚠️ Large PR detected

Your PR is large. Please consider breaking it into multiple PRs.

The do-not-merge/hold label has been added and can be removed by the reviewers based on their judgement.

Mohammad-nassar10 and others added 4 commits June 15, 2026 12:39
Signed-off-by: Mohammad-nassar10 <79787844+Mohammad-nassar10@users.noreply.github.com>
Signed-off-by: Mohammad <mohammad.nassar@ibm.com>
…enalty.

Signed-off-by: Mohammad <mohammad.nassar@ibm.com>
Signed-off-by: Mohammad <mohammad.nassar@ibm.com>
@github-actions

Copy link
Copy Markdown

⚠️ Large PR detected

Your PR is large. Please consider breaking it into multiple PRs.

The do-not-merge/hold label has been added and can be removed by the reviewers based on their judgement.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Improve current avgttft scorer

1 participant