Skip to content

feat: Extend histogram metrics to non-decoupled models - #8580

Merged
yinggeh merged 1 commit into
mainfrom
yinggeh/tgh-57-metrics-cant-enable-histogram_latencies-metrics-and-enabling
Dec 18, 2025
Merged

feat: Extend histogram metrics to non-decoupled models#8580
yinggeh merged 1 commit into
mainfrom
yinggeh/tgh-57-metrics-cant-enable-histogram_latencies-metrics-and-enabling

Conversation

@yinggeh

@yinggeh yinggeh commented Dec 17, 2025

Copy link
Copy Markdown
Contributor

What does the PR do?

Currently nv_inference_first_response_histogram_ms is only shown in decoupled models. Extending to non-decoupled models based on user request.

Checklist

  • PR title reflects the change and is of format <commit_type>: <Title>
  • Changes are described in the pull request.
  • Related issues are referenced.
  • Populated github labels field
  • Added test plan and verified test passes.
  • Verified that the PR passes existing CI.
  • Verified copyright is correct on all changed files.
  • Added succinct git squash message before merging ref.
  • All template sections are filled out.
  • Optional: Additional screenshots for behavior/output changes with before/after.

Commit Type:

Check the conventional commit type
box here and add the label to the github PR.

  • feat

Related PRs:

triton-inference-server/core#464

Where should the reviewer start?

Test plan:

  • CI Pipeline ID:
    40388685

Caveats:

Background

Related Issues: (use one of the action keywords Closes / Fixes / Resolves / Relates to)

@yinggeh
yinggeh requested a review from whoisj December 17, 2025 20:34
@yinggeh yinggeh self-assigned this Dec 17, 2025
@yinggeh yinggeh added the PR: feat A new feature label Dec 17, 2025
@yinggeh
yinggeh merged commit eb04f5f into main Dec 18, 2025
3 checks passed
@yinggeh
yinggeh deleted the yinggeh/tgh-57-metrics-cant-enable-histogram_latencies-metrics-and-enabling branch December 18, 2025 16:32
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

PR: feat A new feature

Development

Successfully merging this pull request may close these issues.

2 participants