Skip to content

Commit 79abd6c

Browse files
Add Interactivity (tok/s/user) column to GitHub Action summary (#210)
* Initial plan * Add Interactivity (tok/s/user) column to GitHub Action summary Co-authored-by: functionstackx <47992694+functionstackx@users.noreply.github.com> --------- Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com> Co-authored-by: functionstackx <47992694+functionstackx@users.noreply.github.com>
1 parent b7ba336 commit 79abd6c

1 file changed

Lines changed: 3 additions & 2 deletions

File tree

utils/summarize.py

Lines changed: 3 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -12,8 +12,8 @@
1212
results.sort(key=lambda r: (r.get('model', 'unknown'), r['hw'], r.get('framework', 'vllm'), r.get('precision', 'fp8'), r['tp'], r['ep'], r['conc']))
1313

1414
summary_header = f'''\
15-
| Model | Hardware | Framework | Precision | TP | EP | DP Attention | Conc | TTFT (ms) | TPOT (ms) | E2EL (s) | TPUT per GPU | Output TPUT per GPU | Input TPUT per GPU |
16-
| :-: | :-: | :-: | :-: | :-: | :-: | :-: | :-: | :-: | :-: | :-: | :-: | :-: | :-: |\
15+
| Model | Hardware | Framework | Precision | TP | EP | DP Attention | Conc | TTFT (ms) | TPOT (ms) | Interactivity (tok/s/user) | E2EL (s) | TPUT per GPU | Output TPUT per GPU | Input TPUT per GPU |
16+
| :-: | :-: | :-: | :-: | :-: | :-: | :-: | :-: | :-: | :-: | :-: | :-: | :-: | :-: | :-: |\
1717
'''
1818
print(summary_header)
1919

@@ -32,6 +32,7 @@
3232
f"| {result['conc']} "
3333
f"| {(result['median_ttft'] * 1000):.4f} "
3434
f"| {(result['median_tpot'] * 1000):.4f} "
35+
f"| {result['median_intvty']:.4f} "
3536
f"| {result['median_e2el']:.4f} "
3637
f"| {result['tput_per_gpu']:.4f} "
3738
f"| {result['output_tput_per_gpu']:.4f} "

0 commit comments

Comments
 (0)