Skip to content

Commit 8a98688

Browse files
Add Output TPUT per GPU and Input TPUT per GPU columns to summary table (#178)
* Initial plan * Add Output TPUT per GPU and Input TPUT per GPU to summary table Co-authored-by: functionstackx <47992694+functionstackx@users.noreply.github.com> * Add trailing comma to dictionary for better maintainability Co-authored-by: functionstackx <47992694+functionstackx@users.noreply.github.com> --------- Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com> Co-authored-by: functionstackx <47992694+functionstackx@users.noreply.github.com>
1 parent 593e1a6 commit 8a98688

1 file changed

Lines changed: 5 additions & 3 deletions

File tree

utils/summarize.py

Lines changed: 5 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -12,8 +12,8 @@
1212
results.sort(key=lambda r: (r['hw'], r.get('framework', 'vllm'), r.get('precision', 'fp8'), r['tp'], r['ep'], r['conc']))
1313

1414
summary_header = f'''\
15-
| Hardware | Framework | Precision | TP | EP | DP Attention | Conc | TTFT (ms) | TPOT (ms) | E2EL (s) | TPUT per GPU |
16-
| :-: | :-: | :-: | :-: | :-: | :-: | :-: | :-: | :-: | :-: | :-: |\
15+
| Hardware | Framework | Precision | TP | EP | DP Attention | Conc | TTFT (ms) | TPOT (ms) | E2EL (s) | TPUT per GPU | Output TPUT per GPU | Input TPUT per GPU |
16+
| :-: | :-: | :-: | :-: | :-: | :-: | :-: | :-: | :-: | :-: | :-: | :-: | :-: |\
1717
'''
1818
print(summary_header)
1919

@@ -31,5 +31,7 @@
3131
f"| {(result['median_ttft'] * 1000):.4f} "
3232
f"| {(result['median_tpot'] * 1000):.4f} "
3333
f"| {result['median_e2el']:.4f} "
34-
f"| {result['tput_per_gpu']:.4f} |"
34+
f"| {result['tput_per_gpu']:.4f} "
35+
f"| {result['output_tput_per_gpu']:.4f} "
36+
f"| {result['input_tput_per_gpu']:.4f} |"
3537
)

0 commit comments

Comments
 (0)