Skip to content

[TRTLLM-13319][fix] fix output distribution correctness for Eagle3 dynamic-tree rejection sampling#15098

Open
zhaoyangwang-nvidia wants to merge 5 commits into
NVIDIA:mainfrom
zhaoyangwang-nvidia:eagle3-rej-target-only
Open

[TRTLLM-13319][fix] fix output distribution correctness for Eagle3 dynamic-tree rejection sampling#15098
zhaoyangwang-nvidia wants to merge 5 commits into
NVIDIA:mainfrom
zhaoyangwang-nvidia:eagle3-rej-target-only

[TRTLLM-12669][perf] Add torch.compile(max-autotune) to compute_probs…

56cc46a
Select commit
Loading
Failed to load commit list.