Commit 8f2bd8f
committed
[TRTLLM-12669][fix] disable fast-path when use_rejection_sampling=True
The rejection sampling path always reads spec_metadata.temperatures,
regardless of greedy/non-greedy. Skipping phase 2 there would leave
stale buffer values and break greedy semantics in the rejection
acceptance step.
Signed-off-by: ZhaoyangWang <zhaoyangw@nvidia.com>1 parent 752ad68 commit 8f2bd8f
1 file changed
Lines changed: 2 additions & 1 deletion
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
654 | 654 | | |
655 | 655 | | |
656 | 656 | | |
657 | | - | |
| 657 | + | |
| 658 | + | |
658 | 659 | | |
659 | 660 | | |
660 | 661 | | |
| |||
0 commit comments