[None][fix] Fix encoder-decoder beam search corruption via per-slot fragmentPointerDevice#15461

Merged

achartier merged 11 commits into

NVIDIA:mainfrom

achartier:fix-enc-dec-gather-logits-kernel

Jun 23, 2026

Commits on Jun 23, 2026

[None][fix] Fix cross-KV block sharing for encoder-decoder beam search
achartier
committed
[None][fix] Clean up mInflightReqIds and buffers on mixed-beam exception
achartier
committed
[None][test] Add C++ unit tests for enc-dec beam-search fixes
achartier
committed
[None][fix] Fix gather_generation_logits corruption: per-slot fragmentPointerDevice
achartier
committed
[None][chore] Update copyright years to 2026 in files modified by this PR
achartier
committed
[None][fix] Address code review: API safety, assertion, and comment accuracy
achartier
committed
[None][test] Strengthen enc-dec beam-search regression tests
achartier
committed
[None][fix] Guard changeBeamWidth on mInflightReqIds.empty() in error handler
achartier
committed
[None][fix] Remove fix 1 per review: cross-KV beam sharing is redundant
achartier
committed
[None][chore] Remove file-level summary comment from encDecBeamSearchTest
achartier
committed
Revert variable renaming
achartier
committed