fix(inference): size DynamicInferenceContext KV layer_map for non-uniform PP#4775

Draft

athitten wants to merge 5 commits into

NVIDIA:mainfrom

athitten:fix/dynamic-inference-context-pp-layer-count

Commits on May 13, 2026

fix(inference): size DynamicInferenceContext KV layer_map for non-uniform PP
Abhishree Thittenamane
committed

Commits on May 14, 2026

test(inference): cover uneven PP layer_map vs get_num_layers_to_build
Abhishree Thittenamane
committed
fix(inference): align DynamicInferenceContext layer count with pg_collection.pp
Abhishree Thittenamane
committed
fix(inference): pass vp_stage=None for get_num_layers_to_build in dynamic context
Abhishree Thittenamane
committed

Commits on May 15, 2026

Reformat test_dynamic_context.py
root
committed