Add GPU-side Gumbel-max sampling for CUDA graph compatibility #5937

Job	Run time
export-model-cuda-windows-artifact (mistralai, Voxtral-Mini-3B-2507, non-quantized) / linux-job	26m 2s
export-model-cuda-windows-artifact (mistralai, Voxtral-Mini-3B-2507, quantized-int4-weight-only) / linux-job	26m 14s
export-model-cuda-windows-artifact (nvidia, parakeet-tdt, quantized-int4-weight-only) / linux-job	14m 15s
export-model-cuda-windows-artifact (mistralai, Voxtral-Mini-4B-Realtime-2602, quantized-int4-tile... / linux-job	27m 22s
export-model-cuda-windows-artifact (facebook, dinov2-small-imagenet1k-1-layer, non-quantized) / linux-job	12m 41s
export-model-cuda-windows-artifact (nvidia, parakeet-tdt, non-quantized) / linux-job	14m 27s
test-model-cuda-windows-e2e	0s
export-model-cuda-windows-artifact (nvidia, parakeet-tdt, non-quantized) / linux-job	14m 49s
export-model-cuda-windows-artifact (mistralai, Voxtral-Mini-3B-2507, non-quantized) / linux-job	26m 2s
export-model-cuda-windows-artifact (facebook, dinov2-small-imagenet1k-1-layer, non-quantized) / linux-job	12m 41s
export-model-cuda-windows-artifact (nvidia, parakeet-tdt, quantized-int4-weight-only) / linux-job	14m 15s
export-model-cuda-windows-artifact (mistralai, Voxtral-Mini-4B-Realtime-2602, quantized-int4-tile... / linux-job	27m 22s
export-model-cuda-windows-artifact (mistralai, Voxtral-Mini-3B-2507, quantized-int4-weight-only) / linux-job	26m 14s
test-model-cuda-windows-e2e	0s
	4h 2m 24s

Provide feedback