Add GPU-side Gumbel-max sampling for CUDA graph compatibility #3459

Job	Run time
test-arm / test-backend-linux (arm_tosa_fp, models) / linux-job	31m 24s
test-arm / test-backend-linux (arm_vgf_fp, operators) / linux-job	16m 21s
test-arm / test-backend-linux (arm_tosa_fp, operators) / linux-job	18m 48s
test-arm / test-backend-linux (arm_vgf_fp, models) / linux-job	32m 14s
test-arm / test-backend-macos	-7s
test-arm / package-golden-artifacts	43s
	1h 39m 23s

Provide feedback