Random Number Generation

[AntonOresten]

There are many uses for RNG, but it is also necessary for some stochastic narrow precision (#108) tricks. See e.g. https://www.radicalnumerics.ai/blog/nvfp4-part1 and https://arxiv.org/pdf/2601.22813.

Based on NVIDIA/cutile-python#17, it seems it might get support at the Tile IR level.

[maleadt]

You mean kernel-side rand() calls?

[AntonOresten]

Yeah, I suppose that'd be the API. Then presumably the Tile IR instrinsics would take UInt RNG states.

[maleadt]

I wonder if we couldn't already do a counter-based RNG, just like we do in CUDA.jl, but then with explicitly-managed state instead of the hackery we do over there (injecting at kernel launch, storing in shared memory, etc). I'll throw a robot at it.

[AntonOresten]

Not sure I understand what you mean by explicitly managed, and how it'd get incremented. Interesting though. Worth a stab!

[maleadt]

Let me know how the RNG works! It seems to perform really well, if anything.