[Model] Investigate why fp32 in RMSNorm & output.

[NANWOOD]

Reference

• https://github.com/meta-llama/llama/blob/main/llama/model.py#L76