Commit e7bbf3f

authored

High-precision, supports save_z_fp8=False, recompute_z, and BF16-wgrad (#56)

1 parent f8f51ac commit e7bbf3fCopy full SHA for e7bbf3f

3 files changed

sonicmoe
- functional
  - __init__.py
  - fp8_config.py
- quack_utils
  - gemm_sm100_fp8_zeromat.py

Comments

(0)