Skip to content

Default HiddenAct::Gelu to GeLU + tanh in favour of GeLU erf #753

Merged
alvarobartt merged 21 commits into
huggingface:mainfrom
vrdn-23:vrdn-23/fix-gelu-activation
Jan 30, 2026
Merged

Default HiddenAct::Gelu to GeLU + tanh in favour of GeLU erf #753
alvarobartt merged 21 commits into
huggingface:mainfrom
vrdn-23:vrdn-23/fix-gelu-activation

Commits

Commits on Nov 6, 2025

Commits on Jan 28, 2026