Weight tying improvements#456

Merged

le1nux merged 5 commits into

mainfrom

3B_training_prep

Jun 30, 2026

Commits on Jun 20, 2026

fix: fixed initialization of tied weights in Llama3Initializer
le1nux
committed

Commits on Jun 26, 2026

chore: added weight tying tests and Llama3 initialization checks
le1nux
committed

Commits on Jun 27, 2026

Commits on Jun 28, 2026

fix: update Llama3Initializer to infer weight tying from model and reject non-GPT2 models
le1nux
committed