Commit 64c6375
authored
Add OLMoE architecture adapter tests (#1333)
* Add OLMoE architecture adapter tests
Download-free unit suite for OlmoeArchitectureAdapter (50 tests, no real
checkpoints), following the existing adapter-test pattern. Covers config
defaults, QKVO weight conversions with GQA head counts, component mapping
(including Q/K-norm and the MoE bridge), factory dispatch, numerical
conversion round-trips, GQA forward hook shapes with Q/K-norm wired,
setup_component_testing, prepare_model in-place-clamp patching, and
architecture guards.
* Simplify Q/K-norm and final-RMS test docstrings1 parent 7329b20 commit 64c6375
1 file changed
Lines changed: 631 additions & 0 deletions
0 commit comments