Skip to content

Commit 64c6375

Browse files
Add OLMoE architecture adapter tests (#1333)
* Add OLMoE architecture adapter tests Download-free unit suite for OlmoeArchitectureAdapter (50 tests, no real checkpoints), following the existing adapter-test pattern. Covers config defaults, QKVO weight conversions with GQA head counts, component mapping (including Q/K-norm and the MoE bridge), factory dispatch, numerical conversion round-trips, GQA forward hook shapes with Q/K-norm wired, setup_component_testing, prepare_model in-place-clamp patching, and architecture guards. * Simplify Q/K-norm and final-RMS test docstrings
1 parent 7329b20 commit 64c6375

1 file changed

Lines changed: 631 additions & 0 deletions

File tree

0 commit comments

Comments
 (0)