Snehalv dsv4 conv utility#4078

Draft

snehalv2002 wants to merge 22 commits into

mainfrom

snehalv-dsv4-conv-utility

Commits on May 14, 2026

feat: implement DeepSeek-V4 core primitives (RMSNorm, RoPE, GroupedLinear)
parambole
committed
feat: implement DeepSeek-V4 MoE routing primitives (HashRouter, TopKRouter, RoutedMoE)
parambole
committed
feat: implement DeepSeek-V4 compressed attention layers (HCA, CSA, LightningIndexer)
parambole
committed

Commits on May 20, 2026

feat: implement DeepSeek-V4 model integration, decoders, and configuration stack
parambole
committed
feat(core): synchronize production-grade normalization bounds and linear projection layers from mainline
parambole
committed
feat(moe): integrate float32 static routing lookup tables and custom variable tags to satisfy XLA compile rules
parambole
committed
feat(attention): update CSA/HCA compressors and Lightning Indexer query expansion parameters for Trillium parity
parambole
committed
Merge deepseek_v4_core_primitives into dsv4-moe-routing-primitives
parambole
committed
Merge dsv4-moe-routing-primitives into deepseek_v4_compressed_attention
parambole
committed
Merge deepseek_v4_compressed_attention into dsv4_integration and incorporate DeepSeek-V4 top-k hash routers
parambole
committed
test(dsv4): disable sa_block_kv hardware grid padding to secure unmasked reference numerical parity
parambole
committed
ci(github): exclude deepseek_v4_vs_reference_test.py across GitHub runner test suites
parambole
committed
Merge deepseek_v4_core_primitives into dsv4-moe-routing-primitives
parambole
committed
Merge dsv4-moe-routing-primitives into deepseek_v4_compressed_attention
parambole
committed
Merge deepseek_v4_compressed_attention into dsv4_integration
parambole
committed
ci(pytest): ignore deepseek_v4_vs_reference_test.py parity evaluation across automated runner suites
parambole
committed
Merge deepseek_v4_core_primitives into dsv4-moe-routing-primitives
parambole
committed
Merge dsv4-moe-routing-primitives into deepseek_v4_compressed_attention
parambole
committed
Merge deepseek_v4_compressed_attention into dsv4_integration
parambole
committed

Commits on May 26, 2026

fix(attention_compressed): use min kwarg in jnp.clip
parambole
committed

Commits on Jun 2, 2026

fix zero loss issue
snehalv2002
committed

Commits on Jun 5, 2026

standalone and checkpoint util for deepseek v4
snehalv2002
committed