feat(moe): parallel execution prefetch queue for SSD expert streaming#8

Merged

solderzzc merged 66 commits intomainfrom

feature/papps-ssd-streaming

Apr 14, 2026

Commits on Apr 6, 2026

Fix doc comments and verify in CI (#176)
DePasqualeOrg
authored

Commits on Apr 9, 2026

Commits on Apr 11, 2026

feat: Expose Omni modality UserInput.Audio structures, Chat representations, and Gemma4VL support
Aegis AI Assistant
committed
fix: Resolve missing brace syntax error in Gemma4 and add any KVCache for Swift 6
Aegis AI Assistant
committed
feat: Support global partial RoPE Base Frequencies and explicit QK-Logit Softcapping in Gemma4 configuration
Aegis AI Assistant
committed
fix: Resolve potential merge conflicts for Gemma4 softcapping and shared KV cache
Aegis AI Assistant
committed

Commits on Apr 12, 2026

fix(gemma4): stabilize logit projection accuracy and mm weight sync
Aegis AI Assistant
committed
fix(kvcache): handle empty states gracefully on reload and add safe causal mask
Aegis AI Assistant
committed
feat(gemma4): implement native message generator for multimodal tokens
Aegis AI Assistant
committed
feat(audio): implement native Gemma-4 Omni Audio processing via Conformer mapping
Aegis AI Assistant
committed
feat(vlm): stabilize Gemma 4 Omni integration bounds for Audio Subsamping and KVCache alignments
Aegis AI Assistant
committed
fix(gemma4): enforce explicit enableMoeBlock fallback mapping to prevent dense layout allocation crashes
Antigravity
committed
feat: migrate and restructure STFT audio processing into MLXLMCommon
Aegis AI Assistant
committed
refactor(gemma4): integrate native MEL spectrogram audio pipeline into VLM logic
Aegis AI Assistant
committed
fix(vlm): mask per-layer text streams and scale multimodal vectors uniformly

Antigravity
authored and
Aegis AI Assistant
committed
fix(gemma): use exact reshape for multimodal mask
Antigravity
committed
chore: merge main into papps-ssd-streaming
Aegis AI Assistant
committed
fix(gemma4): restore manual normalizations and inputEmbedding parameter support
Aegis AI Assistant
committed
fix(gemma4): prevent double scaling of inputEmbedding and fix omni prompt anchoring
Aegis AI Assistant
committed
fix(gemma4): update camelCase config coding keys to match JSON schema
Aegis AI Assistant
committed
fix: safely unwrap Gemma 4 VLM configuration options
Aegis AI Assistant
committed
fix: make LanguageModel and associated types Sendable for Swift 6
Aegis AI Assistant
committed
fix: use @unchecked Sendable for MLX-backed types in LanguageModel
Aegis AI Assistant
committed
revert: Sendable changes in LanguageModel to restore build sanity
Aegis AI Assistant
committed
fix(audio): resolve optional unwrapping build error in Gemma4Audio inference pipeline
Aegis-AI
committed
fix(gemma4): stabilize PLE gated residual and weight sanitization; adds CI/CD suit
Aegis-AI
committed
test(speculative): add hardened regression checks and CI protection gate
Aegis-AI
committed
feat(quality): add high-rigor regression suite for 8GB runners and Gemma 4 parity
Aegis-AI
committed
fix(gemma4): stabilize RoPE, softcapping, shared KV, and audio axis concatenation
Aegis AI Assistant
committed
chore: fix Sendable violations, deprecations, and unused variables for CI stabilization
Aegis AI Assistant
committed
fix: restore missing Foundation import in SwitchLayers
Aegis AI Assistant
committed
fix(gemma4): update Gemma4 and Gemma4VL parameter unpacking and architecture cleanup
Aegis AI Assistant
committed
Merge remote-tracking branch 'origin/feature/papps-ssd-streaming' into feature/papps-ssd-streaming
Aegis AI Assistant
committed
fix(sync): resolve overlapping omni-model tied word embedding logic
Aegis-AI
committed
fix(gemma4): resolve missing MoE router projection weight during load
Aegis-AI
committed
fix: build tests in release mode and execute them with -c release to resolve missing xctest failure
Aegis-AI
committed

Commits on Apr 13, 2026

fix(gemma4): remove explicit ModuleInfo strings from internal Router MLXArrays to natively resolve 'scale' unpacking
Aegis-AI
committed
Add gemma 4 model (text, vision, MoE) (#180)
adrgrondin
authored
fix(gemma4): resolve architectural phase shifts and initialization crashes
Aegis AI Assistant
committed
fix(gemma4): resolve multimodal blindness via accurate spatial convolutions and PLE conditioning scale preservation
Aegis AI Assistant
committed
Add Gemma 4 text model support (E2B and E4B) (#185)

stefan-geens
and
Stefan Geens
authored
fix(gemma4audio): remove manual audio bounding tokens inhibiting transcription interpretation natively
Aegis AI Assistant
committed
fix(gemma4): restore multimodal scale magnitudes and stabilize token wrappers
Aegis AI Assistant
committed
fix(gemma4): implement float32 safe RMSNorm wrapper, resolving NaN overflow shattering on Apple Silicon without compromising base magnitudes
Aegis AI Assistant
committed
small v3 api fixes (#190)
davidkoski
authored

Commits on Apr 14, 2026

fix(gemma4): finalize omni enhancements, audio logic, and native masking structures before upstream sync
Aegis AI Assistant
committed
Merge upstream/main into feature/papps-ssd-streaming, adopting Apple's Gemma4 structures
Aegis AI Assistant
committed
chore: remove superseded Gemma4VL.swift in favor of upstream Gemma4.swift (MLXVLM)
Aegis AI Assistant
committed
test(gemma4): rewrite Gemma4Tests to use upstream Gemma4Model and JSON-decoded configuration
Aegis AI Assistant
committed
fix(ci): support @testable imports in release builds and clean up unused dependencies
Aegis AI Assistant
committed
fix(tests): resolve syntax errors in SpeculativeDecodingTests.swift (invalid identifiers)
Aegis AI Assistant
committed
fix(ci): aggressive mlx.metallib injection for Metal accelerated tests on macOS 15
Aegis AI Assistant
committed
fix(ci): robust metallib injection into MacOS and Resources dirs inside xctest bundles
Aegis AI Assistant
committed
fix(tests): serialize all MLX-eval test suites to prevent Metal concurrency crashes
Aegis AI Assistant
committed
fix(ci): disable parallel testing and serialize all suites to avoid AppleParavirtCommandBuffer concurrency assertions on macOS runners
Aegis AI Assistant
committed
fix(tests): serialize remaining MLX-eval tests (KVCache, Pooling) to solve Metal Paravirt concurrency faults
Aegis AI Assistant
committed
fix(tests): fully encapsulate KVCacheTests inside serialized suite to prevent interleaving parameterized Metal invocations
Aegis AI Assistant
committed
fix(tests): perfectly serialize all MLX suites by nesting them under MLXTestingSuite trait to definitively fix Paravirt bounds assertion
Aegis AI Assistant
committed
fix(tests): resolve matrix rank broadcasting logic in performance suite using matmul instead of element-wise multiplication
Aegis AI Assistant
committed
fix(layers): explicitly capture arrays in concurrent loops to resolve Swift 6 preconcurrency warnings
Aegis AI Assistant
committed