Skip to content

feat: SwiftBuddy Memory Palace V1 & Omni Audio Edge Stabilization#31

Open
solderzzc wants to merge 157 commits intomainfrom
feature/swiftbuddy-mempalace-v1
Open

feat: SwiftBuddy Memory Palace V1 & Omni Audio Edge Stabilization#31
solderzzc wants to merge 157 commits intomainfrom
feature/swiftbuddy-mempalace-v1

Conversation

@solderzzc
Copy link
Copy Markdown
Member

Pull Request

Title: feat: SwiftBuddy Memory Palace V1 & Omni Audio Edge Stabilization

🚀 Summary

This PR merges the entire feature/swiftbuddy-mempalace-v1 architecture into main. This milestone finalizes our end-to-end multimodal inference pipeline over Gemma 4 (Text + Audio + Vision), heavily refines the SwiftBuddy interface natively for macOS, replaces the legacy persona integration pipeline with lightning-fast RAG vector synthesis (Memory Palace), and hardens the core local-inference framework to cleanly package zero-secret GitHub Action releases.

🧠 Core Architectural Upgrades

  • Gemma 4 Omni Pipeline Stabilization: Completely resolved the upstream DraftModelRef speculative-decoding integration failures in Server.swift. Re-exposed the critical Gemma4Configuration payload structs so that MLXVLM processing can successfully bind scaling integers across the audio array ingestion layers. Native inputEmbedding overrides are permanently restored!
  • Memory Palace Vector Migration: Deprecated the slow LLM-dependent GraphPalaceService in favor of precise, deterministic semantic searches using MemoryPalaceService.synthesizePersonaIndex. To secure massive compute continuity, RAG directives are forcefully appended into dynamic UI states to avoid fracturing identical MLX KV-cache hits!
  • SSD Inference & Model Loading: Rolled out the definitive Hot Expert LRU Cache to eliminate destructive sequential pread() blocking when sliding across enormous MoE configurations.
  • Zero-Secret DMG Deployment: Upgraded GitHub runners to seamlessly package, CodeSign, and natively Notarize the Apple Silicon app distribution endpoints dynamically using Info.plist data.

🎨 Layout & Discovery Aesthetics (SwiftBuddy)

  • Ancient RPG Persona UX: Immersive visual novel elements added to character bonding, layered explicitly beneath system Toolbar bounds for native UI fluidity. Trapped NSDetectedLayoutRecursion rendering faults inherently caused by Apple's TextEditor SwiftUI boundaries.
  • HuggingFace Pipeline Integrity: Dynamically fetches byte storage sizes with native ByteCountFormatter, traps undocumented GGUF metadata returns, and natively embeds offline-verified "Interactive Summoning" states directly into individual model rows.

🧪 Pipeline Validation

  • DSP math fully stabilized via SwiftLMTestSTFT harness evaluation points.
  • Zero compilation crashes recorded under swift build -c release.
  • System Roles definitively translated out of Gemma Jinja templates to prevent echoing and linguistic exhaustion.

solderzzc added 30 commits April 7, 2026 18:53
- Injected export pipeline guaranteeing MLX metal library initialization hooks bypass Github Action test environments natively
- Introduced currentWing target on ChatViewModel for persona routing
- Intercepted userText explicitly searching SwiftData native memories
- Pre-pended retrieved factual context invisibly inside system prompts ensuring zero-latency, 100% stable context retention across all dumb models seamlessly
…rference and make downloaded models directly tappable to load
…o prevent macOS layout recursion crashes resulting in blank models
…cursive background querying for HF Hub discovery
…skeleton constraints for HuggingFace Hub modal layout
…ng to RegistryService to trace GitHub API access drops
…hed persona.json and statically request known room txt files
… WAL transaction flooding during massive persona corpus ingestion
…oops by converting TextEditor blocks to vertical TextFields inside iOS/macOS active ScrollViews
…ine and introduce Native graphical Map hierarchy for memory rooms
…natively into ChatView toolbars for RAG identity mapping
…tly reflect the currently selected memory persona wing
…try and pivot root Navigation to a primary Friends List model
…ectures by forcefully prepending RAG variables linearly against raw User instructions rather than allocating hostile System Role bounds
Antigravity and others added 30 commits April 12, 2026 10:17
… broken build script, and expose native inference logs in Omni test harness
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant