feat(voice): backend voice picker + advanced controls behind disclosure (#742)#743

Open

heavygee wants to merge 50 commits into

heavygee:feat/voice-selection-all-backends

Commits on May 31, 2026

feat(voice): pluggable voice backend with Gemini Live & Qwen Realtime
heavygee
committed
fix(voice): restore user mic mute state after Gemini turn completes
heavygee
committed
fix(voice): remove hard-coded Chinese language from Gemini backend
heavygee
committed
fix(voice): reset modelSpeaking in cleanup to unblock mic on restart
heavygee
committed
fix(voice): guard stale close handlers in Gemini and Qwen sessions

heavygee
and
HAPI
committed
fix(voice): remove hard-coded Chinese language from Qwen backend

heavygee
and
HAPI
committed
feat(voice): proactive/reactive toggle in voice settings

heavygee
and
HAPI
committed
fix(voice): normalize WS close codes, drop barrel re-exports, fix SSE visibility

heavygee
and
HAPI
committed
fix(voice): respect language setting in Gemini/Qwen; fix voice-start toggle label

heavygee
and
HAPI
committed
fix(voice): send greeting trigger in reactive mode for Gemini

heavygee
and
HAPI
committed
fix(voice): suppress Gemini self-identification and context leak in greeting

heavygee
and
HAPI
committed
fix(voice): address code review findings — error handling, proxy, audio

heavygee
and
HAPI
committed
fix(voice): trailing-slash WS URL, Qwen session.update schema

heavygee
and
HAPI
committed
fix(voice): await audio capture before setMuted; sanitize upstream close codes

heavygee
and
HAPI
committed
fix(voice): wrap startAudioCapture in try/catch to propagate mic errors

heavygee
and
HAPI
committed
fix(voice): propagate backend discovery failure instead of silently falling back to ElevenLabs

heavygee
and
HAPI
committed
fix(voice): throw on unrecognised backend value instead of silently falling back to ElevenLabs

heavygee
and
HAPI
committed
fix(voice): add Qwen greeting/proactive trigger; fix socket buffer for base64 uploads

heavygee
and
HAPI
committed
fix(voice): replace unsupported conversation.item.create with session.update for Qwen text

heavygee
and
HAPI
committed
fix(voice): guard session.updated re-entry and reset config on session start

heavygee
and
HAPI
committed
fix(voice): assert wsUrl presence for Gemini proxy connections

heavygee
and
HAPI
committed
fix(voice): correct Qwen audio formats and default voice

heavygee
and
HAPI
committed
fix(voice): close AudioContext on failed voice session start

heavygee
and
HAPI
committed
chore: restore non-voice files to upstream/main state
heavygee
committed
fix(voice): harden Gemini and Qwen WS proxies against client abuse

heavygee
and
cursoragent
committed
fix(voice): harden Qwen proxy — hub-owned setup, client frame allowlist
heavygee
committed
fix(voice): respect Qwen session.created→session.update protocol ordering
heavygee
committed
fix(voice): use Realtime tool shape for Qwen session.update (not chat-completions)
heavygee
committed
feat(voice): scaffold picker catalogs for Gemini and Qwen (#742)

heavygee
and
cursoragent
committed
feat(voice): backend chooser and per-provider voice settings (#742)

heavygee
and
cursoragent
committed
fix(web): show Gemini/Qwen voice descriptions in Settings

heavygee
and
cursoragent
committed
chore(dev): harden voice settings Playwright dogfood wait strategy

heavygee
and
cursoragent
committed
test(voice): isolate VOICE_BACKEND fallback test from leaked env vars

heavygee
and
cursoragent
committed
feat(web): advanced voice character and ElevenLabs tuning controls

heavygee
and
cursoragent
committed
feat(web): expose full editable voice system prompt in settings

heavygee
and
cursoragent
committed
fix(web): VoiceAdvancedControls checkbox handler typo
heavygee
committed
fix(web): ElevenLabs overrides keep client tools, skip default prompt
heavygee
committed
fix(web): cap ElevenLabs WebRTC payload (65KB message limit)
heavygee
committed
feat(web): composed voice prompt layers and bootstrap context stream

heavygee
and
cursoragent
committed
test(web): import from vitest instead of bun:test

heavygee
and
cursoragent
committed

Commits on Jun 1, 2026