Cosyvoice3 optim#1874

Open

better-one wants to merge 12 commits intoFunAudioLLM:mainfrom

better-one:cosyvoice3-optim

Commits on Apr 22, 2026

feat: WSL deployment with FE-cache + lock-free streaming server

better-one
and
claude
committed
perf(flow): enable TRT fp16 engine (TTFA p95 -41%, lat p95 -42%)

better-one
and
claude
committed
perf(vllm): unblock high-concurrency QPS (+70% at conc=16)

better-one
and
claude
committed
perf(llm): single-thread vllm scheduler (peak QPS @ conc=8 instead of 16)

better-one
and
claude
committed
docs(profile): post-Round-3 stage breakdown + roadmap re-prioritization

better-one
and
claude
committed
perf(hift): TRT fp16 engine for HiFi-GAN decoder (peak QPS +24%)

better-one
and
claude
committed
perf(flow): trt_concurrent 1 -> 4 for parallel Flow contexts (+17% QPS @ conc=4)

better-one
and
claude
committed
fix(audio): document Round 6 hift-TRT regression + add quality eval framework

better-one
and
claude
committed
fix(hift): use fp32 TRT engine for hift decoder (audio correct + still wins)

better-one
and
claude
committed

Commits on Apr 23, 2026