You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
This page collects maintained community integrations and experiments around FunASR models. These projects are useful for users exploring deployment paths beyond the official Python runtime, but they are not official FunASR implementations unless explicitly noted.
3
+
# FunASR Community Integrations
4
4
5
-
## Applications and workflows
5
+
This page lists maintained projects where FunASR, Fun-ASR-Nano, SenseVoice, or an official FunASR model is already integrated upstream. Each entry below was checked against the project's default branch and, where available, a linked merged change.
6
6
7
-
| Project | What it provides | Notes |
8
-
|---|---|---|
9
-
|[GPT-SoVITS](https://github.com/RVC-Boss/GPT-SoVITS)| Voice-dataset preparation and WebUI transcription with Fun-ASR-Nano, SenseVoice, and classic FunASR models. | The default CLI path uses Fun-ASR-Nano for Chinese, English, Japanese, Korean, and automatic language detection; Cantonese uses classic UniASR. Models download on first use. See the upstream [runtime fallback](https://github.com/RVC-Boss/GPT-SoVITS/pull/2801) and [backend documentation](https://github.com/RVC-Boss/GPT-SoVITS/pull/2803). |
10
-
11
-
Run dataset transcription from a GPT-SoVITS checkout:
These integrations are community-maintained. Their release cadence, hardware support, and API stability are controlled by the upstream project, not by the FunASR maintainers.
16
8
17
-
## VAD runtimes
9
+
## Voice agents and applications
18
10
19
-
| Project | What it provides|Notes|
11
+
| Project | What is integrated|Start here|
20
12
|---|---|---|
21
-
|[vad-burn](https://github.com/di-osc/vad-burn)| FSMN VAD inference in pure Rust with Python bindings. It supports offline VAD, streaming VAD, CPU-only inference, and automatic download of the default `iic/speech_fsmn_vad_zh-cn-16k-common-pytorch` model from ModelScope. | Community project from [#3106](https://github.com/modelscope/FunASR/issues/3106). Useful for Rust services, CLI tools, desktop apps, or Python pipelines that need FSMN VAD without depending on the original Python runtime. |
13
+
|[Pipecat](https://github.com/pipecat-ai/pipecat)| A local `FunASRSTTService` backed by SenseVoice for voice and multimodal agent pipelines, with transcription and voice-agent examples. |[FunASR service docs](https://docs.pipecat.ai/api-reference/server/services/stt/funasr), [transcription example](https://github.com/pipecat-ai/pipecat/blob/main/examples/transcription/transcription-funasr.py), [voice-agent example](https://github.com/pipecat-ai/pipecat/blob/main/examples/voice/voice-funasr.py), and merged [#4844](https://github.com/pipecat-ai/pipecat/pull/4844). |
14
+
|[xiaozhi-esp32-server](https://github.com/xinnan-tech/xiaozhi-esp32-server)| The default local ASR provider uses FunASR with SenseVoiceSmall; recognition language can be set to `auto`, `zh`, `en`, `ja`, `ko`, or `yue`. A separate FunASR runtime-server provider is also available. |[Provider implementation](https://github.com/xinnan-tech/xiaozhi-esp32-server/blob/main/main/xiaozhi-server/core/providers/asr/fun_local.py), [configuration](https://github.com/xinnan-tech/xiaozhi-esp32-server/blob/main/main/xiaozhi-server/config.yaml), and merged [#3255](https://github.com/xinnan-tech/xiaozhi-esp32-server/pull/3255). |
15
+
|[AutoSubs](https://github.com/tmoroney/auto-subs)| An on-device int8 ONNX SenseVoice engine for subtitle generation in DaVinci Resolve, Premiere, and After Effects. |[SenseVoice model notes](https://github.com/tmoroney/auto-subs#sensevoice), [engine source](https://github.com/tmoroney/auto-subs/blob/main/AutoSubs-App/src-tauri/crates/transcription-engine/src/engines/sense_voice.rs), and merged [#629](https://github.com/tmoroney/auto-subs/pull/629). |
16
+
|[OmniVoice Studio](https://github.com/debpalash/OmniVoice-Studio)| Its OpenAI-compatible remote ASR backend can point dictation and dubbing workflows at a self-hosted FunASR or SenseVoice server. |[OpenAI-compatible ASR guide](https://github.com/debpalash/OmniVoice-Studio/blob/main/docs/engines/openai-compatible-asr.md) and merged [#1003](https://github.com/debpalash/OmniVoice-Studio/pull/1003). |
17
+
|[GPT-SoVITS](https://github.com/RVC-Boss/GPT-SoVITS)| Dataset preparation and WebUI transcription with Fun-ASR-Nano, SenseVoice, and classic FunASR models. |[`funasr_asr.py`](https://github.com/RVC-Boss/GPT-SoVITS/blob/main/tools/asr/funasr_asr.py), runtime fallback [#2801](https://github.com/RVC-Boss/GPT-SoVITS/pull/2801), and backend documentation [#2803](https://github.com/RVC-Boss/GPT-SoVITS/pull/2803). |
22
18
23
-
`vad-burn` reports the following benchmark on `assets/vad_example.wav` (16 kHz mono PCM, 70.47 seconds) on a MacBook Pro M1 with the Burn Flex CPU backend:
19
+
## Model serving and runtimes
24
20
25
-
| Mode | Avg time | RTF | Speedup |
26
-
|---|---:|---:|---:|
27
-
| FSMN VAD offline | 73.631 ms | 0.001045 | 957.08x |
28
-
| FSMN VAD streaming, 600 ms chunks | 198.425 ms | 0.002816 | 355.15x |
29
-
30
-
Minimal Python usage from the project:
31
-
32
-
```python
33
-
from vad_burn import FsmnVadModel, VadOptions
21
+
| Project | What is integrated | Start here |
22
+
|---|---|---|
23
+
|[Xinference](https://github.com/xorbitsai/inference)| Built-in audio model specifications for SenseVoiceSmall, Fun-ASR-Nano-2512, and Fun-ASR-MLT-Nano-2512 through Xinference's unified inference API. |[Audio model specifications](https://github.com/xorbitsai/inference/blob/main/xinference/model/audio/model_spec.json) and the FunASR 1.3 compatibility update in merged [#5140](https://github.com/xorbitsai/inference/pull/5140). |
24
+
|[Fun-ASR-vLLM](https://github.com/yuekaizhang/Fun-ASR-vllm)| Community vLLM inference for Fun-ASR-Nano and Fun-ASR-MLT-Nano, including batch evaluation and NVIDIA Triton deployment. |[Setup and benchmarks](https://github.com/yuekaizhang/Fun-ASR-vllm#readme) and the deterministic ASR decoding fix in merged [#20](https://github.com/yuekaizhang/Fun-ASR-vllm/pull/20). |
25
+
|[vad-burn](https://github.com/di-osc/vad-burn)| FSMN VAD inference in pure Rust with Python bindings, including offline, streaming, and CPU-only modes. |[Project README](https://github.com/di-osc/vad-burn#readme) and the FunASR showcase in [#3106](https://github.com/modelscope/FunASR/issues/3106). |
- Follow the upstream project's installation and release notes; do not assume its dependency versions match FunASR `main`.
30
+
- Validate the exact model, language, audio format, and hardware path you plan to deploy.
31
+
- Report application or adapter bugs to the integration project. Report reproducible core FunASR model or runtime bugs to [FunASR issues](https://github.com/modelscope/FunASR/issues).
43
32
44
33
## Add your project
45
34
@@ -48,5 +37,5 @@ If you maintain a FunASR integration, open a [showcase issue](https://github.com
48
37
- repository link and maintenance status
49
38
- supported FunASR model or runtime path
50
39
- install and minimal usage instructions
51
-
- benchmark or validation details when available
40
+
-a merged change, release, benchmark, or other reproducible validation
52
41
- a note about whether the project is official, community-maintained, or experimental
Copy file name to clipboardExpand all lines: docs/use_case_showcase.md
+1Lines changed: 1 addition & 0 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -11,6 +11,7 @@ FunASR is useful far beyond a single offline transcription command. This page co
11
11
| Compare accuracy and speed |[Benchmark report](https://modelscope.github.io/FunASR/benchmark.html)| Reproduce the 184-file long-audio benchmark before choosing a model. |
12
12
| Migrate from Whisper/cloud ASR |[Migration guide](./migration_from_whisper.md)| Map existing pipelines to FunASR, benchmark representative audio, and plan a safe rollout. |
13
13
| Build a private speech API |[OpenAI-compatible API example](../examples/openai_api/), [Gradio browser demo](../examples/openai_api/GRADIO.md), [client recipes](../examples/openai_api/CLIENTS.md), [JavaScript/TypeScript recipes](../examples/openai_api/JAVASCRIPT.md), and [workflow recipes](../examples/openai_api/WORKFLOWS.md)| Reuse LangChain, Dify, n8n, AutoGen, and other OpenAI-style clients without sending audio to a cloud ASR provider. |
14
+
| Reuse an existing integration |[Community integrations](./community_projects.md)| Start from verified upstream paths for voice agents, local assistants, desktop subtitles, model serving, and Rust VAD. |
14
15
| Add speech input to agents |[MCP server](../examples/mcp_server/) and [voice input](../examples/voice_input/)| Connect local ASR to Claude, Cursor, and desktop agent workflows. |
| Serve streaming ASR |[Runtime service docs](../runtime/readme.md)| Run WebSocket or service-mode ASR for live captioning and call-center style workloads. |
0 commit comments