You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Use `turn_detection.language` for Agora interaction language; it defaults to `en-US`. STT vendor `language` options are serialized under `asr.params` using each provider's own format. If `with_stt()` is omitted, AgentKit defaults to `AresSTT` for global clients and `FengmingSTT` for `Area.CN` clients. Ares does not take a provider language option; AgentKit uses `turn_detection.language` for REST `asr.language`.
111
112
113
+
`AresSTT` and `FengmingSTT` accept an optional `keywords: List[str]` hotword list.
Import the CN-only Qwen helper from `agora_agent.cn`:
169
+
170
+
```python
171
+
from agora_agent.cn import QwenOmni
172
+
```
173
+
163
174
## Avatar Vendors
164
175
165
176
Used with `agent.with_avatar()` in the cascading ASR + LLM + TTS pipeline. Some avatars require specific TTS sample rates — see [Avatar Integration](../guides/avatars.md).
Copy file name to clipboardExpand all lines: docs/guides/regional-routing.md
+4-4Lines changed: 4 additions & 4 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -38,10 +38,10 @@ client = Agora(
38
38
Bind `client` into `Agent(client=client, ...)` and construct vendors directly with SDK classes. The bound client selects `CNAgent` or `GlobalAgent` for IDE hints based on `area`, but does not restrict which vendor classes you can configure.
39
39
If you omit `with_stt()`, AgentKit uses `FengmingSTT` by default for `Area.CN` clients and `AresSTT` for global clients.
Copy file name to clipboardExpand all lines: docs/index.md
+3-3Lines changed: 3 additions & 3 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -17,12 +17,12 @@ The Agora Conversational AI Python SDK lets you build voice-powered AI agents on
17
17
18
18
**Cascading flow** uses ASR -> LLM -> TTS and supports the broadest set of vendor combinations.
19
19
20
-
**MLLM flow** uses a multimodal model such as OpenAI Realtime, Gemini Live, Vertex AI, or xAI Grok for end-to-end audio.
20
+
**MLLM flow** uses a multimodal model such as OpenAI Realtime, Azure OpenAI Realtime, Gemini Live, Vertex AI, xAI Grok, or Qwen Omni for end-to-end audio.
21
21
22
22
## Start here
23
23
24
24
- Start with [Quick Start](./getting-started/quick-start.md). It shows the baseline app-credentials setup and starts a cascading ASR -> LLM -> TTS agent.
25
-
- Use [MLLM Flow](./guides/mllm-flow.md) when your agent uses one realtime multimodal model, such as OpenAI Realtime, Gemini Live, Vertex AI, or xAI Grok.
25
+
- Use [MLLM Flow](./guides/mllm-flow.md) when your agent uses one supported realtime multimodal model.
26
26
- Use [Cascading Flow](./guides/cascading-flow.md) for more examples of the default ASR -> LLM -> TTS flow, including provider-specific configuration.
27
27
28
28
## How the SDK is organized
@@ -46,7 +46,7 @@ The Agora Conversational AI Python SDK lets you build voice-powered AI agents on
46
46
|[AgentSession](./concepts/session.md)| Manage the agent lifecycle |
47
47
|[Vendors](./concepts/vendors.md)| Browse all LLM, TTS, STT, MLLM, and Avatar providers |
48
48
|[Cascading Flow](./guides/cascading-flow.md)| Build an ASR -> LLM -> TTS pipeline |
49
-
|[MLLM Flow](./guides/mllm-flow.md)| Use OpenAI Realtime, Gemini Live, Vertex AI, or xAI Grok for end-to-end audio |
49
+
|[MLLM Flow](./guides/mllm-flow.md)| Use a global or CN realtime multimodal model for end-to-end audio |
50
50
|[Avatars](./guides/avatars.md)| Add a digital avatar with LiveAvatar, Akool, Anam, Generic Avatar, SenseTime, or Spatius |
51
51
|[Regional Routing](./guides/regional-routing.md)| Route requests to the nearest region |
52
52
|[Error Handling](./guides/error-handling.md)| Handle API errors with ApiError |
Copy file name to clipboardExpand all lines: docs/reference/vendors.md
+60-6Lines changed: 60 additions & 6 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -10,17 +10,18 @@ All vendor classes are available from `agora_agent`:
10
10
11
11
<!-- snippet: fragment -->
12
12
```python
13
-
from agora_agent import OpenAI, ElevenLabsTTS, DeepgramTTS, DeepgramSTT, OpenAIRealtime, XaiGrok, GenericAvatar
13
+
from agora_agent import AzureOpenAIRealtime, DeepgramSTT, OpenAI, TypecastTTS
14
+
from agora_agent.cn import QwenOmni
14
15
```
15
16
16
17
## Recommended vendors by area
17
18
18
19
Construct vendors directly from `agora_agent`, then bind a client with `Agent(client=client, ...)`. The bound client selects `CNAgent` or `GlobalAgent` for IDE hints based on `area`, but does not restrict which vendor classes you can configure.
0 commit comments