You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Add DeepSeek V3.1 model to inference guide (#1553)
## Summary
This PR adds the DeepSeek V3.1 model to the list of available models in
the W&B Inference guide.
## Changes
- Added DeepSeek V3.1 to the models table in
`content/en/guides/inference/models.md`
## Model Details
- **Model ID**: `deepseek-ai/DeepSeek-V3.1`
- **Type**: Text
- **Context Window**: 128K
- **Size**: 37B-671B (Active-Total)
- **Description**: A large hybrid model that supports both thinking and
non-thinking modes via prompt templates
This addition helps users discover and utilize the DeepSeek V3.1 model
in their W&B Inference workflows.
<!-- preview-links-comment -->
📄 **[View preview links for changed
content](#1553 (comment)
| OpenAI GPT OSS 120B |`openai/gpt-oss-120b`| Text | 131,000 | 5.1B-117B (Active-Total) | Efficient Mixture-of-Experts model designed for high-reasoning, agentic and general-purpose use cases. |
15
-
| OpenAI GPT OSS 20B |`openai/gpt-oss-20b`| Text | 131,000 | 3.6B-20B (Active-Total) | Lower latency Mixture-of-Experts model trained on OpenAI's Harmony response format with reasoning capabilities. |
16
-
| Qwen3 235B A22B Thinking-2507 |`Qwen/Qwen3-235B-A22B-Thinking-2507`| Text | 262K | 22B-235B (Active-Total) | High-performance Mixture-of-Experts model optimized for structured reasoning, math, and long-form generation |
| Qwen3 Coder 480B A35B |`Qwen/Qwen3-Coder-480B-A35B-Instruct`| Text | 262K | 35B-480B (Active-Total) | Mixture-of-Experts model optimized for coding tasks such as function calling, tooling use, and long-context reasoning |
19
-
| MoonshotAI Kimi K2 |`moonshotai/Kimi-K2-Instruct`| Text | 128K | 32B-1T (Active-Total) | Mixture-of-Experts model optimized for complex tool use, reasoning, and code synthesis |
20
14
| DeepSeek R1-0528 |`deepseek-ai/DeepSeek-R1-0528`| Text | 161K | 37B-680B (Active-Total) | Optimized for precise reasoning tasks including complex coding, math, and structured document analysis |
21
15
| DeepSeek V3-0324 |`deepseek-ai/DeepSeek-V3-0324`| Text | 161K | 37B-680B (Active-Total) | Robust Mixture-of-Experts model tailored for high-complexity language processing and comprehensive document analysis |
16
+
| DeepSeek V3.1 |`deepseek-ai/DeepSeek-V3.1`| Text | 128K | 37B-671B (Active-Total) | A large hybrid model that supports both thinking and non-thinking modes via prompt templates |
22
17
| Meta Llama 3.1 8B |`meta-llama/Llama-3.1-8B-Instruct`| Text | 128K | 8B (Total) | Efficient conversational model optimized for responsive multilingual chatbot interactions |
23
18
| Meta Llama 3.3 70B |`meta-llama/Llama-3.3-70B-Instruct`| Text | 128K | 70B (Total) | Multilingual model excelling in conversational tasks, detailed instruction-following, and coding |
24
19
| Meta Llama 4 Scout |`meta-llama/Llama-4-Scout-17B-16E-Instruct`| Text, Vision | 64K | 17B-109B (Active-Total) | Multi-modal model integrating text and image understanding, ideal for visual tasks and combined analysis |
25
20
| Microsoft Phi 4 Mini 3.8B |`microsoft/Phi-4-mini-instruct`| Text | 128K | 3.8B (Active-Total) | Compact, efficient model ideal for fast responses in resource-constrained environments |
21
+
| MoonshotAI Kimi K2 |`moonshotai/Kimi-K2-Instruct`| Text | 128K | 32B-1T (Active-Total) | Mixture-of-Experts model optimized for complex tool use, reasoning, and code synthesis |
22
+
| OpenAI GPT OSS 20B |`openai/gpt-oss-20b`| Text | 131K | 3.6B-20B (Active-Total) | Lower latency Mixture-of-Experts model trained on OpenAI's Harmony response format with reasoning capabilities. |
23
+
| OpenAI GPT OSS 120B |`openai/gpt-oss-120b`| Text | 131K | 5.1B-117B (Active-Total) | Efficient Mixture-of-Experts model designed for high-reasoning, agentic and general-purpose use cases. |
24
+
| Qwen3 235B A22B Thinking-2507 |`Qwen/Qwen3-235B-A22B-Thinking-2507`| Text | 262K | 22B-235B (Active-Total) | High-performance Mixture-of-Experts model optimized for structured reasoning, math, and long-form generation |
| Qwen3 Coder 480B A35B |`Qwen/Qwen3-Coder-480B-A35B-Instruct`| Text | 262K | 35B-480B (Active-Total) | Mixture-of-Experts model optimized for coding tasks such as function calling, tooling use, and long-context reasoning |
0 commit comments