Skip to content

available-models.md

Latest commit

 

History

History
120 lines (81 loc) · 5.39 KB

available-models.md

File metadata and controls

120 lines (81 loc) · 5.39 KB

Available Models

DOS AI serves high-quality open-source LLMs via an OpenAI-compatible API. Self-hosted models run on dedicated RTX Pro 6000 GPUs with 96 GB VRAM in Asia-Southeast 1. Cloud models are served via partner providers for maximum coverage.

Smart Routing

Use dos-auto as the model ID to let DOS AI automatically select the best model for each request. Smart routing uses a 15-dimension classifier to analyze your prompt and route to the optimal model based on task complexity, cost, and latency.

response = client.chat.completions.create(
    model="dos-auto",  # Smart routing picks the best model
    messages=[{"role": "user", "content": "..."}],
)

Model Catalog

Self-Hosted (Lowest Latency)

Model Provider Context Input Output Model ID
Qwen3.5-35B-A3B Alibaba 128K $0.15 / 1M $0.15 / 1M dos-ai

Cloud Models

Model Provider Context Input Output Model ID
Llama 4 Maverick 17B-128E Meta / DeepInfra 1M $0.17 / 1M $0.66 / 1M llama-4-maverick
Llama 4 Scout 17B-16E Meta / DeepInfra 640K $0.11 / 1M $0.38 / 1M llama-4-scout
DeepSeek V3 DeepSeek 128K $0.25 / 1M $0.25 / 1M deepseek-v3
Llama 3.3 70B Meta 128K $0.20 / 1M $0.20 / 1M llama-3.3-70b
Llama 3.1 8B Meta 128K $0.05 / 1M $0.05 / 1M llama-3.1-8b

All prices are in USD. The catalog is DB-driven -- new models are added regularly. Check GET /v1/catalog or the dashboard for the latest list. See Pricing for billing details.

Embedding Models

Model Provider Dimensions Model ID
Qwen3-Embedding-4B AWQ Alibaba / Self-hosted 2560 qwen3-embedding-4b

Model Details

Qwen3.5-35B-A3B (default)

Alibaba's Mixture-of-Experts model with 35 billion total parameters and 3 billion active parameters per forward pass. This architecture delivers excellent quality at remarkably low cost and latency, making it our recommended default model for most use cases.

  • Best for: General-purpose chat, code generation, reasoning, multilingual tasks
  • Strengths: Outstanding cost-efficiency, fast response times, strong multilingual support (especially CJK languages)
  • Model ID: dos-ai

Llama 4 Maverick 17B-128E

Meta's latest Mixture-of-Experts model with 17 billion active parameters and 128 experts. Strong reasoning and multilingual capabilities with an industry-leading 1 million token context window.

  • Best for: Complex reasoning, long-context analysis, multilingual tasks
  • Strengths: Massive context window, strong benchmark scores, efficient MoE architecture
  • Model ID: llama-4-maverick

Llama 4 Scout 17B-16E

Meta's efficient MoE model with 17 billion active parameters and 16 experts. Fast and cost-effective for everyday tasks with a 640K context window.

  • Best for: Everyday tasks, fast responses, cost-sensitive workloads
  • Strengths: Good balance of speed and quality, large context window
  • Model ID: llama-4-scout

DeepSeek V3

DeepSeek's latest Mixture-of-Experts model, known for strong performance across coding, math, and reasoning benchmarks.

  • Best for: Code generation, mathematical reasoning, structured output
  • Strengths: Competitive benchmark scores, good at structured/JSON output, strong code capabilities
  • Model ID: deepseek-v3

Llama 3.3 70B

Meta's 70-billion-parameter dense model. Offers top-tier reasoning and instruction-following capabilities.

  • Best for: Complex reasoning, long-form content, detailed analysis
  • Strengths: Strong English performance, excellent instruction following, robust safety tuning
  • Model ID: llama-3.3-70b

Llama 3.1 8B

Meta's efficient 8-billion-parameter model. An excellent choice when you need fast, affordable responses and the task does not require the full capability of a larger model.

  • Best for: Simple tasks, high-throughput workloads, prototyping, cost-sensitive applications
  • Strengths: Very low latency, lowest cost, suitable for classification and extraction tasks
  • Model ID: llama-3.1-8b

Choosing the Right Model

Use Case Recommended Model Why
Let DOS AI decide dos-auto Smart routing picks the best model per request
General assistant / chatbot Qwen3.5-35B-A3B Best balance of quality, speed, and cost
Long-context analysis (100K+ tokens) Llama 4 Maverick 1M context window, strong reasoning
Complex reasoning / analysis Llama 3.3 70B Dense model, top reasoning capability
Code generation / math DeepSeek V3 Top coding and math benchmark scores
High-volume / low-cost tasks Llama 3.1 8B Fastest and cheapest option
Multilingual (CJK languages) Qwen3.5-35B-A3B Superior CJK language performance

Listing Models via API

You can retrieve the current list of available models programmatically:

curl https://api.dos.ai/v1/models \
  -H "Authorization: Bearer YOUR_API_KEY"

For the full retail catalog with pricing and metadata:

curl https://api.dos.ai/v1/catalog \
  -H "Authorization: Bearer YOUR_API_KEY"

See the Models API reference for the full response schema.