Skip to content

Commit a3b3d1f

Browse files
authored
Update docs following removal of providers (#2605)
* Update docs following removal of providers * remove templates * (unrelated) re-generate docs page for inference providers
1 parent 31422c3 commit a3b3d1f

16 files changed

Lines changed: 19 additions & 240 deletions

File tree

docs/inference-providers/_redirects.yml

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -6,3 +6,5 @@ usage: index
66
faq: index
77
rate-limits: pricing
88
guides/vscode: integrations/vscode
9+
providers/hyperbolic: index
10+
providers/sambanova: index

docs/inference-providers/_toctree.yml

Lines changed: 0 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -120,8 +120,6 @@
120120
title: Fireworks
121121
- local: providers/groq
122122
title: Groq
123-
- local: providers/hyperbolic
124-
title: Hyperbolic
125123
- local: providers/hf-inference
126124
title: HF Inference
127125
- local: providers/novita
@@ -134,8 +132,6 @@
134132
title: Public AI
135133
- local: providers/replicate
136134
title: Replicate
137-
- local: providers/sambanova
138-
title: SambaNova
139135
- local: providers/scaleway
140136
title: Scaleway
141137
- local: providers/together

docs/inference-providers/guides/evaluation-inspect-ai.md

Lines changed: 1 addition & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -100,7 +100,7 @@ inspect view
100100
## Example: Comparing several inference providers for a task
101101
In this section, we will evaluate the same model across different providers. Inference Providers gives us access to many providers for the same model. Performance might vary across providers, so this is a useful factor, in addition to speed and cost, to choose the most appropriate inference provider for your task.
102102

103-
If we don't specify a provider, like we did in our previous examples, the system automatically selects the fastest available provider for the specified model (equivalent to the `:fastest` policy). But we can also select the provider by appending the provider name to the model id (e.g. `openai/gpt-oss-120b:sambanova`).
103+
If we don't specify a provider, like we did in our previous examples, the system automatically selects the fastest available provider for the specified model (equivalent to the `:fastest` policy). But we can also select the provider by appending the provider name to the model id (e.g. `openai/gpt-oss-120b:groq`).
104104

105105
Let's run the evaluations for `gpt-oss-120b` across several providers. Please note that this time we are using the `eval_set` function directly in Python for extra flexibility (e.g., changing the list of providers):
106106

@@ -109,12 +109,10 @@ from inspect_ai import eval_set
109109

110110
target_providers = [
111111
"together",
112-
"sambanova",
113112
"groq",
114113
"novita",
115114
"cerebras",
116115
"nscale",
117-
"hyperbolic",
118116
"fireworks-ai",
119117
"scaleway"
120118
]
@@ -139,15 +137,13 @@ Launching the viewer and sorting by score, we can compare the performance across
139137

140138
| Model | Provider | Score |
141139
|-------|----------|-------|
142-
| openai/gpt-oss-120b | hyperbolic | 0.84 |
143140
| openai/gpt-oss-120b | fireworks-ai | 0.82 |
144141
| openai/gpt-oss-120b | nscale | 0.82 |
145142
| openai/gpt-oss-120b | scaleway | 0.81 |
146143
| openai/gpt-oss-120b | together | 0.81 |
147144
| openai/gpt-oss-120b | cerebras | 0.8 |
148145
| openai/gpt-oss-120b | novita | 0.8 |
149146
| openai/gpt-oss-120b | groq | 0.8 |
150-
| openai/gpt-oss-120b | sambanova | 0.8 |
151147

152148
> [!TIP]
153149
> **Why performance varies across providers**: As seen above, the same model can produce different results when served by different inference providers due to several factors: variations in inference implementations, differences in hardware (GPU generations, optimizations), and non-determinism introduced by load balancing and batching strategies. Performance can vary across the matrix of provider-model combinations and may change with updates to inference stacks, GPU generations, and model versions. Evaluating across multiple providers helps identify the best-performing combinations for your specific use case.

docs/inference-providers/guides/function-calling.md

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -304,7 +304,6 @@ client = OpenAI(
304304
client.chat.completions.create(
305305
- model="deepseek-ai/DeepSeek-R1-0528", # automatically selects the fastest available provider
306306
+ model="deepseek-ai/DeepSeek-R1-0528:novita", # manually select Novita
307-
+ model="deepseek-ai/DeepSeek-R1-0528:hyperbolic", # manually select Hyperbolic
308307
...
309308
)
310309
```

docs/inference-providers/hub-api.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -31,8 +31,8 @@ It can be combined with other filters to e.g. select only `text-to-image` models
3131
Pass a comma-separated list of providers to select multiple:
3232

3333
```sh
34-
# List image-text-to-text models served by Novita or Sambanova
35-
~ curl -s https://huggingface.co/api/models?inference_provider=sambanova,novita&pipeline_tag=image-text-to-text | jq ".[].id"
34+
# List image-text-to-text models served by Novita or Nscale
35+
~ curl -s https://huggingface.co/api/models?inference_provider=nscale,novita&pipeline_tag=image-text-to-text | jq ".[].id"
3636
"meta-llama/Llama-3.2-11B-Vision-Instruct"
3737
"meta-llama/Llama-3.2-90B-Vision-Instruct"
3838
"Qwen/Qwen2-VL-72B-Instruct"

docs/inference-providers/index.md

Lines changed: 10 additions & 12 deletions
Original file line numberDiff line numberDiff line change
@@ -48,13 +48,11 @@ Our platform integrates with leading AI infrastructure providers, giving you acc
4848
| [Fireworks](./providers/fireworks-ai) ||| | | | |
4949
| [Groq](./providers/groq) ||| | | | |
5050
| [HF Inference](./providers/hf-inference) ||||| ||
51-
| [Hyperbolic](./providers/hyperbolic) ||| | | | |
5251
| [Novita](./providers/novita) ||| | || |
5352
| [Nscale](./providers/nscale) ||| || | |
5453
| [OVHcloud AI Endpoints](./providers/ovhcloud)||| | | | |
5554
| [Public AI](./providers/publicai) || | | | | |
5655
| [Replicate](./providers/replicate) | | | ||||
57-
| [SambaNova](./providers/sambanova) || || | | |
5856
| [Scaleway](./providers/scaleway) || || | | |
5957
| [Together](./providers/together) ||| || | |
6058
| [WaveSpeedAI](./providers/wavespeed) | | | ||| |
@@ -82,7 +80,7 @@ Here's what you can build:
8280
## Key Features
8381

8482
- **🎯 All-in-One API**: A single API for text generation, image generation, document embeddings, NER, summarization, image classification, and more.
85-
- **🔀 Multi-Provider Support**: Easily run models from top-tier providers like fal, Replicate, Sambanova, Together AI, and others.
83+
- **🔀 Multi-Provider Support**: Easily run models from top-tier providers like fal, Replicate, Together AI, and others.
8684
- **🚀 Scalable & Reliable**: Built for high availability and low-latency performance in production environments.
8785
- **🔧 Developer-Friendly**: Simple requests, fast responses, and a consistent developer experience across Python and JavaScript clients.
8886
- **👷 Easy to integrate**: Drop-in replacement for the OpenAI chat completions API.
@@ -135,7 +133,7 @@ By default, our system automatically selects the fastest available provider for
135133

136134
You can change the provider selection policy by appending a policy suffix to the model id: `:cheapest` for the most cost-efficient provider (lowest price per output token), or `:preferred` to follow your preference order in [Inference Provider settings](https://hf.co/settings/inference-providers). For example, `openai/gpt-oss-120b:cheapest`.
137135

138-
You can also select the provider of your choice by appending the provider name to the model id (e.g. `"openai/gpt-oss-120b:sambanova"`).
136+
You can also select the provider of your choice by appending the provider name to the model id (e.g. `"openai/gpt-oss-120b:groq"`).
139137

140138
```python
141139
import os
@@ -166,7 +164,7 @@ By default, our system automatically selects the fastest available provider for
166164

167165
You can change the provider selection policy by appending a policy suffix to the model id: `:cheapest` for the most cost-efficient provider (lowest price per output token), or `:preferred` to follow your preference order in [Inference Provider settings](https://hf.co/settings/inference-providers). For example, `openai/gpt-oss-120b:cheapest`.
168166

169-
You can also select the provider of your choice by appending the provider name to the model id (e.g. `"openai/gpt-oss-120b:sambanova"`).
167+
You can also select the provider of your choice by appending the provider name to the model id (e.g. `"openai/gpt-oss-120b:groq"`).
170168

171169
```python
172170
import os
@@ -198,7 +196,7 @@ By default, our system automatically selects the fastest available provider for
198196

199197
You can change the provider selection policy by appending a policy suffix to the model id: `:cheapest` for the most cost-efficient provider (lowest price per output token), or `:preferred` to follow your preference order in [Inference Provider settings](https://hf.co/settings/inference-providers). For example, `openai/gpt-oss-120b:cheapest`.
200198

201-
You can also select the provider of your choice by appending the provider name to the model id (e.g. `"openai/gpt-oss-120b:sambanova"`).
199+
You can also select the provider of your choice by appending the provider name to the model id (e.g. `"openai/gpt-oss-120b:groq"`).
202200

203201
```python
204202
import os
@@ -246,7 +244,7 @@ By default, our system automatically selects the fastest available provider for
246244

247245
You can change the provider selection policy by appending a policy suffix to the model id: `:cheapest` for the most cost-efficient provider (lowest price per output token), or `:preferred` to follow your preference order in [Inference Provider settings](https://hf.co/settings/inference-providers). For example, `openai/gpt-oss-120b:cheapest`.
248246

249-
You can also select the provider of your choice by appending the provider name to the model id (e.g. `"openai/gpt-oss-120b:sambanova"`).
247+
You can also select the provider of your choice by appending the provider name to the model id (e.g. `"openai/gpt-oss-120b:groq"`).
250248

251249
```js
252250
import { InferenceClient } from "@huggingface/inference";
@@ -276,7 +274,7 @@ By default, our system automatically selects the fastest available provider for
276274

277275
You can change the provider selection policy by appending a policy suffix to the model id: `:cheapest` for the most cost-efficient provider (lowest price per output token), or `:preferred` to follow your preference order in [Inference Provider settings](https://hf.co/settings/inference-providers). For example, `openai/gpt-oss-120b:cheapest`.
278276

279-
You can also select the provider of your choice by appending the provider name to the model id (e.g. `"openai/gpt-oss-120b:sambanova"`).
277+
You can also select the provider of your choice by appending the provider name to the model id (e.g. `"openai/gpt-oss-120b:groq"`).
280278

281279
```javascript
282280
import OpenAI from "openai";
@@ -309,7 +307,7 @@ By default, our system automatically selects the fastest available provider for
309307

310308
You can change the provider selection policy by appending a policy suffix to the model id: `:cheapest` for the most cost-efficient provider (lowest price per output token), or `:preferred` to follow your preference order in [Inference Provider settings](https://hf.co/settings/inference-providers). For example, `openai/gpt-oss-120b:cheapest`.
311309

312-
You can also select the provider of your choice by appending the provider name to the model id (e.g. `"openai/gpt-oss-120b:sambanova"`).
310+
You can also select the provider of your choice by appending the provider name to the model id (e.g. `"openai/gpt-oss-120b:groq"`).
313311

314312
```js
315313
import fetch from "node-fetch";
@@ -348,7 +346,7 @@ By default, our system automatically selects the fastest available provider for
348346

349347
You can change the provider selection policy by appending a policy suffix to the model id: `:cheapest` for the most cost-efficient provider (lowest price per output token), or `:preferred` to follow your preference order in [Inference Provider settings](https://hf.co/settings/inference-providers). For example, `openai/gpt-oss-120b:cheapest`.
350348

351-
You can also select the provider of your choice by appending the provider name to the model id (e.g. `"openai/gpt-oss-120b:sambanova"`).
349+
You can also select the provider of your choice by appending the provider name to the model id (e.g. `"openai/gpt-oss-120b:groq"`).
352350

353351
```bash
354352
curl https://router.huggingface.co/v1/chat/completions \
@@ -440,7 +438,7 @@ const client = new InferenceClient(process.env.HF_TOKEN);
440438
// Explicit provider selection
441439
await client.chatCompletion({
442440
model: "deepseek-ai/DeepSeek-R1",
443-
provider: "sambanova", // Specific provider
441+
provider: "novita", // Specific provider
444442
messages: [{ role: "user", content: "Hello!" }],
445443
});
446444

@@ -466,7 +464,7 @@ client = InferenceClient(token=os.environ["HF_TOKEN"])
466464
# Explicit provider selection
467465
result = client.chat_completion(
468466
model="deepseek-ai/DeepSeek-R1",
469-
provider="sambanova", # Specific provider
467+
provider="novita", # Specific provider
470468
messages=[{"role": "user", "content": "Hello!"}],
471469
)
472470

docs/inference-providers/integrations/vscode.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -19,7 +19,7 @@ Use frontier open LLMs like Kimi K2, DeepSeek V3.1, GLM 4.5 and more in VS Code
1919
## ✨ Why use the Hugging Face provider in Copilot
2020

2121
- Access [SoTA open‑source LLMs](https://huggingface.co/models?pipeline_tag=text-generation&inference_provider=all&sort=trending) with tool calling capabilities.
22-
- Single API to switch between multiple providers like Groq, Cerebras, Together AI, SambaNova, and more.
22+
- Single API to switch between multiple providers like Groq, Cerebras, Together AI, and more.
2323
- Built for high availability (across providers) and low latency.
2424
- Transparent pricing: what the provider charges is what you pay.
2525

docs/inference-providers/providers/fal-ai.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -87,6 +87,6 @@ Find out more about Text To Video [here](../tasks/text-to-video).
8787

8888
<InferenceSnippet
8989
pipeline=text-to-video
90-
providersMapping={ {"fal-ai":{"modelId":"meituan-longcat/LongCat-Video","providerModelId":"fal-ai/longcat-video/text-to-video/480p"} } }
90+
providersMapping={ {"fal-ai":{"modelId":"Wan-AI/Wan2.2-TI2V-5B","providerModelId":"fal-ai/wan/v2.2-5b/text-to-video"} } }
9191
/>
9292

docs/inference-providers/providers/hyperbolic.md

Lines changed: 0 additions & 81 deletions
This file was deleted.

0 commit comments

Comments
 (0)