You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
| Ollama |`"openai"`| Local models via OpenAI-compatible API |
13
+
| Microsoft Foundry Local |`"openai"`| Run AI models locally on your device via OpenAI-compatible API |
13
14
| Other OpenAI-compatible |`"openai"`| vLLM, LiteLLM, etc. |
14
15
15
16
## Quick Start: Azure AI Foundry
@@ -250,6 +251,36 @@ provider: {
250
251
}
251
252
```
252
253
254
+
### Microsoft Foundry Local
255
+
256
+
[Microsoft Foundry Local](https://foundrylocal.ai) lets you run AI models locally on your own device with an OpenAI-compatible API. Install it via the Foundry Local CLI, then point the SDK at your local endpoint:
257
+
258
+
```typescript
259
+
provider: {
260
+
type: "openai",
261
+
baseUrl: "http://localhost:<PORT>/v1",
262
+
// No apiKey needed for local Foundry Local
263
+
}
264
+
```
265
+
266
+
> **Note:** Foundry Local starts on a **dynamic port** — the port is not fixed. Use `foundry service status` to confirm the port the service is currently listening on, then use that port in your `baseUrl`.
267
+
268
+
To get started with Foundry Local:
269
+
270
+
```bash
271
+
# Install Foundry Local CLI
272
+
winget install Microsoft.FoundryLocal
273
+
274
+
# List available models
275
+
foundry model list
276
+
277
+
# Run a model (starts the local server automatically)
278
+
foundry model run phi-4-mini
279
+
280
+
# Check the port the service is running on
281
+
foundry service status
282
+
```
283
+
253
284
### Anthropic
254
285
255
286
```typescript
@@ -305,6 +336,7 @@ Some Copilot features may behave differently with BYOK:
305
336
|----------|-------------|
306
337
| Azure AI Foundry | No Entra ID auth; must use API keys |
307
338
| Ollama | No API key; local only; model support varies |
339
+
|[Microsoft Foundry Local](https://foundrylocal.ai)| Local only; model availability depends on device hardware; no API key required |
308
340
| OpenAI | Subject to OpenAI rate limits and quotas |
0 commit comments