Skip to content

Latest commit

 

History

History
48 lines (42 loc) · 1.01 KB

File metadata and controls

48 lines (42 loc) · 1.01 KB
title DeepInfra
description Configure DeepInfra with Continue to access low-cost inference for open-source models like Mixtral-8x7B-Instruct, including API setup instructions
**Discover Deep Infra models [here](https://continue.dev/deepinfra)** Get an API key from the [Deep Infra](https://deepinfra.com/)

Configuration

```yaml title="config.yaml" name: My Config version: 0.0.1 schema: v1

models: - name: <MODEL_NAME> provider: deepinfra model: <MODEL_ID> apiKey: <YOUR_DEEPINFRA_API_KEY>

</Tab>
<Tab title="JSON (Deprecated)">
```json title="config.json"
{
  "models": [
    {
      "title": "<MODEL_NAME>",
      "provider": "deepinfra",
      "model": "<MODEL_ID>",
      "apiKey": "<YOUR_DEEPINFRA_API_KEY>"
    }
  ]
}
**Check out a more advanced configuration [here](https://continue.dev/deepinfra/qwen-qwen2.5-coder-32b-instruct?view=config)**