Skip to content

Commit 923a720

Browse files
dihydroJenoxideCopilotsunbryenhu-do
authored
Auto model with task intent (#61309)
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com> Co-authored-by: Sunbrye Ly <56200261+sunbrye@users.noreply.github.com> Co-authored-by: Nhu Do <nhu-do@github.com>
1 parent ab1abdc commit 923a720

4 files changed

Lines changed: 48 additions & 45 deletions

File tree

content/copilot/concepts/auto-model-selection.md

Lines changed: 45 additions & 39 deletions
Original file line numberDiff line numberDiff line change
@@ -1,8 +1,8 @@
11
---
2-
title: 'About {% data variables.product.prodname_copilot_short %} auto model selection'
2+
title: 'About {% data variables.product.prodname_copilot_short %} {% data variables.copilot.copilot_auto_model_selection_short %}'
33
allowTitleToDifferFromFilename: true
44
shortTitle: 'Auto model selection'
5-
intro: 'Automatically select models for {% data variables.copilot.copilot_chat_short %}, {% data variables.copilot.copilot_cloud_agent %}, and third-party agents.'
5+
intro: 'Automatically select the best model for each task.'
66
product: '{% data variables.copilot.copilot_auto_model_selection_short_cap_a %} is available with all {% data variables.product.prodname_copilot %} plans.'
77
versions:
88
feature: copilot
@@ -13,70 +13,76 @@ category:
1313

1414
## Overview
1515

16-
Experience less rate limiting and reduce the mental load of choosing a model by letting {% data variables.copilot.copilot_auto_model_selection %} choose the best available model on your behalf.
16+
More than just a model picker, {% data variables.copilot.copilot_auto_model_selection_short %} is an intelligent system delivering high quality results, better reliability, and one less decision to make as the model landscape rapidly evolves.
1717

18-
{% data variables.copilot.copilot_auto_model_selection %} intelligently chooses models based on real time system health and model performance. You benefit from:
19-
* Reduced rate limiting
20-
* Lower latency and errors
21-
* Discounted multipliers for paid plans
18+
{% data variables.copilot.copilot_auto_model_selection_short_cap_a %} combines two systems to provide high quality results and better reliability. One system tracks real-time system health and availability, while the other evaluates task complexity. Putting these together, {% data variables.copilot.copilot_auto_model_selection_short %} routes the task to the optimal model.
19+
20+
Routing occurs along natural cache boundaries to avoid additional cache related costs. Switching models mid-session has shown increased cost without ample improvements in quality.
21+
This helps you get more value from {% data variables.product.prodname_copilot_short %} since it matches each task to the model that can solve it most efficiently. That means reserving higher-cost reasoning models for problems that truly need it, while routing straightforward tasks to faster, lower-cost models that still deliver great results.
22+
23+
Benefits of using {% data variables.copilot.copilot_auto_model_selection_short %} include:
24+
* Matching each task to the model that can solve it most efficiently.
25+
* Model choice based on real-time system health and availability.
26+
* Language invariance: Routing decisions depend on what you are trying to do, not what language you're asking in.
27+
* Improved cost efficiency due to intelligent task routing.
28+
29+
### Policies and availability
30+
31+
When you select **Auto**, {% data variables.copilot.copilot_auto_model_selection_short %} chooses from supported models, subject to your policies and subscription type. Available models may change over time. See [AUTOTITLE](/copilot/reference/ai-models/supported-models#supported-ai-models-in-auto-model-selection).
2232

2333
{% data variables.copilot.copilot_auto_model_selection_short_cap_a %} **won't** include these models:
34+
* Models not available in your plan.
2435
* Models excluded by administrator policies. See [AUTOTITLE](/copilot/how-tos/copilot-on-github/set-up-copilot/configure-access-to-ai-models).
25-
* Models with premium request multipliers greater than one. See [AUTOTITLE](/copilot/reference/ai-models/supported-models#model-multipliers).
26-
* Models not available in your plan. See [AUTOTITLE](/copilot/reference/ai-models/supported-models#supported-ai-models-per-copilot-plan).
27-
28-
> [!NOTE] Soon {% data variables.copilot.copilot_auto_model_selection %} will choose the best model for you based on your task.
36+
* Models excluded by policies restricting {% data variables.product.prodname_copilot_short %} to data-resident or FedRAMP-compliant models.
37+
* Models with premium request multipliers greater than one.
2938

3039
### Multiplier discounts
3140

3241
{% data reusables.copilot.auto-model-multiplier-discount %} See [AUTOTITLE](/copilot/concepts/billing/copilot-requests#model-multipliers).
3342

34-
## {% data variables.copilot.copilot_auto_model_selection_short_cap_a %} in {% data variables.copilot.copilot_chat_short %}
43+
## {% data variables.copilot.copilot_auto_model_selection_short_cap_a %} in {% data variables.product.prodname_copilot_short %}
3544

36-
{% data variables.copilot.copilot_auto_model_selection_short_cap_a %} is generally available in the following IDEs:
37-
* {% data variables.product.prodname_vscode_shortname %}
38-
* JetBrains IDEs
45+
{% data variables.copilot.copilot_auto_model_selection_short_cap_a %} is available in these {% data variables.product.prodname_copilot_short %} products:
46+
* {% data variables.copilot.copilot_chat_short %}
47+
* {% data variables.copilot.copilot_cli_short %}
48+
* {% data variables.copilot.copilot_cloud_agent %}
3949

40-
{% data variables.copilot.copilot_auto_model_selection_short_cap_a %} is in public preview for the following IDEs:
41-
* {% data variables.product.prodname_vs %}
42-
* Eclipse
43-
* Xcode
50+
> [!TIP]
51+
> You can see which model was used for each {% data variables.product.prodname_copilot_short %} response.
52+
> * In **{% data variables.copilot.copilot_chat_short %}**, hover over the response.
53+
> * In **{% data variables.copilot.copilot_cli_short %}**, the model used for each response displays in the terminal.
54+
> * In **{% data variables.copilot.copilot_cloud_agent %}**, the model used for each response displays at the end of the response.
4455
45-
When you select **Auto** in {% data variables.copilot.copilot_chat_short %} in IDEs, {% data variables.copilot.copilot_auto_model_selection_short_cap_a %} chooses from the supported models, subject to your policies and subscription type. Models may change over time. See [AUTOTITLE](/copilot/reference/ai-models/supported-models#supported-ai-models-in-auto-model-selection).
56+
### {% data variables.copilot.copilot_chat_short %} in IDEs
4657

47-
> [!TIP] To see which model was used for each response, hover over the response in {% data variables.copilot.copilot_chat_short %} in IDEs.
58+
{% data variables.copilot.copilot_auto_model_selection_short_cap_a %} with task selection is in public preview in the following IDEs:
59+
* {% data variables.product.prodname_vscode_shortname %}
4860

49-
{% data reusables.copilot.change-the-ai-model %}
61+
{% data variables.copilot.copilot_auto_model_selection_short_cap_a %} (without task selection) is available in the following IDEs:
62+
* JetBrains IDEs
63+
* Eclipse
64+
* Xcode
65+
* {% data variables.product.prodname_vs %}
5066

51-
### Enabling access during {% data variables.release-phases.public_preview %}
67+
#### Enabling access during {% data variables.release-phases.public_preview %}
5268

5369
During the {% data variables.release-phases.public_preview %}, if you're using a {% data variables.copilot.copilot_business_short %} or {% data variables.copilot.copilot_enterprise_short %} plan, the organization or enterprise that provides your plan must have the **Editor preview features** policy enabled. See [AUTOTITLE](/enterprise-cloud@latest/copilot/managing-copilot/managing-github-copilot-in-your-organization/managing-policies-for-copilot-in-your-organization#enabling-copilot-features-in-your-organization) or [AUTOTITLE](/enterprise-cloud@latest/copilot/managing-copilot/managing-copilot-for-your-enterprise/managing-policies-and-features-for-copilot-in-your-enterprise#copilot-in-githubcom).
5470

55-
## {% data variables.copilot.copilot_auto_model_selection_short_cap_a %} in {% data variables.copilot.copilot_cli %}
56-
57-
When you select **Auto** from the list of available models in {% data variables.copilot.copilot_cli %}, {% data variables.copilot.copilot_auto_model_selection_short_cap_a %} chooses from the supported models, subject to your policies and subscription type. Models may change over time. See [AUTOTITLE](/copilot/reference/ai-models/supported-models#supported-ai-models-in-auto-model-selection).
58-
59-
When using Auto, the model used for each response displays in the terminal.
60-
61-
{% data reusables.copilot.change-the-ai-model %}
62-
63-
## {% data variables.copilot.copilot_auto_model_selection_short_cap_a %} in {% data variables.copilot.copilot_cloud_agent %}
64-
65-
When you select **Auto** in {% data variables.copilot.copilot_cloud_agent %}, {% data variables.copilot.copilot_auto_model_selection_short_cap_a %} chooses from the supported list of models, subject to your policies and subscription type. See [AUTOTITLE](/copilot/reference/ai-models/supported-models#supported-ai-models-in-auto-model-selection).
71+
## {% data variables.copilot.copilot_auto_model_selection_short_cap_a %} in third-party agents
6672

67-
{% data reusables.copilot.change-the-ai-model-copilot-cloud-agent %}
73+
When you select **Auto** in the {% data variables.product.prodname_openai_codex %} or {% data variables.product.prodname_anthropic_claude %} coding agents, {% data variables.copilot.copilot_auto_model_selection_short_cap_a %} chooses from the supported list of models, subject to your policies and subscription type.
6874

69-
## {% data variables.copilot.copilot_auto_model_selection_short_cap_a %} in {% data variables.product.prodname_openai_codex %}
75+
### {% data variables.product.prodname_openai_codex %} supported models
7076

71-
When you select **Auto** in the {% data variables.product.prodname_openai_codex %} coding agent, {% data variables.copilot.copilot_auto_model_selection_short_cap_a %} currently chooses from the following list of models, subject to your policies and subscription type:
77+
These models are available for {% data variables.copilot.copilot_auto_model_selection_short_cap_a %} in the {% data variables.product.prodname_openai_codex %} coding agent.
7278

7379
{% data reusables.copilot.openai-codex-agent-models %}
7480

7581
For more information, see [AUTOTITLE](/copilot/concepts/agents/openai-codex).
7682

77-
## {% data variables.copilot.copilot_auto_model_selection_short_cap_a %} in {% data variables.product.prodname_anthropic_claude %}
83+
### {% data variables.product.prodname_anthropic_claude %} supported models
7884

79-
When you select **Auto** in the {% data variables.product.prodname_anthropic_claude %} coding agent, {% data variables.copilot.copilot_auto_model_selection_short_cap_a %} currently chooses from the following list of models, subject to your policies and subscription type:
85+
These models are available for {% data variables.copilot.copilot_auto_model_selection_short_cap_a %} in the {% data variables.product.prodname_anthropic_claude %} coding agent.
8086

8187
{% data reusables.copilot.anthropic-claude-agent-models %}
8288

content/copilot/reference/ai-models/supported-models.md

Lines changed: 1 addition & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -47,7 +47,7 @@ This table lists the AI models available in {% data variables.product.prodname_c
4747

4848
## Supported AI models in {% data variables.copilot.copilot_auto_model_selection_short_cap_a %}
4949

50-
This table lists the supported AI models for {% data variables.copilot.copilot_auto_model_selection_short_cap_a %}. Available models may be limited by model policies, including policies restricting {% data variables.product.prodname_copilot_short %} to data-resident or FedRAMP-compliant models.
50+
This table lists the supported AI models for {% data variables.copilot.copilot_auto_model_selection_short_cap_a %}. Available models may be limited by model policies. See [AUTOTITLE](/copilot/concepts/auto-model-selection).
5151

5252
{% rowheaders %}
5353

@@ -77,9 +77,6 @@ The following table lists AI models that are retired or scheduled for retirement
7777

7878
The following table shows which models are available in each client.
7979

80-
> [!NOTE]
81-
> {% data reusables.copilot.auto-model-selection %}
82-
8380
{% rowheaders %}
8481

8582
| Model | {% data variables.product.prodname_dotcom_the_website %} | {% data variables.copilot.copilot_cli_short %} | {% data variables.product.prodname_vscode %} | {% data variables.product.prodname_vs %} | Eclipse | Xcode | JetBrains IDEs |
Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1 +1 @@
1-
When you use {% data variables.copilot.copilot_chat_short %} in supported IDEs, **Auto** will automatically select the best model for you based on availability. You can manually choose a different model to override this selection. See [AUTOTITLE](/copilot/concepts/auto-model-selection) and [AUTOTITLE](/copilot/how-tos/use-ai-models/change-the-chat-model?tool=vscode).
1+
When you use {% data variables.copilot.copilot_chat_short %} in supported IDEs, **Auto** will automatically select the best model for you based on availability. You can manually choose a different model to override this selection. See [AUTOTITLE](/copilot/concepts/auto-model-selection).
Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1 +1 @@
1-
You can change the model {% data variables.product.prodname_copilot_short %} uses to generate responses to chat prompts. You may find that different models perform better, or provide more useful responses, depending on the type of questions you ask. Options include premium models with advanced capabilities. See [AUTOTITLE](/copilot/using-github-copilot/ai-models/changing-the-ai-model-for-copilot-chat).
1+
You can change the model {% data variables.product.prodname_copilot_short %} uses to generate responses. You may find that different models perform better, or provide more useful responses, depending on the type of questions you ask. Options include premium models with advanced capabilities.

0 commit comments

Comments
 (0)