Utility models (#61281)

Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>

Author: isaacmbrown

content/copilot/concepts/index.md

@@ -13,15 +13,14 @@ children:
   - /prompting
   - /context
   - /tools
-  - /auto-model-selection
+  - /models
   - /usage-limits
   - /billing
   - /about-enterprise-accounts-for-copilot-business
   - /policies
   - /mcp-management
-  - /fedramp-models
   - /network-settings
-  - /fallback-and-lts-models
   - /preparing-for-new-features-and-models
 contentType: concepts
 ---
+

…copilot/concepts/auto-model-selection.md …/concepts/models/auto-model-selection.mdcontent/copilot/concepts/auto-model-selection.md renamed to content/copilot/concepts/models/auto-model-selection.md content/copilot/concepts/auto-model-selection.md renamed to content/copilot/concepts/models/auto-model-selection.md

@@ -7,8 +7,10 @@ product: '{% data variables.copilot.copilot_auto_model_selection_short_cap_a %}
 versions:
   feature: copilot
 contentType: concepts
-category: 
+category:
   - Learn about Copilot
+redirect_from:
+  - /copilot/concepts/auto-model-selection
 ---
 
 ## Overview
@@ -17,14 +19,14 @@ More than just a model picker, {% data variables.copilot.copilot_auto_model_sele
 
 ### Auto with task optimization
 
-> [!NOTE] {% data variables.copilot.copilot_auto_model_selection_short_cap_a %} with task optimization is generally available in {% data variables.copilot.copilot_chat_short %} in {% data variables.product.prodname_vscode_shortname %}. 
+> [!NOTE] {% data variables.copilot.copilot_auto_model_selection_short_cap_a %} with task optimization is generally available in {% data variables.copilot.copilot_chat_short %} in {% data variables.product.prodname_vscode_shortname %}.
 
 {% data variables.copilot.copilot_auto_model_selection_short_cap_a %} with task optimization combines two systems to provide high quality results and better reliability. One system tracks real-time system health and availability, while the other evaluates task complexity. Putting these together, {% data variables.copilot.copilot_auto_model_selection_short %} routes the task to the optimal model.
 
-Routing occurs along natural cache boundaries to avoid additional cache related costs. Switching models mid-session has shown increased cost without ample improvements in quality. 
+Routing occurs along natural cache boundaries to avoid additional cache related costs. Switching models mid-session has shown increased cost without ample improvements in quality.
 This helps you get more value from {% data variables.product.prodname_copilot_short %} since it matches each task to the model that can solve it most efficiently. That means reserving higher-cost reasoning models for problems that truly need it, while routing straightforward tasks to faster, lower-cost models that still deliver great results.
 
-Benefits of using {% data variables.copilot.copilot_auto_model_selection_short %} include: 
+Benefits of using {% data variables.copilot.copilot_auto_model_selection_short %} include:
 * Matching each task to the model that can solve it most efficiently.
 * Model choice based on real-time system health and availability.
 * Language invariance: Routing decisions depend on what you are trying to do, not what language you're asking in.
@@ -46,36 +48,36 @@ When you select **Auto**, {% data variables.copilot.copilot_auto_model_selection
 * Models not available in your plan.
 * Models excluded by administrator policies. See [AUTOTITLE](/copilot/how-tos/copilot-on-github/set-up-copilot/configure-access-to-ai-models).
 * Models excluded by policies restricting {% data variables.product.prodname_copilot_short %} to data-resident or FedRAMP-compliant models.
-* Models with premium request multipliers greater than one. 
+* Models with premium request multipliers greater than one.
 
 ### Multiplier discounts
 
 {% data reusables.copilot.auto-model-multiplier-discount %} See [AUTOTITLE](/copilot/concepts/billing/copilot-requests#model-multipliers).
 
 ## {% data variables.copilot.copilot_auto_model_selection_short_cap_a %} in {% data variables.product.prodname_copilot_short %}
 
-{% data variables.copilot.copilot_auto_model_selection_short_cap_a %}, optimized for model reliability and availability, is available in these {% data variables.product.prodname_copilot_short %} products: 
+{% data variables.copilot.copilot_auto_model_selection_short_cap_a %}, optimized for model reliability and availability, is available in these {% data variables.product.prodname_copilot_short %} products:
 * {% data variables.copilot.copilot_chat_short %}
 * {% data variables.copilot.copilot_cli_short %}
-* {% data variables.copilot.copilot_cloud_agent %} 
+* {% data variables.copilot.copilot_cloud_agent %}
 
 > [!TIP]
 > You can see which model was used for each {% data variables.product.prodname_copilot_short %} response.
 > * In **{% data variables.copilot.copilot_chat_short %}**, hover over the response.
 > * In **{% data variables.copilot.copilot_cli_short %}**, the model used for each response displays in the terminal.
-> * In **{% data variables.copilot.copilot_cloud_agent %}**, the model used for each response displays at the end of the response. 
+> * In **{% data variables.copilot.copilot_cloud_agent %}**, the model used for each response displays at the end of the response.
 
 ### {% data variables.copilot.copilot_chat_short %} in IDEs
 
-{% data variables.copilot.copilot_auto_model_selection_short_cap_a %}, with task optimization, is generally available in the following IDEs: 
+{% data variables.copilot.copilot_auto_model_selection_short_cap_a %}, with task optimization, is generally available in the following IDEs:
   * {% data variables.product.prodname_vscode_shortname %}
 
 {% data variables.copilot.copilot_auto_model_selection_short_cap_a %}, optimized for model reliability and availability, is generally available in the following IDEs:
   * JetBrains IDEs
   * Eclipse
   * Xcode
 
-{% data variables.copilot.copilot_auto_model_selection_short_cap_a %}, optimized for model reliability and availability, is in public preview in the following IDEs: 
+{% data variables.copilot.copilot_auto_model_selection_short_cap_a %}, optimized for model reliability and availability, is in public preview in the following IDEs:
   * {% data variables.product.prodname_vs %}
 
 #### Enabling access during {% data variables.release-phases.public_preview %}
@@ -88,15 +90,15 @@ When you select **Auto** in the {% data variables.product.prodname_openai_codex
 
 ### {% data variables.product.prodname_openai_codex %} supported models
 
-These models are available for {% data variables.copilot.copilot_auto_model_selection_short_cap_a %} in the {% data variables.product.prodname_openai_codex %} coding agent. 
+These models are available for {% data variables.copilot.copilot_auto_model_selection_short_cap_a %} in the {% data variables.product.prodname_openai_codex %} coding agent.
 
 {% data reusables.copilot.openai-codex-agent-models %}
 
 For more information, see [AUTOTITLE](/copilot/concepts/agents/openai-codex).
 
 ### {% data variables.product.prodname_anthropic_claude %} supported models
 
-These models are available for {% data variables.copilot.copilot_auto_model_selection_short_cap_a %} in the {% data variables.product.prodname_anthropic_claude %} coding agent. 
+These models are available for {% data variables.copilot.copilot_auto_model_selection_short_cap_a %} in the {% data variables.product.prodname_anthropic_claude %} coding agent.
 
 {% data reusables.copilot.anthropic-claude-agent-models %}
 

…ilot/concepts/fallback-and-lts-models.md …ncepts/models/fallback-and-lts-models.mdcontent/copilot/concepts/fallback-and-lts-models.md renamed to content/copilot/concepts/models/fallback-and-lts-models.md content/copilot/concepts/fallback-and-lts-models.md renamed to content/copilot/concepts/models/fallback-and-lts-models.md

@@ -1,13 +1,15 @@
 ---
 title: Base and long-term support (LTS) models
 shortTitle: Base and LTS models
-intro: 'Learn about base models, long-term support (LTS) models, and how they affect model availability for enterprises using {% data variables.product.prodname_copilot %}.'
+intro: Learn about base models, long-term support (LTS) models, and how they affect model availability for enterprises using {% data variables.product.prodname_copilot %}.
 versions:
   feature: copilot
 allowTitleToDifferFromFilename: true
 contentType: concepts
 category:
   - Manage Copilot for a team
+redirect_from:
+  - /copilot/concepts/fallback-and-lts-models
 ---
 
 ## About base models

…ntent/copilot/concepts/fedramp-models.md …opilot/concepts/models/fedramp-models.mdcontent/copilot/concepts/fedramp-models.md renamed to content/copilot/concepts/models/fedramp-models.md content/copilot/concepts/fedramp-models.md renamed to content/copilot/concepts/models/fedramp-models.md

@@ -1,11 +1,13 @@
 ---
 title: FedRAMP-compliant models for GitHub Copilot
 shortTitle: FedRAMP models
-intro: "Restrict users to models with FedRAMP Moderate certification."
+intro: Restrict users to models with FedRAMP Moderate certification.
 versions:
   feature: copilot
 product: '{% data variables.enterprise.data_residency %}'
 contentType: concepts
+redirect_from:
+  - /copilot/concepts/fedramp-models
 ---
 
 If your enterprise uses {% data variables.enterprise.data_residency %} in the US, you can enable a policy to ensure that users on your {% data variables.product.prodname_copilot_short %} plan can only use models with **FedRAMP Moderate** certification.
@@ -34,4 +36,4 @@ Enabling the FedRAMP policy restricts users to the following models:
 
 To enable this policy, use the **Restrict {% data variables.product.prodname_copilot_short %} to FedRAMP models** policy in the "Features" section of your enterprise's {% data variables.product.prodname_copilot_short %} policies. This policy is disabled by default, and enabling it will affect your pricing for {% data variables.product.prodname_copilot_short %} requests.
 
-For instructions on finding your policies page, see [AUTOTITLE](/copilot/how-tos/administer-copilot/manage-for-enterprise/manage-enterprise-policies).
+For instructions on finding your policies page, see [AUTOTITLE](/copilot/how-tos/administer-copilot/manage-for-enterprise/manage-enterprise-policies).

content/copilot/concepts/models/index.md

@@ -0,0 +1,14 @@
+---
+title: Models for GitHub Copilot
+shortTitle: Models
+intro: Learn about the AI models available for {% data variables.product.prodname_copilot %}.
+versions:
+  feature: copilot
+contentType: concepts
+children:
+  - /utility-models
+  - /auto-model-selection
+  - /fedramp-models
+  - /fallback-and-lts-models
+---
+

content/copilot/concepts/models/utility-models.md

@@ -0,0 +1,24 @@
+---
+title: Utility models
+intro: 'Utility models power background {% data variables.product.prodname_copilot_short %} features.'
+versions:
+  feature: copilot
+contentType: concepts
+---
+
+Utility models are a small set of models that are automatically enabled for all {% data variables.product.prodname_copilot %} users across every plan. They power background features such as the generation of commit messages or chat session titles, and they apply across {% data variables.product.prodname_copilot_short %} surfaces: in IDEs, on {% data variables.product.github %}, and in {% data variables.copilot.copilot_cli_short %}.
+
+## How do utility models work?
+
+Utility models:
+
+* Are **not** visible in the model picker and cannot be selected by users directly.
+* **Cannot** be disabled by organization or enterprise administrators, except by disabling {% data variables.product.prodname_copilot_short %} completely.
+* Do **not** consume premium request units or tokens for usage-based billing, and do **not** appear as a billed line item in usage reports.
+* **Are** subject to per-user rate limits.
+
+These characteristics ensure that {% data variables.product.prodname_copilot_short %} features work smoothly regardless of your model policies and billing controls.
+
+## List of utility models
+
+Utility models are typically selected for being fast and lightweight. {% data reusables.copilot.utility-models %}

content/copilot/concepts/preparing-for-new-features-and-models.md

@@ -54,18 +54,21 @@ You can find information about the models available and upcoming models in the f
 * **Model comparison**: To compare model capabilities side by side, see [AUTOTITLE](/copilot/reference/ai-models/model-comparison).
 * **Changelog**: Model updates are announced in the [{% data variables.product.prodname_copilot_short %} changelog](https://github.blog/changelog/label/copilot/).
 
-To plan for model transitions and set user expectations, track which models {% data variables.product.github %} designates as base or long-term support (LTS):
+#### Special categories
+
+{% data variables.product.company_short %} categorizes certain types of model, allowing you to plan for model transitions and set user expectations.
 
 {% rowheaders %}
 
 | Model type | Description | Why it matters |
 | --- | --- | --- |
+| Utility model | A small set of models that power background {% data variables.product.company_short %} features across surfaces. | Your enterprise cannot disable these models. Monitor these to ensure they are compliant. |
 | Base model | The default model when no other models are enabled. | Automatically enabled within 60 days of designation. |
 | LTS model | A model supported for one year from designation. | Allows enterprises to build workflows around a stable model. |
 
 {% endrowheaders %}
 
-For more information, see [AUTOTITLE](/copilot/concepts/fallback-and-lts-models).
+For more information, see [AUTOTITLE](/copilot/concepts/models/utility-models) and [AUTOTITLE](/copilot/concepts/models/fallback-and-lts-models).
 
 ## Considering different release stages
 

content/copilot/reference/ai-models/supported-models.md

@@ -107,7 +107,7 @@ Some {% data variables.product.prodname_copilot_short %} models require minimum
 {% endrowheaders %}
 
 > [!NOTE]
-> 
+>
 > * For {% data variables.copilot.copilot_gpt_53_codex %} in {% data variables.product.prodname_vscode %}, `v1.108` and later provide improved prompting and response quality.
 > * "No minimum listed" means the reviewed changelog or release guidance did not specify a minimum version, not that all older versions are supported.
 > * Even when a model appears in the model picker on older supported versions, prompting and model behavior may work best with the latest IDE and {% data variables.product.prodname_copilot_short %} extension or plugin versions.
@@ -154,6 +154,12 @@ For more information about fallback and LTS models, see [AUTOTITLE](/copilot/con
 
 Evaluation models may be added, updated, or removed without notice. Availability and rate limits may differ from generally available models.
 
+## Utility models
+
+Utility models power background features across surfaces, and cannot be disabled or selected in the model picker. See [AUTOTITLE](/copilot/concepts/models/utility-models).
+
+{% data reusables.copilot.utility-models %}
+
 ## Next steps
 
 * For task-based guidance on selecting a model, see [AUTOTITLE](/copilot/reference/ai-models/model-comparison).

data/reusables/copilot/utility-models.md

@@ -0,0 +1,6 @@
+The following models are currently used as utility models:
+
+* {% data variables.copilot.copilot_gpt_4o_mini %}
+* {% data variables.copilot.copilot_gpt_4o %}
+* {% data variables.copilot.copilot_gpt_41 %}
+* {% data variables.copilot.copilot_gpt_54_nano %}