From 382ca45a35ee5cd771c296acc516152709edb082 Mon Sep 17 00:00:00 2001 From: Dorin Geman Date: Tue, 9 Sep 2025 23:59:09 +0300 Subject: [PATCH 1/4] settings-management: add `enableInferenceGPUVariant` to AI settings table Signed-off-by: Dorin Geman --- .../settings-management/configure-json-file.md | 13 +++++++------ 1 file changed, 7 insertions(+), 6 deletions(-) diff --git a/content/manuals/enterprise/security/hardened-desktop/settings-management/configure-json-file.md b/content/manuals/enterprise/security/hardened-desktop/settings-management/configure-json-file.md index 343304c9b400..57d561e9a415 100644 --- a/content/manuals/enterprise/security/hardened-desktop/settings-management/configure-json-file.md +++ b/content/manuals/enterprise/security/hardened-desktop/settings-management/configure-json-file.md @@ -334,12 +334,13 @@ For more information, see [Networking](/manuals/desktop/features/networking.md#n ### AI settings -| Parameter | OS | Description | Version | -|:-----------------------------------------------------|----|:-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|---------| -| `enableInference` | | If `allowBetaFeatures` is true, setting `enableInference` to `true` enables [Docker Model Runner](/manuals/ai/model-runner/_index.md) by default. You can independently control this setting from the `allowBetaFeatures` setting. | | -|         `enableInferenceTCP` | | Enable host-side TCP support. This setting requires Docker Model Runner setting to be enabled first. | | -|         `enableInferenceTCPPort` | | Specifies the exposed TCP port. This setting requires Docker Model Runner setting to be enabled first. | | -|         `enableInferenceCORS` | | Specifies the allowed CORS origins. Empty string to deny all,`*` to accept all, or a list of comma-separated values. This setting requires Docker Model Runner setting to be enabled first. | | +| Parameter | OS | Description | Version | +|:----------------------------|---------------|:------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|---------| +| `enableInference` | | Setting `enableInference` to `true` enables [Docker Model Runner](/manuals/ai/model-runner/_index.md). | | +| `enableInferenceTCP` | | Enable host-side TCP support. This setting requires Docker Model Runner setting to be enabled first. | | +| `enableInferenceTCPPort` | | Specifies the exposed TCP port. This setting requires Docker Model Runner and Enable host-side TCP support settings to be enabled first. | | +| `enableInferenceCORS` | | Specifies the allowed CORS origins. Empty string to deny all,`*` to accept all, or a list of comma-separated values. This setting requires Docker Model Runner and Enable host-side TCP support settings to be enabled first. | | +| `enableInferenceGPUVariant` | Windows only | Setting `enableInferenceGPUVariant` to `true` enables GPU-backed inference. The additional components required for this don't come by default with Docker Desktop, therefore they will be downloaded to `~/.docker/bin/inference`. | | ### Beta features From 1bc3bb9202bc939bde25d0a3c09bac399566a2bd Mon Sep 17 00:00:00 2001 From: Dorin Geman Date: Wed, 10 Sep 2025 00:06:41 +0300 Subject: [PATCH 2/4] settings-management: Add DMR in the `admin-settings.json` file example Signed-off-by: Dorin Geman --- .../configure-json-file.md | 20 +++++++++++++++++++ 1 file changed, 20 insertions(+) diff --git a/content/manuals/enterprise/security/hardened-desktop/settings-management/configure-json-file.md b/content/manuals/enterprise/security/hardened-desktop/settings-management/configure-json-file.md index 57d561e9a415..1d4b06a204db 100644 --- a/content/manuals/enterprise/security/hardened-desktop/settings-management/configure-json-file.md +++ b/content/manuals/enterprise/security/hardened-desktop/settings-management/configure-json-file.md @@ -216,6 +216,26 @@ The following sample is an `admin-settings.json` file with common enterprise set "desktopTerminalEnabled": { "locked": false, "value": false + }, + "enableInference": { + "locked": false, + "value": true + }, + "enableInferenceTCP": { + "locked": false, + "value": true + }, + "enableInferenceTCPPort": { + "locked": true, + "value": 12434 + }, + "enableInferenceCORS": { + "locked": true, + "value": "" + }, + "enableInferenceGPUVariant": { + "locked": true, + "value": true } } ``` From 5531088819613af7b2131da3de91655b36b34614 Mon Sep 17 00:00:00 2001 From: Dorin Geman Date: Wed, 10 Sep 2025 00:20:58 +0300 Subject: [PATCH 3/4] settings-management: DMR: mention the `AI` settings group in DD, the Admin Console and add `enableInferenceGPUVariant` Signed-off-by: Dorin Geman --- .../settings-management/settings-reference.md | 34 +++++++++++++++++-- 1 file changed, 31 insertions(+), 3 deletions(-) diff --git a/content/manuals/enterprise/security/hardened-desktop/settings-management/settings-reference.md b/content/manuals/enterprise/security/hardened-desktop/settings-management/settings-reference.md index 35589996fa60..cc68ef77576f 100644 --- a/content/manuals/enterprise/security/hardened-desktop/settings-management/settings-reference.md +++ b/content/manuals/enterprise/security/hardened-desktop/settings-management/settings-reference.md @@ -616,13 +616,15 @@ Builders settings lets you manage Buildx builder instances for advanced image-bu | Default value | Accepted values | Format | |---------------|-----------------|----------| -| `true` | `true`, `false` | Boolean | +| `true` | `true`, `false` | Boolean | - **Description:** Docker Model Runner functionality for running AI models in containers. - **OS:** {{< badge color=blue text="All" >}} - **Use case:** Run and manage AI/ML models using Docker infrastructure. - **Configure this setting with:** + - **AI** settings in [Docker Desktop GUI](/manuals/desktop/settings-and-maintenance/settings.md) - Settings Management: `enableDockerAI` setting in the [`admin-settings.json` file](/manuals/enterprise/security/hardened-desktop/settings-management/configure-json-file.md) + - Settings Management: **Enable Docker Model Runner** setting in the [Admin Console](/manuals/enterprise/security/hardened-desktop/settings-management/configure-admin-console.md) #### Enable host-side TCP support @@ -634,7 +636,9 @@ Builders settings lets you manage Buildx builder instances for advanced image-bu - **OS:** {{< badge color=blue text="All" >}} - **Use case:** Allow external applications to connect to Model Runner via TCP. - **Configure this setting with:** + - **AI** settings in [Docker Desktop GUI](/manuals/desktop/settings-and-maintenance/settings.md) - Settings Management: `enableDockerAI` setting in the [`admin-settings.json` file](/manuals/enterprise/security/hardened-desktop/settings-management/configure-json-file.md) + - Settings Management: **Host-side TCP support** setting in the [Admin Console](/manuals/enterprise/security/hardened-desktop/settings-management/configure-admin-console.md) > [!NOTE] > @@ -650,8 +654,13 @@ Builders settings lets you manage Buildx builder instances for advanced image-bu - **OS:** {{< badge color=blue text="All" >}} - **Use case:** Customize the port for Model Runner TCP connectivity. - **Configure this setting with:** - - **Beta features** settings in [Docker Desktop GUI](/manuals/desktop/settings-and-maintenance/settings.md) + - **AI** settings in [Docker Desktop GUI](/manuals/desktop/settings-and-maintenance/settings.md) - Settings Management: `enableInferenceTCP` setting in the [`admin-settings.json` file](/manuals/enterprise/security/hardened-desktop/settings-management/configure-json-file.md) + - Settings Management: **Host-side TCP port** setting in the [Admin Console](/manuals/enterprise/security/hardened-desktop/settings-management/configure-admin-console.md) + +> [!NOTE] +> +> This setting requires Docker Model Runner and host-side TCP support settings to be enabled first. ##### CORS Allowed Origins @@ -663,8 +672,27 @@ Builders settings lets you manage Buildx builder instances for advanced image-bu - **OS:** {{< badge color=blue text="All" >}} - **Use case:** Allow web applications to connect to Model Runner services. - **Configure this setting with:** - - **Beta features** settings in [Docker Desktop GUI](/manuals/desktop/settings-and-maintenance/settings.md) + - **AI** settings in [Docker Desktop GUI](/manuals/desktop/settings-and-maintenance/settings.md) - Settings Management: `enableInferenceCORS` setting in the [`admin-settings.json` file](/manuals/enterprise/security/hardened-desktop/settings-management/configure-json-file.md) + - Settings Management: **CORS Allowed Origins** setting in the [Admin Console](/manuals/enterprise/security/hardened-desktop/settings-management/configure-admin-console.md) + +> [!NOTE] +> +> This setting requires Docker Model Runner and host-side TCP support settings to be enabled first. + +#### Enable GPU-backed inference + +| Default value | Accepted values | Format | +|---------------|-----------------|----------| +| `false` | `true`, `false` | Boolean | + +- **Description:** GPU-backed inference. +- **OS:** {{< badge color=blue text="Windows only" >}} +- **Use case:** Enable GPU-backed inference. Additional components will be downloaded to ~/.docker/bin/inference. +- **Configure this setting with:** + - **AI** settings in [Docker Desktop GUI](/manuals/desktop/settings-and-maintenance/settings.md) + - Settings Management: `enableInferenceGPUVariant` setting in the [`admin-settings.json` file](/manuals/enterprise/security/hardened-desktop/settings-management/configure-json-file.md) + - Settings Management: **Enable GPU-backed inference** setting in the [Admin Console](/manuals/enterprise/security/hardened-desktop/settings-management/configure-admin-console.md) ## Kubernetes settings From ce8c493d004647161ae541858e7cd4554e1ef3c4 Mon Sep 17 00:00:00 2001 From: Allie Sadler <102604716+aevesdocker@users.noreply.github.com> Date: Wed, 10 Sep 2025 09:39:23 +0100 Subject: [PATCH 4/4] Apply suggestions from code review Co-authored-by: Jacob Howard --- .../settings-management/configure-json-file.md | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/content/manuals/enterprise/security/hardened-desktop/settings-management/configure-json-file.md b/content/manuals/enterprise/security/hardened-desktop/settings-management/configure-json-file.md index 1d4b06a204db..855daf587a21 100644 --- a/content/manuals/enterprise/security/hardened-desktop/settings-management/configure-json-file.md +++ b/content/manuals/enterprise/security/hardened-desktop/settings-management/configure-json-file.md @@ -357,9 +357,9 @@ For more information, see [Networking](/manuals/desktop/features/networking.md#n | Parameter | OS | Description | Version | |:----------------------------|---------------|:------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|---------| | `enableInference` | | Setting `enableInference` to `true` enables [Docker Model Runner](/manuals/ai/model-runner/_index.md). | | -| `enableInferenceTCP` | | Enable host-side TCP support. This setting requires Docker Model Runner setting to be enabled first. | | -| `enableInferenceTCPPort` | | Specifies the exposed TCP port. This setting requires Docker Model Runner and Enable host-side TCP support settings to be enabled first. | | -| `enableInferenceCORS` | | Specifies the allowed CORS origins. Empty string to deny all,`*` to accept all, or a list of comma-separated values. This setting requires Docker Model Runner and Enable host-side TCP support settings to be enabled first. | | +| `enableInferenceTCP` | | Enable host-side TCP support. This setting requires the Docker Model Runner setting to be enabled first. | | +| `enableInferenceTCPPort` | | Specifies the exposed TCP port. This setting requires the Docker Model Runner and Enable host-side TCP support settings to be enabled first. | | +| `enableInferenceCORS` | | Specifies the allowed CORS origins. Empty string to deny all,`*` to accept all, or a list of comma-separated values. This setting requires the Docker Model Runner and Enable host-side TCP support settings to be enabled first. | | | `enableInferenceGPUVariant` | Windows only | Setting `enableInferenceGPUVariant` to `true` enables GPU-backed inference. The additional components required for this don't come by default with Docker Desktop, therefore they will be downloaded to `~/.docker/bin/inference`. | | ### Beta features