You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/docs/concepts/fleets.md
+7-9Lines changed: 7 additions & 9 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -328,10 +328,7 @@ This is required if you'd like to use the fleet for [distributed tasks](tasks.md
328
328
329
329
#### Blocks { #ssh-blocks }
330
330
331
-
By default, a single job occupies the entire instance, so if the instance has 8 GPUs, the job will use all of them.
332
-
333
-
To make it more efficient, you can set the blocks property to specify how many blocks you’d like the instance to be
334
-
divided into, allowing multiple jobs to use these blocks concurrently.
331
+
By default, a job uses the entire instance—e.g., all 8 GPUs. To allow multiple jobs on the same instance, set the `blocks` property to divide the instance. Each job can then use one or more blocks, up to the full instance.
335
332
336
333
<div editor-title=".dstack.yml">
337
334
@@ -355,14 +352,15 @@ divided into, allowing multiple jobs to use these blocks concurrently.
355
352
356
353
</div>
357
354
358
-
For instance, with 8 GPUs, 128 CPUs, and 2TB of memory, setting blocks to 8 would assign 1 GPU, 16 CPUs, and 256 GB of
359
-
memory to each block. These blocks can be used concurrently, and a single job can occupy multiple blocks if needed.
355
+
All resources (GPU, CPU, memory) are split evenly across blocks, while disk is shared.
360
356
361
-
> GPUs and CPUs must be divisible by the number of blocks. All resources (GPU, CPU, memory) are split proportionally,
362
-
> except disk storage, which is shared.
357
+
For example, with 8 GPUs, 128 CPUs, and 2TB RAM, setting `blocks` to `8` gives each block 1 GPU, 16 CPUs, and 256 GB RAM.
363
358
364
-
You can also set `blocks` to `auto`, which automatically sets the number of blocks to match the number of GPUs.
359
+
Set `blocks` to `auto` to match the number od blocks to the number of GPUs.
365
360
361
+
!!! info "Distributed tasks"
362
+
Distributed tasks require exclusive access to all host resources and therefore must use all blocks on each node.
363
+
366
364
#### Environment variables
367
365
368
366
If needed, you can specify environment variables that will be used by `dstack-shim` and passed to containers.
0 commit comments