Skip to content

Commit f41570f

Browse files
committed
changed to show_slurm_qos
1 parent 9a9d7d9 commit f41570f

2 files changed

Lines changed: 16 additions & 16 deletions

File tree

docs/hpc/05_submitting_jobs/01_slurm_submitting_jobs.md

Lines changed: 0 additions & 16 deletions
Original file line numberDiff line numberDiff line change
@@ -34,22 +34,6 @@ As stated in the tutorial, be sure to only request the compute resources (e.g.,
3434
Jobs with low GPU utilization will be automatically canceled. The exact threshold is TBD, but enforcement will be very aggressive.
3535
:::
3636

37-
:::info Maximum number of jobs a user can submit
38-
This depends on the requested wall time.<br />
39-
You can check it with the following command:
40-
```bash
41-
[NetID@torch-login-b-1 ~]$ sacctmgr show qos cpu48,cpu168,gpu48,gpu168,interactive format=name%16,maxTresPU%32,MaxWall,MaxSubmitJobsPerUser
42-
Name MaxTRESPU MaxWall MaxSubmitPU
43-
---------------- -------------------------------- ----------- -----------
44-
cpu168 cpu=1000,mem=2000G 7-00:00:00 500
45-
cpu48 cpu=3000,mem=6000G 2-00:00:00 5000
46-
gpu168 gres/gpu=4 7-00:00:00 50
47-
gpu48 gres/gpu=16 2-00:00:00 2000
48-
interactive cpu=16,mem=60G 06:00:00 20
49-
```
50-
The values above are just an example and they may change without notice, so please check within your account for the most up to date results.
51-
:::
52-
5337
## Preemptible jobs on Torch
5438
On Torch, users may run "preemptible" jobs on stakeholder resources that their group does not own. This allows the stakeholder resources to be utilized by non-stakeholders which may otherwise be idle. To make the best use of these resources, you are encouraged to adopt checkpoint/restart to allow for resumption of the workload in subsequent jobs.
5539

docs/hpc/06_tools_and_software/08_utils.mdx

Lines changed: 16 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -104,6 +104,22 @@ As you can see above, `seff` gives information about CPU and memory efficiency t
104104
Requesting the minimum resources needed for your job can help it spend less time in the queue.
105105
:::
106106

107+
## `show_slurm_qos`
108+
This shows the maximum number of cpus/gpus and memory allowed for different wall times.
109+
```bash
110+
[NetID@torch-login-b-0 ~]$ show_slurm_qos
111+
Name MaxWall MaxTRESPU Preempt PreemptExemptTime PreemptMode
112+
------------------------ ----------- ------------------------ ---------- ------------------- -----------
113+
cpu_short 06:00:00 cpu=32,mem=120G cluster
114+
cpu168 7-00:00:00 cpu=1000,mem=2000G cluster
115+
cpu48 2-00:00:00 cpu=3000,mem=6000G cluster
116+
cpuprem 2-00:00:00 cpu=30000,mem=120000G cluster
117+
gpu168 7-00:00:00 gres/gpu=4 cluster
118+
gpu48 2-00:00:00 gres/gpu=16 cluster
119+
interactive 06:00:00 cpu=16,mem=60G cluster
120+
```
121+
You can see that, in general, the partitions with shorter wall times will allow the use of greater resources.
122+
107123
{/* coming soon
108124
## `rpsquota`
109125

0 commit comments

Comments
 (0)