Skip to content

Commit 85235be

Browse files
authored
Merge pull request #344 from NYU-RTS/max-jobs
added info on max jobs per user
2 parents 6076af8 + f41570f commit 85235be

2 files changed

Lines changed: 17 additions & 1 deletion

File tree

docs/hpc/05_submitting_jobs/01_slurm_submitting_jobs.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -28,7 +28,7 @@ Non-stakeholders to temporarily use stakeholder resources (a stakeholder group t
2828
:::
2929

3030
## Job Submission on Torch
31-
As stated in the tuturial, always only request the compute resources (e.g., GPUs, CPUs, memory) needed for the job. Requesting too many resources can prevent your job from being scheduled within an adequate time. The `SLURM` scheduler will automatically dispatch jobs to all accessible GPU partitions that match resource requests.
31+
As stated in the tutorial, be sure to only request the compute resources (e.g., GPUs, CPUs, memory) needed for the job. Requesting too many resources can prevent your job from being scheduled within an adequate time. The `SLURM` scheduler will automatically dispatch jobs to all accessible GPU partitions that match resource requests.
3232

3333
:::danger Low GPU Utilization Policy
3434
Jobs with low GPU utilization will be automatically canceled. The exact threshold is TBD, but enforcement will be very aggressive.

docs/hpc/06_tools_and_software/08_utils.mdx

Lines changed: 16 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -107,6 +107,22 @@ As you can see above, `seff` gives information about CPU and memory efficiency t
107107
Requesting the minimum resources needed for your job can help it spend less time in the queue.
108108
:::
109109

110+
## `show_slurm_qos`
111+
This shows the maximum number of cpus/gpus and memory allowed for different wall times.
112+
```bash
113+
[NetID@torch-login-b-0 ~]$ show_slurm_qos
114+
Name MaxWall MaxTRESPU Preempt PreemptExemptTime PreemptMode
115+
------------------------ ----------- ------------------------ ---------- ------------------- -----------
116+
cpu_short 06:00:00 cpu=32,mem=120G cluster
117+
cpu168 7-00:00:00 cpu=1000,mem=2000G cluster
118+
cpu48 2-00:00:00 cpu=3000,mem=6000G cluster
119+
cpuprem 2-00:00:00 cpu=30000,mem=120000G cluster
120+
gpu168 7-00:00:00 gres/gpu=4 cluster
121+
gpu48 2-00:00:00 gres/gpu=16 cluster
122+
interactive 06:00:00 cpu=16,mem=60G cluster
123+
```
124+
You can see that, in general, the partitions with shorter wall times will allow the use of greater resources.
125+
110126
{/* coming soon
111127
## `rpsquota`
112128

0 commit comments

Comments
 (0)