Skip to content

Commit 75c40ca

Browse files
s-sajid-alis-sajid-ali
authored
Merge branch 'main' into robjy-arrayjob
2 parents c787685 + 6aaf20d commit 75c40ca

10 files changed

Lines changed: 294 additions & 204 deletions

File tree

‎.github/workflows/code-quality.yml‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -23,7 +23,7 @@ jobs:
2323
node-version: latest
2424

2525
- name: Install pnpm
26-
uses: pnpm/action-setup@v5
26+
uses: pnpm/action-setup@v6
2727
with:
2828
version: latest
2929

‎.github/workflows/deploy.yaml‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -18,7 +18,7 @@ jobs:
1818
uses: actions/checkout@v6
1919

2020
- name: Install pnpm
21-
uses: pnpm/action-setup@v5
21+
uses: pnpm/action-setup@v6
2222
with:
2323
version: latest
2424

‎.github/workflows/links.yaml‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -16,7 +16,7 @@ jobs:
1616
- uses: actions/checkout@v6
1717

1818
- name: Install pnpm
19-
uses: pnpm/action-setup@v5
19+
uses: pnpm/action-setup@v6
2020
with:
2121
version: latest
2222

‎.github/workflows/lint.yaml‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -23,7 +23,7 @@ jobs:
2323
- uses: actions/checkout@v6
2424

2525
- name: Install pnpm
26-
uses: pnpm/action-setup@v5
26+
uses: pnpm/action-setup@v6
2727
with:
2828
version: latest
2929

‎.github/workflows/preview.yml‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -26,7 +26,7 @@ jobs:
2626
uses: actions/checkout@v6
2727

2828
- name: Install pnpm
29-
uses: pnpm/action-setup@v5
29+
uses: pnpm/action-setup@v6
3030
with:
3131
version: latest
3232

‎.github/workflows/storage-finder-sync.yml‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -21,7 +21,7 @@ jobs:
2121
uses: oven-sh/setup-bun@v2
2222

2323
- name: Install pnpm
24-
uses: pnpm/action-setup@v5
24+
uses: pnpm/action-setup@v6
2525
with:
2626
version: latest
2727

‎docs/hpc/01_getting_started/03_Slurm_Accounts/06_adding_publications_grants.mdx‎

Lines changed: 7 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,12 @@
11
# Entering Grants and Publciations for Your Project
22

3+
## Acknowledgment Statement for Publications
4+
The following acknowledgment statement should appear in the publication of any material that resulted from using the NYU IT HPC resources, services, and staff expertise.
5+
6+
*"This work was supported in part through the NYU IT High Performance Computing resources, services, and staff expertise"*
7+
8+
Please also enter your publications and grants following the steps below. For non-publications, such as presentations or conference posted, please let the NYU HPC team know of your work via email to hpc@nyu.edu.
9+
310
:::info[VPN Needed]
411
You need to be connected to [NYU VPN](https://www.nyu.edu/life/information-technology/infrastructure/network-services/vpn.html) to access the HPC project management portal.
512
:::

‎docs/hpc/06_tools_and_software/08_utils.mdx‎

Lines changed: 86 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -72,6 +72,92 @@ You can get very detailed information about the GPU with:
7272
```
7373
:::
7474

75+
## `sdiag`
76+
77+
A scheduling diagnostic tool for Slurm. It shows information related to slurmctld execution about: threads, agents, jobs, and scheduling algorithms.
78+
79+
```bash
80+
[NetID@torch-login-b-2 ~]$ sdiag
81+
*******************************************************
82+
sdiag output at Tue May 05 17:03:58 2026 (1778015038)
83+
Data since Mon May 04 20:00:00 2026 (1777939200)
84+
*******************************************************
85+
Server thread count: 1
86+
RPC queue enabled: 0
87+
Agent queue size: 0
88+
Agent count: 0
89+
Agent thread count: 0
90+
DBD Agent queue size: 3928
91+
92+
Jobs submitted: 68600
93+
Jobs started: 47338
94+
Jobs completed: 46650
95+
Jobs canceled: 3004
96+
Jobs failed: 0
97+
98+
Job states ts: Tue May 05 17:03:55 2026 (1778015035)
99+
Jobs pending: 25570
100+
Jobs running: 3531
101+
102+
Main schedule statistics (microseconds):
103+
Last cycle: 439197
104+
Max cycle: 213062424
105+
Total cycles: 23887
106+
Mean cycle: 147838
107+
Mean depth cycle: 3901
108+
Cycles per minute: 18
109+
Last queue length: 8588
110+
111+
Main scheduler exit:
112+
End of job queue:22329
113+
Hit default_queue_depth: 0
114+
Hit sched_max_job_start: 0
115+
Blocked on licenses: 0
116+
Hit max_rpc_cnt: 0
117+
Timeout (max_sched_time):761
118+
119+
Backfilling stats
120+
Total backfilled jobs (since last slurm start): 2491
121+
Total backfilled jobs (since last stats cycle start): 2144
122+
Total backfilled heterogeneous job components: 0
123+
Total cycles: 1132
124+
etc....
125+
126+
Backfill exit
127+
End of job queue: 0
128+
Hit bf_max_job_start: 0
129+
Hit bf_max_job_test:1117
130+
System state changed:15
131+
Hit table size limit (bf_node_space_size): 0
132+
Timeout (bf_max_time): 0
133+
134+
Latency for 1000 calls to gettimeofday(): 37 microseconds
135+
136+
Remote Procedure Call statistics by message type
137+
REQUEST_PARTITION_INFO ( 2009) count:265039 ave_time:862 total_time:228596549
138+
REQUEST_JOB_INFO_SINGLE ( 2021) count:148070 ave_time:177411 total_time:26269388019
139+
REQUEST_FED_INFO ( 2049) count:109863 ave_time:131 total_time:14500296
140+
etc....
141+
142+
Remote Procedure Call statistics by user
143+
root ( 0) count:641281 ave_time:136950 total_time:87823642922
144+
NetID1 ( 3316908) count:35412 ave_time:206086 total_time:7297919561
145+
NetID2 ( 4704548) count:32959 ave_time:152431 total_time:5023999046
146+
NetID3 ( 3511186) count:32373 ave_time:102614 total_time:3321933704
147+
etc....
148+
149+
Pending RPC statistics
150+
No pending RPCs
151+
```
152+
::::warning
153+
Being high on the list in `Remote Procedure Call statistics by user` can cause you to be throttled by Slurm for using too many resources.
154+
:::tip
155+
If you find yourself in this position please try to reduce the number of calls you make to slurm services like `squeue` and `sacct`. Do not use these commands with `watch`. As an alternative you can use the slurm [mail-type flag](https://slurm.schedmd.com/sbatch.html#OPT_mail-type) to see when jobs start and end.
156+
157+
If you're running a number of similar jobs, please look into using [array jobs](https://slurm.schedmd.com/job_array.html) as this will reduce your procedure call statistics.
158+
:::
159+
::::
160+
75161
## `seff`
76162

77163
The `seff` script can be used to display status information about a user’s historical or running jobs.

‎pnpm-workspace.yaml‎

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,5 @@
1+
allowBuilds:
2+
"@swc/core": true
3+
core-js: true
4+
core-js-pure: true
5+
unrs-resolver: true

0 commit comments

Comments
 (0)