Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 0 additions & 5 deletions docs/hpc/01_getting_started/01_intro.md

This file was deleted.

9 changes: 9 additions & 0 deletions docs/hpc/01_getting_started/01_intro.mdx
Original file line number Diff line number Diff line change
@@ -0,0 +1,9 @@
# Start here!

Welcome to the Torch HPC documentation! If you do not have an HPC account, please proceed to the next section that explains how you may be able to get one.

If you are an active user, you can proceed to one of the categories on the left.

## Announcements

<iframe src="https://docs.google.com/presentation/d/e/2PACX-1vR8sCeFahadhOL_PRaMl8_dBT6dXEVkLqWznRvEEzNbF3-aUH7AQT1KiZEiwznsy8cMYrvzZoTHORVx/pubembed?start=false&loop=false&delayms=3000" frameborder="0" width="960" height="569" allowfullscreen="true" mozallowfullscreen="true" webkitallowfullscreen="true"></iframe>
2 changes: 1 addition & 1 deletion docs/hpc/03_storage/01_intro_and_data_management.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -105,7 +105,7 @@ The HPC team makes available a number of public datasets that are commonly used

For some of the datasets users must provide a signed usage agreement before accessing.

Public datasets available on the HPC clusters can be viewed on the [Datasets page](../01_getting_started/01_intro.md).
Public datasets available on the HPC clusters can be viewed on the [Datasets page](../04_datasets/01_intro.md).

#### HPC Archive
Once the Analysis stage of the research data lifecycle has completed, <ins>_HPC users should **tar** their data and code into a single tar.gz file and then copy the file to their archive directory (**`/archive/$USER`**_).</ins> The HPC Archive file system is not accessible by running jobs; it is suitable for long-term data storage. Each user has access to a default disk quota of **2TB** and ***20,000 inode (files) limit***. The rather low limit on the number of inodes per user is intentional. The archive file system is available only ***on login nodes*** of Greene. The archive file system is backed up daily.
Expand Down
2 changes: 1 addition & 1 deletion docs/hpc/03_storage/03_data_transfers.md
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@ Globus is the recommended tool to use for large-volume data transfers due to the
:::

## Data-Transfer nodes
Attached to the NYU HPC cluster Greene, the Greene Data Transfer Node (gDTN) are nodes optimized for transferring data between cluster file systems (e.g. scratch) and other endpoints outside the NYU HPC clusters, including user laptops and desktops. The gDTNs have 100-Gb/s Ethernet connections to the High Speed Research Network (HSRN) and are connected to the HDR Infiniband fabric of the HPC clusters. More information on the hardware characteristics is available at [Greene spec sheet](../10_spec_sheet.mdx).
Attached to the NYU HPC cluster Greene, the Greene Data Transfer Node (gDTN) are nodes optimized for transferring data between cluster file systems (e.g. scratch) and other endpoints outside the NYU HPC clusters, including user laptops and desktops. The gDTNs have 100-Gb/s Ethernet connections to the High Speed Research Network (HSRN) and are connected to the HDR Infiniband fabric of the HPC clusters. More information on the hardware characteristics is available at [Greene spec sheet](../10_spec_sheet.md).

### Data Transfer Node Access
The HPC cluster filesystems include `/home`, `/scratch`, `/archive` and the [HPC Research Project Space](./05_research_project_space.mdx) are available on the gDTN. The Data-Transfer Node (DTN) can be accessed in a variety of ways
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -344,7 +344,7 @@ Please enter 'q' and we're done with configuration.

### Step 4: Transfer
:::warning
Please be sure to perform data transters on a data transfer node (DTN). It can degrade performance for other users to perform transfers on other types of nodes. For more information please see [Data Transfers](./03_data_transfers.md)
Please be sure to perform data transfers on a data transfer node (DTN). It can degrade performance for other users to perform transfers on other types of nodes. For more information please see [Data Transfers](./03_data_transfers.md)
:::

Sample commands:
Expand Down
2 changes: 1 addition & 1 deletion docs/hpc/05_submitting_jobs/03_slurm_tutorial.md
Original file line number Diff line number Diff line change
Expand Up @@ -16,7 +16,7 @@ The Slurm software system is a resource manager and a job scheduler, which is de

- It also assumes you are comfortable with Linux command-line environment. To learn about linux please read our [Linux Tutorial](../12_tutorial_intro_shell_hpc/01_intro.mdx).

- Please review the [Hardware Specs page](../10_spec_sheet.mdx) for more information on Greene's hardware specifications.
- Please review the [Hardware Specs page](../10_spec_sheet.md) for more information on Greene's hardware specifications.

## Slurm Commands

Expand Down
2 changes: 1 addition & 1 deletion docs/hpc/06_tools_and_software/01_intro.md
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,7 @@
We encourage you to setup your own computational environment on Torch and to assist you in doing so, we allow you to run [Apptainer](../07_containers/01_intro.md) (formerly known as Singularity) containers, we manage licensed software suites and offer extensive documentation, training and support.

:::tip
We stongly advise that you setup your own computational enviromments via Apptainer containers and overlay files. Detailed documentation is available in the [containers section](../07_containers/01_intro.md).
We strongly advise that you setup your own computational enviromments via Apptainer containers and overlay files. Detailed documentation is available in the [containers section](../07_containers/01_intro.md).
:::

## Package Management for R, Python, & Julia, and Conda in general
Expand Down
21 changes: 21 additions & 0 deletions docs/hpc/10_spec_sheet.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,21 @@

# Torch Spec Sheet

The Torch cluster has 518 [Intel "Xeon Platinum 8592+ 64C"](https://www.intel.com/content/www/us/en/products/sku/237261/intel-xeon-platinum-8592-processor-320m-cache-1-90-ghz/specifications.html) CPUs, 29 NVIDIA [H200](https://nvdam.widen.net/s/nb5zzzsjdf/hpc-datasheet-sc23-h200-datasheet-3002446) GPUs & 68 NVIDIA [L40S](https://resources.nvidia.com/en-us-l40s/l40s-datasheet-28413) GPUs connected together via Infiniband NDR400 interconnect. Further details on each kind of node is provided in the table below.

| Type | Nodes | CPU Cores | GPUs | Memory (GB) |
|---|---|---|---|---|
| Standard Memory | 186 | 23,808 | N/A | 95,232 |
| Large memory | 7 | 896 | N/A | 21,504 |
| H200 GPU | 29 | 3,712 | 232 | 59,392 |
| L40S GPU | 68 | 8,704 | 272 | 34,816 |
| Login | 4 | 512 | N/A | 1024 |
| Data Transfer | 2 | 64 | N/A | 512 |
| Provisioning | 4 | 320 | N/A | 1024 |
| Scheduler | 2 | 64 | N/A | 1024 |
| Total | N/A | 38,080 | 504 | 209.5(TB) |


Torch was tested in June 2025 using the [LINPACK benchmark system](https://top500.org/project/linpack/), which is the basis for all HPC systems ranked on the Top500 list. It had a theoretical maximum performance of 12.25 PF/s thanks to its powerful GPU resources, of which LINPACK was able to use 10.79 PF/s, thus placing it at [#133 on the listed](https://top500.org/system/180363/).

Torch was recently ranked [#40 on the Green 500 list](https://top500.org/lists/green500/list/2025/06/), a global list of the most energy efficient supercomputers in the world thanks to its advanced liquid cooling system.
76 changes: 0 additions & 76 deletions docs/hpc/10_spec_sheet.mdx

This file was deleted.

2 changes: 1 addition & 1 deletion docs/srde/02_faq/01_basics.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -25,7 +25,7 @@ Fill out our intake form to provide more information about your project: [Secure
The cost is dependent on the needs of the project, such as size of the data and the type of machine needed for the analysis. Google Cloud has a calculator that will help estimate the costs: https://cloud.google.com/products/calculator

## My data is not high risk, are there other options available?
There are several options available depending on the data risk classification and the needs of the project. There are resources provided by the university such as research project space, cloud computing, etc. You can check out many of these services on the [HPC Support Site](../../hpc/01_getting_started/01_intro.md). If you are unsure on how to proceed, a consultation with the SRDE team will help determine the best path forward.
There are several options available depending on the data risk classification and the needs of the project. There are resources provided by the university such as research project space, cloud computing, etc. You can check out many of these services on the [HPC Support Site](../../hpc/01_getting_started/01_intro.mdx). If you are unsure on how to proceed, a consultation with the SRDE team will help determine the best path forward.

## What does the SRDE team need from me for the consultation?
To help get things started it would be beneficial to submit an [intake form](https://nyu.qualtrics.com/jfe/form/SV_3Vok9ax87Bxxdsy) with any related data governance documentation (files can be attached to the form), including, but not limited to, data use agreement, OSP/IRB documents, and project information.
Expand Down