From b31a98b17e42574d4bf1ac90bb7160e7312e9965 Mon Sep 17 00:00:00 2001 From: Robert Young Date: Tue, 23 Jun 2026 17:20:33 -0400 Subject: [PATCH] removed references to greene --- docs/hpc/03_storage/02_data_transfers.md | 31 ------------------- .../03_singularity_with_conda.md | 15 ++------- .../02_jupyter_with_conda_singularity.mdx | 17 ++-------- 3 files changed, 5 insertions(+), 58 deletions(-) diff --git a/docs/hpc/03_storage/02_data_transfers.md b/docs/hpc/03_storage/02_data_transfers.md index 33357129a0..a3e9796dd6 100644 --- a/docs/hpc/03_storage/02_data_transfers.md +++ b/docs/hpc/03_storage/02_data_transfers.md @@ -60,34 +60,3 @@ Please only use OOD for small data transfers! Please use Data-Transfer Nodes (D ### FDT [FDT](https://fast-data-transfer.github.io/) stands for "Fast Data Transfer". It is a command line application written in Java. With the plugin mechanism, FDT allows users to load user-defined classes for Pre- and Post-Processing of file transfers. Users can start their own server processes. If you have use cases for FDT, visit the [download page](https://github.com/fast-data-transfer/fdt/releases) to get `fdt.jar` to start. Please contact [hpc@nyu.edu](mailto:hpc@nyu.edu) for any questions. - -## Copying Data from the Greene HPC Cluster to Torch HPC Cluster -### Copying Data to Torch via the Command Line -Torch has an available data transfer node (DTN) that can be used to upload data. You must authenticate similarly to the steps outlined on the Accessing Torch page. - -``` -netid@localpc ~ $ rsync -avz -e ssh ~/testfile.txt netid@dtn012.hpc.nyu.edu:/scratch/netid/testfile.txt -(netid@dtn012.hpc.nyu.edu) Authenticate with PIN BUUM5YHJX at https://microsoft.com/devicelogin and press ENTER. -testfile.txt                      100%    0     0.0KB/s   00:00 -netid@localpc ~ $ -``` -## Copying Data to Torch via Globus -Globus has been installed for Torch - you can log in at https://globus.org/ and search for the Torch home, scratch, or archive collections under nyu#torch.​ - -Globus works much the same as it did on Greene, so see our previous page on how to use it. Once you install Globus Connect Personal on your personal device you can easily transfer files between your local machine and Torch. - -## File Transfer (Torch ↔ Greene) -To ease data transfer between clusters, Torch storage has been mounted on the Greene Data Transfer Nodes (e.g. dtn-1.hpc.nyu.edu and dtn-2.hpc.nyu.edu). - -This allows users to access the data under /torch: - -``` -[netid@dtn-1]$ ls /torch -archive home scratch share -``` - -You can copy files using the rsync command from the Greene DTN: - -``` -[netid@dtn-1]$ rsync /scratch/netid/my_file.txt /torch/scratch/netid/my_file.txt -``` diff --git a/docs/hpc/07_containers/03_singularity_with_conda.md b/docs/hpc/07_containers/03_singularity_with_conda.md index 24899d1e59..8fd5c65649 100644 --- a/docs/hpc/07_containers/03_singularity_with_conda.md +++ b/docs/hpc/07_containers/03_singularity_with_conda.md @@ -1,17 +1,5 @@ # Singularity with Conda -Please note that Greene and Torch organize overlay files and Singularity images in different directories. - -## Greene Directories -Overlay Files: -``` -/scratch/work/public/overlay-fs-ext3/ -``` -Singularity Files: -``` -/scratch/work/public/singularity/ -``` - -## Torch Directories +:::info Overlay Files: ``` /share/apps/overlay-fs-ext3 @@ -20,6 +8,7 @@ Singularity Files: ``` /share/apps/images/ ``` +::: ## Using Singularity Overlays for Miniforge (Python & Julia) ### Preinstallation Warning diff --git a/docs/hpc/09_ood/02_jupyter_with_conda_singularity.mdx b/docs/hpc/09_ood/02_jupyter_with_conda_singularity.mdx index ecf092c49b..510ecce4b4 100644 --- a/docs/hpc/09_ood/02_jupyter_with_conda_singularity.mdx +++ b/docs/hpc/09_ood/02_jupyter_with_conda_singularity.mdx @@ -1,17 +1,5 @@ # Jupyter Notebook with Conda/Singularity in OOD -Please note that Greene and Torch organize overlay files and Singularity images in different directories. - -## Greene Directories -Overlay Files: -``` -/scratch/work/public/overlay-fs-ext3/ -``` -Singularity Files: -``` -/scratch/work/public/singularity/ -``` - -## Torch Directories +:::info Overlay Files: ``` /share/apps/overlay-fs-ext3 @@ -20,6 +8,8 @@ Singularity Files: ``` /share/apps/images/ ``` +::: + ## OOD + Singularity + conda This page describes how to use your Singularity with conda environment in OOD GUI at Torch. @@ -174,7 +164,6 @@ After it is running, you’ll be redirected to a compute node. From there, run s ### Configure iPython Kernels To create a kernel named my_env copy the template files to your home directory. -Please note that kernel_template on Greene is stored under `/share/apps/mypy/src/kernel_template` ```bash sh mkdir -p ~/.local/share/jupyter/kernels cd ~/.local/share/jupyter/kernels