Skip to content

Commit e0bb332

Browse files
authored
Merge pull request #378 from NYU-RTS/robjy-rm-greene
removed references to greene
2 parents 35eea9c + b31a98b commit e0bb332

3 files changed

Lines changed: 5 additions & 58 deletions

File tree

docs/hpc/03_storage/02_data_transfers.md

Lines changed: 0 additions & 31 deletions
Original file line numberDiff line numberDiff line change
@@ -60,34 +60,3 @@ Please only use OOD for small data transfers! Please use Data-Transfer Nodes (D
6060

6161
### FDT
6262
[FDT](https://fast-data-transfer.github.io/) stands for "Fast Data Transfer". It is a command line application written in Java. With the plugin mechanism, FDT allows users to load user-defined classes for Pre- and Post-Processing of file transfers. Users can start their own server processes. If you have use cases for FDT, visit the [download page](https://github.com/fast-data-transfer/fdt/releases) to get `fdt.jar` to start. Please contact [hpc@nyu.edu](mailto:hpc@nyu.edu) for any questions.
63-
64-
## Copying Data from the Greene HPC Cluster to Torch HPC Cluster
65-
### Copying Data to Torch via the Command Line
66-
Torch has an available data transfer node (DTN) that can be used to upload data. You must authenticate similarly to the steps outlined on the Accessing Torch page.
67-
68-
```
69-
netid@localpc ~ $ rsync -avz -e ssh ~/testfile.txt netid@dtn012.hpc.nyu.edu:/scratch/netid/testfile.txt
70-
(netid@dtn012.hpc.nyu.edu) Authenticate with PIN BUUM5YHJX at https://microsoft.com/devicelogin and press ENTER.
71-
testfile.txt                      100%    0     0.0KB/s   00:00
72-
netid@localpc ~ $
73-
```
74-
## Copying Data to Torch via Globus
75-
Globus has been installed for Torch - you can log in at https://globus.org/ and search for the Torch home, scratch, or archive collections under nyu#torch.​
76-
77-
Globus works much the same as it did on Greene, so see our previous page on how to use it. Once you install Globus Connect Personal on your personal device you can easily transfer files between your local machine and Torch.
78-
79-
## File Transfer (Torch ↔ Greene)
80-
To ease data transfer between clusters, Torch storage has been mounted on the Greene Data Transfer Nodes (e.g. dtn-1.hpc.nyu.edu and dtn-2.hpc.nyu.edu).
81-
82-
This allows users to access the data under /torch:
83-
84-
```
85-
[netid@dtn-1]$ ls /torch
86-
archive home scratch share
87-
```
88-
89-
You can copy files using the rsync command from the Greene DTN:
90-
91-
```
92-
[netid@dtn-1]$ rsync /scratch/netid/my_file.txt /torch/scratch/netid/my_file.txt
93-
```

docs/hpc/07_containers/03_singularity_with_conda.md

Lines changed: 2 additions & 13 deletions
Original file line numberDiff line numberDiff line change
@@ -1,17 +1,5 @@
11
# Singularity with Conda
2-
Please note that Greene and Torch organize overlay files and Singularity images in different directories.
3-
4-
## Greene Directories
5-
Overlay Files:
6-
```
7-
/scratch/work/public/overlay-fs-ext3/
8-
```
9-
Singularity Files:
10-
```
11-
/scratch/work/public/singularity/
12-
```
13-
14-
## Torch Directories
2+
:::info
153
Overlay Files:
164
```
175
/share/apps/overlay-fs-ext3
@@ -20,6 +8,7 @@ Singularity Files:
208
```
219
/share/apps/images/
2210
```
11+
:::
2312

2413
## Using Singularity Overlays for Miniforge (Python & Julia)
2514
### Preinstallation Warning

docs/hpc/09_ood/02_jupyter_with_conda_singularity.mdx

Lines changed: 3 additions & 14 deletions
Original file line numberDiff line numberDiff line change
@@ -1,17 +1,5 @@
11
# Jupyter Notebook with Conda/Singularity in OOD
2-
Please note that Greene and Torch organize overlay files and Singularity images in different directories.
3-
4-
## Greene Directories
5-
Overlay Files:
6-
```
7-
/scratch/work/public/overlay-fs-ext3/
8-
```
9-
Singularity Files:
10-
```
11-
/scratch/work/public/singularity/
12-
```
13-
14-
## Torch Directories
2+
:::info
153
Overlay Files:
164
```
175
/share/apps/overlay-fs-ext3
@@ -20,6 +8,8 @@ Singularity Files:
208
```
219
/share/apps/images/
2210
```
11+
:::
12+
2313
## OOD + Singularity + conda
2414
This page describes how to use your Singularity with conda environment in OOD GUI at Torch.
2515

@@ -174,7 +164,6 @@ After it is running, you’ll be redirected to a compute node. From there, run s
174164

175165
### Configure iPython Kernels
176166
To create a kernel named my_env copy the template files to your home directory.
177-
Please note that kernel_template on Greene is stored under `/share/apps/mypy/src/kernel_template`
178167
```bash sh
179168
mkdir -p ~/.local/share/jupyter/kernels
180169
cd ~/.local/share/jupyter/kernels

0 commit comments

Comments
 (0)