Skip to content

Commit a936f01

Browse files
committed
Greene -> Torch
1 parent 70618b7 commit a936f01

2 files changed

Lines changed: 10 additions & 10 deletions

File tree

docs/cloud/03_hpc_bursting_to_cloud/01_intro.md

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -38,17 +38,17 @@ However, approval is required to submit jobs to the partitions. Partitions are s
3838

3939
### Storage
4040

41-
Greene's `/home` and `/scratch` are mounted (available) at login node of bursting setup.
41+
Torch's `/home` and `/scratch` are mounted (available) at login node of bursting setup.
4242

43-
Compute node however, do have independent `/home` and `/scratch`. These `/home` and `/scratch` mounts are persistent, are available from any compute node and independent from `/home` and `/scratch` at Greene.
43+
Compute node however, do have independent `/home` and `/scratch`. These `/home` and `/scratch` mounts are persistent, are available from any compute node and independent from `/home` and `/scratch` at Torch.
4444

45-
User may need to copy data from Greene's `/home` or `/scratch` to GCP mounted `/home` or `/scratch`
45+
User may need to copy data from Torch's `/home` or `/scratch` to GCP mounted `/home` or `/scratch`
4646

4747
When you run a bursting job the compute nodes will not see those file mounts. This means that you need to copy data to the burst instance.
4848

4949
The file systems are independent, so you must copy data to the GCP location.
5050

51-
To copy data, you must first start an interactive job. Once started, you can copy your data using scp from the HPC Data Transfer Nodes (greene-dtn). Below is the basic setup to copy files from Greene to your home directory while you are in an interactive bursting job:
51+
To copy data, you must first start an interactive job. Once started, you can copy your data using scp from the HPC Data Transfer Nodes (greene-dtn). Below is the basic setup to copy files from Torch to your home directory while you are in an interactive bursting job:
5252
```sh
5353
scp <NetID>@greene-dtn.hpc.nyu.edu:/path/to/files /home/<NetID>/
5454
```

docs/cloud/04_dataproc/02_data_management.md

Lines changed: 6 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -54,8 +54,8 @@ You can find the full path to your file/folder in the ingest storage by clicking
5454
Data uploaded into the ingest website will be visible to all members of the cluster temporarily. If you are uploading files that cannot be shared with all cluster users (e.g., code) please use the alternate method described below.
5555
:::
5656

57-
## Uploading Data to HDFS from Greene
58-
First download gcloud on a desktop computer with a browser by following the instructions [here](https://cloud.google.com/sdk/docs/install). Ensure that you run the install command described as optional in step 4. Log into Greene and activate the Google Cloud command line interface module:
57+
## Uploading Data to HDFS from Torch
58+
First download gcloud on a desktop computer with a browser by following the instructions [here](https://cloud.google.com/sdk/docs/install). Ensure that you run the install command described as optional in step 4. Log into Torch and activate the Google Cloud command line interface module:
5959
```sh
6060
ml load google-cloud-sdk/379.0.0
6161
```
@@ -65,7 +65,7 @@ gcloud auth login
6565
```
6666
Copy and paste the command that you are given into a terminal application on your desktop and run it. When prompted, type y to proceed. If you are signed into multiple Google accounts, you will then be presented with a browser window where you can choose your account. Select your NYU account. Google will then present a message saying that “Google Cloud SDK wants to access your Google Account”. Click Allow.
6767

68-
Copy the URL that you are given in the terminal window, and paste it into your Greene session on the line where gcloud asks for it.
68+
Copy the URL that you are given in the terminal window, and paste it into your Torch session on the line where gcloud asks for it.
6969

7070
Type gcloud auth list to verify that you are logged in:
7171
```sh
@@ -81,12 +81,12 @@ Now that you are logged in, use the instructions under the Small Transfers or La
8181

8282
### Small Transfers
8383

84-
Run the following commands on Greene to ensure that gcloud knows that you are using it with Dataproc (rather than a different Google Cloud application):
84+
Run the following commands on Torch to ensure that gcloud knows that you are using it with Dataproc (rather than a different Google Cloud application):
8585
```sh
8686
gcloud config set project hpc-dataproc-19b8
8787
gcloud config set compute/zone us-central1-f
8888
```
89-
Run the following command on Greene to upload your file to your filesystem home directory on Dataproc:
89+
Run the following command on Torch to upload your file to your filesystem home directory on Dataproc:
9090
```sh
9191
gcloud compute scp MYFILE nyu-dataproc-m:~
9292
```
@@ -99,7 +99,7 @@ hdfs dfs -put /home/<your_netid>_nyu_edu/<path_to_file> <hdfs_path>
9999

100100
### Large Transfers
101101

102-
On Greene, run the following to upload a single file to the staging bucket:
102+
On Torch, run the following to upload a single file to the staging bucket:
103103

104104
```sh
105105
gsutil cp FILE gs://nyu-dataproc-hdfs-ingest

0 commit comments

Comments
 (0)