Skip to content

Commit aa0dedb

Browse files
committed
docs: update documentation
1 parent c720b82 commit aa0dedb

4 files changed

Lines changed: 38 additions & 19 deletions

File tree

examples/science/af3-slurm/README.md

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -412,7 +412,6 @@ terraform_backend_defaults:
412412
413413
vars:
414414
# Define overall deployment variables
415-
deployment_name: af3-slurm # adjust if necessary
416415
project_id: <PROJEC_ID> # supply existing project id
417416
region: us-central1 # supply region with C3D-highmem and GPU capacity
418417
zone: us-central1-a # supply zone with C3D-highmem and GPU capacity

examples/science/af3-slurm/examples/simple_ipynb_launcher/README.md

Lines changed: 15 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -10,3 +10,18 @@ Please note that the launcher needs 2 specific setup steps:
1010

1111
## Usage Guide
1212
For usage of the Ipynb Launcher consult the [Step-by-Step Instructions](./Ipynb.md)
13+
14+
## Known Limitations
15+
You may encounter the following problems while using the notebook.
16+
17+
### Warning during dependency installation
18+
You may encounter the following warning during dependency installation:
19+
20+
```text
21+
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
22+
google-cloud-bigtable 1.7.3 requires grpc-google-iam-v1<0.13dev,>=0.12.3, but you have grpc-google-iam-v1 0.14.2 which is incompatible
23+
```
24+
25+
**Resolution**: This warning can be **safely ignored**.
26+
27+
The version mismatch does not impact the functionality required by this project. The `google-cloud-bigtable` package is not used in any critical code path, and no issues have been observed during execution.

examples/science/af3-slurm/examples/simple_ipynb_launcher/Setup-post-cluster-deployment.md

Lines changed: 22 additions & 17 deletions
Original file line numberDiff line numberDiff line change
@@ -29,7 +29,7 @@ ansible-playbook ipynb-upload-config.yml
2929
This step uploads the notebook (`slurm-rest-api-notebook.ipynb`) along with its required scripts and libraries to the bucket defined in the `af3ipynb_bucket` variable in `af3-slurm-deployment.yaml` file.
3030

3131
### 2. Grant Secret Access to the Notebook's Service Account
32-
**Where to run**: **On your local machine** (where the gcloud CLI is authenticated with access to your GCP project).
32+
**Where to run**: **On the system where you executed `gcluster`** (where the `gcloud` CLI is authenticated with access to your GCP project).
3333

3434
This setting ensures that the notebook server can successfully retrieve the specified secret by name. For this you need to make sure that the service account running the Jupyter Notebook instance (typically the Compute Engine default service account) has permission to access the Secret Manager secret that stores your SLURM REST token.
3535

@@ -47,7 +47,7 @@ You can verify this configuration in the Secret Manager section of the Google Cl
4747
<img src="adm/secret-manager.png" alt="secret-manager" width="1000">
4848

4949
### 3. Deploy the Notebook Environment
50-
**Where to run**: **On your local machine**, inside your cluster-toolkit directory.
50+
**Where to run**: **On the system where you executed `gcluster`**, under your `cluster-toolkit` directory.
5151

5252
Deploy the Jupyter Notebook environment using the following command:
5353

@@ -65,10 +65,15 @@ In the Google Cloud Console:
6565

6666
2. Open the JupyterLab interface for the newly deployed instance
6767

68-
3. Locate and open the `slurm-rest-api-notebook.ipynb` file. If you haven't modified the default value of `af3ipynb_bucket_local_mount` in the `af3-slurm-deployment.yaml`, the notebook should be available at `/home/jupyter/alphafold` folder.
68+
3. Locate and open the `slurm-rest-api-notebook.ipynb` file. If you haven't modified the default value of `af3ipynb_bucket_local_mount` in the `af3-slurm-deployment.yaml`, the notebook files will be mounted to `/home/jupyter/alphafold` on the Jupyter notebook system.
69+
70+
When you first connect to Jupyter Notebook, it only shows the alphafold folder — this can appear as if it's located at `/alphafold`. In reality, Jupyter starts in the `/home/jupyter` directory, and the `alphafold` folder is located inside it.
71+
72+
So while it looks like `/alphafold` in the interface, the actual path is `/home/jupyter/alphafold`.
6973

7074
### 5. Verify REST Token Access
71-
**Where to run**: **Inside the JupyterLab terminal** of your deployed Vertex AI Workbench instance.
75+
**Where to run**: **On the system where you executed `gcluster`** (where the `gcloud` CLI is authenticated with access to your GCP project, similar to step [Grant Secret Access to the Notebook's Service Account](#2-grant-secret-access-to-the-notebooks-service-account)
76+
).
7277

7378
To verify that Secret Manager access is properly configured, open a terminal within JupyterLab and run the following command:
7479

@@ -80,22 +85,22 @@ If the command returns the secret value successfully, it confirms that the noteb
8085

8186
<img src="adm/rest_api.png" alt="slrum rest api" width="1000">
8287

83-
## Teardown
84-
To remove the Jupyter Notebook deployment when it is no longer needed, run the following command:
85-
86-
```bash
87-
./gcluster destroy af3-slurm-ipynb --auto-approve
88-
```
89-
90-
> [!WARNING]
91-
> If you do not destroy the Jupyter Notebook deployment, it may continue to incur costs.
92-
> Additionally, any Cloud Storage buckets you created (via the CLI or console) will not be automatically deleted. You are responsible for cleaning them up manually to avoid unnecessary charges.
93-
> For deleting the buckets consult [Delete buckets](https://cloud.google.com/storage/docs/deleting-buckets).
88+
## Using the environment
89+
Go to [Ipynb.md](./Ipynb.md) for documentation on how to use the IPython environment.
9490

9591
## Customization
9692
You can adjust the notebook setup behavior using blueprint variables in the deployment YAML.
9793
All configurations should be validated before running jobs.
9894
If further modifications to SLURM REST/API Server behavior are required, you must destroy and redeploy the cluster with the updated settings.
9995

100-
## Using the environment
101-
Go to [Ipynb.md](./Ipynb.md) for documentation on how to use the IPython environment.
96+
## Teardown
97+
To remove the Jupyter Notebook deployment when it is no longer needed, run the following command:
98+
99+
```bash
100+
./gcluster destroy af3-slurm-ipynb --auto-approve
101+
```
102+
103+
> [!WARNING]
104+
> If you do not destroy the Jupyter Notebook deployment, it may continue to incur costs.
105+
> Additionally, any Cloud Storage buckets you created (via the CLI or console) will not be automatically deleted. You are responsible for cleaning them up manually to avoid unnecessary charges.
106+
> For deleting the buckets consult [Delete buckets](https://cloud.google.com/storage/docs/deleting-buckets).

examples/science/af3-slurm/examples/simple_ipynb_launcher/Setup-pre-cluster-deployment.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -24,7 +24,7 @@ gcloud storage buckets create gs://${UNIQUE_JOB_BUCKET} \
2424
```
2525

2626
### Configure Secret Manager
27-
The IPython notebook will need a secure connection with the Slurm REST API servers. We are using the Google Cloud Secret Manager to manage the necessary credentials in a secure way. Please follow the guideline [here](https://cloud.google.com/secret-manager/docs/create-secret-quickstart) to create a Secret Manager.
27+
The IPython notebook will need a secure connection with the Slurm REST API servers. We are using the Google Cloud Secret Manager to manage the necessary credentials in a secure way. Please follow the guideline [here](https://cloud.google.com/secret-manager/docs/create-secret-quickstart) to create a secret using Secret Manager.
2828

2929
You do not need to manually add any data to the secret; the SLURM token will be automatically populated by the system.
3030

0 commit comments

Comments
 (0)