|
| 1 | +--- |
| 2 | +title: "HPC Spring School June 2026: SURF Research Cloud Workshop" |
| 3 | +--- |
| 4 | + |
| 5 | +## Overview |
| 6 | + |
| 7 | +Welcome to the SURF Research Cloud workshop for the UU HPC Spring School 2026! |
| 8 | + |
| 9 | +During this hands-on workshop, you'll learn how to work effectively with SURF Research Cloud. There are several tutorials available for you to explore: |
| 10 | + |
| 11 | +| Topic | Section | Estimated time | |
| 12 | +| --- | --- | --- | |
| 13 | +| **Working with R/Python environments** | [Go to section](#working-with-r-python-environments) | 15-45 minutes | |
| 14 | +| **Data transfer methods** | [Go to section](#data-transfer-methods) | 15-45 minutes | |
| 15 | +| **Working with Ollama** | [Go to section](#working-with-ollama) | 20-40 minutes | |
| 16 | +| **Running long jobs** | [Go to section](#running-long-jobs-via-the-command-line) | 10-30 minutes | |
| 17 | +| **VS Code Remote-SSH** | [Go to section](#connecting-vs-code-to-research-cloud) | 30 minutes | |
| 18 | + |
| 19 | +Each tutorial includes step-by-step instructions. You can choose the ones most relevant to your research needs or interests. While there are several workspaces available that you can use to follow the tutorials, we recommend using the [VRE Lab](../workspaces/programming/vre-lab.qmd) workspace for most of them, as it comes with many relevant tools pre-installed. |
| 20 | + |
| 21 | +## Prerequisites |
| 22 | + |
| 23 | +**Required** |
| 24 | + |
| 25 | +Before starting the tutorials, you need: |
| 26 | + |
| 27 | +1. **SURF Research Cloud account**: You can login here [**Research Cloud portal**](https://portal.live.surfresearchcloud.nl/) |
| 28 | +2. **Active workspace**: You will need to create a workspace, depending on the tutorial you wish to follow. See [How to Create a Workspace](../first-steps.qmd#create-a-workspace) for guidance. |
| 29 | + |
| 30 | +**Recommended** |
| 31 | + |
| 32 | +Familiarity with the command line (terminal), git, GitHub and basic knowledge of Python/R will be helpful for some tutorials. |
| 33 | + |
| 34 | +## Workshop Tutorials |
| 35 | + |
| 36 | +### 1. Working with R/Python Environments {#working-with-r-python-environments} |
| 37 | + |
| 38 | +Learn how to create, manage, and use Python and R environments in your workspace. Working with environments is good practice for creating robust and reproducible projects, and makes it easier to install the exact same package versions that you are using currentlyon SURF Research Cloud. |
| 39 | + |
| 40 | +**What you'll learn:** |
| 41 | + |
| 42 | +- Creating virtual environments and managing packages |
| 43 | +- Creating requirements files for Python and R |
| 44 | +- Installing packages on SURF Research Cloud using `uv`, `conda`, and `renv` |
| 45 | + |
| 46 | +**Tutorials:** |
| 47 | + |
| 48 | +- [Working with Python Environments and Best Practices](../manuals/python-environment.qmd) |
| 49 | +- [Working with R Environments and Best Practices](../manuals/r-environment.qmd) |
| 50 | + |
| 51 | +We recommend using the [VRE Lab](../workspaces/programming/vre-lab.qmd) workspace to follow these tutorial. Select `Python tools` (for working with Python Environments) and/or `RStudioUU` (for working with R Environments) under optional components in the last step of creating your workspace. |
| 52 | + |
| 53 | +**Estimated time:** 15-45 minutes (depending on any previous experience with environment management tools) |
| 54 | + |
| 55 | +--- |
| 56 | + |
| 57 | +### 2. Data Transfer Methods {#data-transfer-methods} |
| 58 | + |
| 59 | +Transfer data to your Research Cloud workspace from your local computer, cloud storage, Yoda and/or GitHub. Learn which method works best for your data source and file sizes. |
| 60 | + |
| 61 | +**What you'll learn:** |
| 62 | + |
| 63 | +- Transferring files from your PC/laptop |
| 64 | +- Configuring connections to cloud storage such as Surfdrive, Researchdrive and/or Yoda |
| 65 | +- Choosing the right transfer method for your needs |
| 66 | + |
| 67 | +**Tutorials:** |
| 68 | + |
| 69 | +To find the best method to transfer your data, check out this [Interactive Data Transfer Tool.](../manuals/data-transfer-options.qmd) It will help you determine the best method based on your data source, workspace, and file sizes. |
| 70 | + |
| 71 | +You can explore the following tutorials for specific transfer methods: |
| 72 | + |
| 73 | +- [Data Transfer to and from Yoda using iBridges](../manuals/ibridges.qmd) |
| 74 | +- [Data Transfer to and from Yoda using iCommands](../manuals/icommands.qmd) |
| 75 | +- [Data Transfer from your computer using scp and rsync](../manuals/ssh-data-transfer-methods.qmd) |
| 76 | +- [Data Transfer between Research Cloud and Online Storage (Surfdrive, Researchdrive) using Rclone](../manuals/rclone-researchcloud.qmd) |
| 77 | +- [Data Transfer from GitHub/GitLab using Git](../manuals/git-clone.qmd) |
| 78 | + |
| 79 | +**Estimated time:** 15-45 minutes (depending on tutorial selected) |
| 80 | + |
| 81 | +--- |
| 82 | + |
| 83 | +### 3. Working with Ollama {#working-with-ollama} |
| 84 | + |
| 85 | +Set up and use [Ollama](https://ollama.com/) directly in your Jupyter notebooks, e.g. for data extraction from documents or image analysis. |
| 86 | + |
| 87 | +**What you'll learn:** |
| 88 | + |
| 89 | +- Installing and configuring Ollama |
| 90 | +- Downloading models |
| 91 | +- Data extraction and Image description in Jupyter notebooks |
| 92 | + |
| 93 | +**Relevant Workspaces:** [VRE Lab](../workspaces/programming/vre-lab.qmd) with `Python tools` as optional component, [Python Workbench Desktop](../workspaces/programming/python-workbench.qmd) |
| 94 | + |
| 95 | +**Tutorial:** [Setting up and Using Ollama](../manuals/ollama.qmd) |
| 96 | + |
| 97 | +**Estimated time:** 20-40 minutes |
| 98 | + |
| 99 | +--- |
| 100 | + |
| 101 | +### 4. Running Long Jobs via the Command Line {#running-long-jobs-via-the-command-line} |
| 102 | + |
| 103 | +Keep computational tasks running even after (accidentally) closing your terminal or SSH connection. Essential for long-running analyses and simulations. It is also possible to automate pausing of the workspace to save costs. |
| 104 | + |
| 105 | +**What you'll learn:** |
| 106 | + |
| 107 | +- Running jobs in the background |
| 108 | +- Checking job status and output |
| 109 | +- Automating workspace pausing |
| 110 | + |
| 111 | +**Tutorial:** |
| 112 | + |
| 113 | +- [Running Long Jobs](../manuals/long-jobs.qmd) |
| 114 | +This tutorial is relevant if you have an analysis script or simulation that takes a long time to execute. |
| 115 | + |
| 116 | +**Estimated time:** 10-30 minutes |
| 117 | + |
| 118 | +--- |
| 119 | + |
| 120 | +### 5. Connecting VS Code to Research Cloud {#connecting-vs-code-to-research-cloud} |
| 121 | + |
| 122 | +Connect Visual Studio Code on your PC to your SURF Research Cloud workspace. This is useful e.g. if you want to use the VS Code extensions that you have installed. |
| 123 | + |
| 124 | +**What you'll learn:** |
| 125 | + |
| 126 | +- Setting up VS Code Remote-SSH extension |
| 127 | +- Connecting to your workspace |
| 128 | +- Editing files remotely |
| 129 | +- Using VS Code extensions on the remote workspace |
| 130 | + |
| 131 | +Works on any workspace with SSH access, however [VRE Lab](../workspaces/programming/vre-lab.qmd) is recommended. |
| 132 | + |
| 133 | +**Tutorial:** |
| 134 | + |
| 135 | +- [VS Code Remote-SSH](../manuals/vscode-to-researchcloud.qmd) |
| 136 | + |
| 137 | +**Estimated time:** 30 minutes |
| 138 | + |
| 139 | +--- |
0 commit comments