Skip to content

Commit 71d8f45

Browse files
committed
tools & software rework
1 parent 6e9749e commit 71d8f45

3 files changed

Lines changed: 22 additions & 14 deletions

File tree

docs/hpc/06_tools_and_software/04_python_packages_with_virtual_environments.mdx

Lines changed: 6 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -18,8 +18,11 @@ module load python/intel/3.8.6
1818
## Automatic deletion of your files
1919
This page describes the installation of packages on /scratch. One has to remember, though, that files stored in the HPC scratch file system are subject to the HPC Scratch old file purging policy: <br />
2020

21-
::::warning[Automatic deletion of your files]
22-
Files on the /scratch file system that have not been accessed for 60 or more days will be purged (see [HPC Storage](../03_storage/01_intro_and_data_management.mdx) for details).
21+
<details>
22+
<summary>
23+
**Automatic deletion of your files**
24+
Files on the `/scratch` file system that have not been accessed for 60 or more days will be purged (see [HPC Storage](../03_storage/01_intro_and_data_management.mdx) for details). Click to see how you can work around this limitation.
25+
</summary>
2326
:::tip
2427
Thus you can consider the following options:
2528

@@ -28,7 +31,7 @@ Thus you can consider the following options:
2831
- You can do this automatically. For example, within a workflow of a pipeline software like [Nextflow](https://www.nextflow.io/)
2932
- Pay for "Research Project Space" - for details see [Research Project Space](../03_storage/05_research_project_space.mdx)
3033
:::
31-
::::
34+
</details>
3235

3336
## Create virtual environment
3437
It is advisable to create private environment inside the project directory. This boosts reproducibility and does not use space in `/home/$USER`:

docs/hpc/06_tools_and_software/05_r_packages_with_renv.mdx

Lines changed: 7 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -26,8 +26,11 @@ module load r/gcc/4.5.0
2626
R
2727
```
2828

29-
::::warning[Automatic deletion of your files]
30-
Files on the /scratch file system that have not been accessed for 60 or more days will be purged (see [HPC Storage](../03_storage/01_intro_and_data_management.mdx) for details).
29+
<details>
30+
<summary>
31+
**Automatic deletion of your files**
32+
Files on the `/scratch` file system that have not been accessed for 60 or more days will be purged (see [HPC Storage](../03_storage/01_intro_and_data_management.mdx) for details). Click to see how you can work around this limitation.
33+
</summary>
3134
:::tip
3235
Thus you can consider the following options:
3336
- Reinstall your packages if some of the files get deleted
@@ -36,7 +39,8 @@ Thus you can consider the following options:
3639
- Pay for "Research Project Space" - for details see [Research Project Space](../03_storage/05_research_project_space.mdx)
3740
- Use Singularity and install packages within a corresponding overlay file - Details available at [Squash File System and Singularity](../07_containers/04_squash_file_system_and_singularity.md)
3841
:::
39-
::::
42+
</details>
43+
4044

4145
### Cache directory setup
4246
By default, renv will cache package installation files to your home directory (most likely either in `~/.local/share/renv` or `~/.cache/R/renv/` or something similar).

docs/hpc/06_tools_and_software/06_conda_environments.mdx

Lines changed: 9 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,7 @@
11
# Conda Environments (Python, R)
22

33
:::tip
4-
This page describes how you can create conda environments without containers in `$SCRATCH`/`/home/$USER`. We strongly encourage you to create conda enviroments within Overlay files attached to Apptainer containers [as decribed in this section](../07_containers/03_singularity_with_conda.md). Please note that creating both kinds of conda environments is strongly discouraged as it leads to packages from one environment being accidentally used in another.
4+
This page describes how you can create conda environments without containers in `$SCRATCH`/`/home/$USER`. We strongly encourage you to create conda environments within Overlay files attached to Apptainer containers [as described in this section](../07_containers/03_singularity_with_conda.md). Please note that creating both kinds of conda environments is strongly discouraged as it leads to packages from one environment being accidentally used in another.
55
:::
66

77

@@ -30,21 +30,22 @@ However, Conda has a significantly larger number of pre-compiled packages.
3030
- Conda does not take advantage of packages already installed in the system (while [virtualenv and venv](./04_python_packages_with_virtual_environments.mdx) do)
3131
- As you will see below, you may need to do additional steps to keep track of all installed packages (including those installed by pip and/or install.packages)
3232

33-
::::warning[Automatic deletion of your files]
34-
This page describes the installation of packages on `/scratch`. One has to remember, though, that files stored in the HPC scratch file system are subject to the HPC Scratch old file purging policy: <br />
35-
Files on the `/scratch` file system that have not been accessed for 60 or more days will be purged. <br />
36-
You can read more this in [Data Management](../03_storage/01_intro_and_data_management.mdx).
3733

34+
<details>
35+
<summary>
36+
**Automatic deletion of your files**
37+
Files on the `/scratch` file system that have not been accessed for 60 or more days will be purged (see [HPC Storage](../03_storage/01_intro_and_data_management.mdx) for details). Click to see how you can work around this limitation.
38+
</summary>
3839
:::tip
3940
Thus you can consider the following options:
40-
4141
- Reinstall your packages if some of the files get deleted
4242
- You can do this manually
4343
- You can do this automatically. For example, within a workflow of a pipeline software like [Nextflow](https://www.nextflow.io/)
4444
- Pay for "Research Project Space" - for details see [Research Project Space](../03_storage/05_research_project_space.mdx)
45-
- Use Singularity and install packages within a corresponding overlay file - for details see [Singularity with Conda](../07_containers/03_singularity_with_conda.md)
45+
- Use Singularity and install packages within a corresponding overlay file - Details available at [Squash File System and Singularity](../07_containers/04_squash_file_system_and_singularity.md)
4646
:::
47-
::::
47+
</details>
48+
4849

4950
## Initializing Conda
5051
Load anaconda module

0 commit comments

Comments
 (0)