You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Adjust tables to prevent breaks in the Argument column of tables by adding a stylesheet.
user-interactions guide:
- cleanup markdown warnings in user-interactions guide.
- commonize language around profiles
Signed-off-by: Anthony Floeder <anthony.floeder@hpe.com>
Copy file name to clipboardExpand all lines: docs/guides/user-interactions/readme.md
+29-21Lines changed: 29 additions & 21 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -15,17 +15,18 @@ Once the job is running on compute nodes, the application can find access to Rab
15
15
16
16
### jobdw
17
17
18
-
The `jobdw` directive command tells the Rabbit software to create a file system on the Rabbit hardware for the lifetime of the user's job. At the end of the job, any data that is not moved off of the file system either by the application or through a `copy_out` directive will be lost. Multiple `jobdw` directives can be listed in the same job script.
18
+
The `jobdw` directive command tells the Rabbit software to create a file system on the Rabbit hardware for the lifetime of the user's job. At the end of the job, any data that is not moved off of the file system either by the application or through a `copy_out` directive is lost. Multiple `jobdw` directives can be listed in the same job script.
19
19
20
20
#### Command Arguments
21
+
21
22
| Argument | Required | Value | Notes |
22
23
|----------|----------|-------|-------|
23
-
|`type`| Yes |`raw`, `xfs`, `gfs2`, `lustre`| Type defines how the storage should be formatted. For Lustre file systems, a single file system is created that is mounted by all computes in the job. For raw, xfs, and GFS2 storage, a separate file system is allocated for each compute node. |
24
+
|`type`| Yes |`raw`, `xfs`, `gfs2`, `lustre`| Type defines how the storage should be formatted. For Lustre file systems, a single file system is created that is mounted by all computes in the job. For raw, xfs, and GFS2 storage, a separate file system is allocated for each compute node. |
24
25
|`capacity`| Yes | Allocation size with units. `1TiB`, `100GB`, etc. | Capacity interpretation varies by storage type. For Lustre file systems, capacity is the aggregate OST capacity. For raw, xfs, and GFS2 storage, capacity is the capacity of the file system for a single compute node. Capacity suffixes are: `KB`, `KiB`, `MB`, `MiB`, `GB`, `GiB`, `TB`, `TiB`|
25
26
|`name`| Yes | String including numbers and '-' | This is a name for the storage allocation that is unique within a job |
26
-
|`profile`| No | Profile name | This specifies which profile to use when allocating storage. Profiles include `mkfs` and `mount` arguments, file system layout, and many other options. Profiles are created by admins. When no profile is specified, the default profile is used. More information about storage profiles can be found in the [Storage Profiles](../storage-profiles/readme.md) guide. |
27
+
|`profile`| No | Profile name | This specifies which profile to use when allocating storage. Profiles include `mkfs` and `mount` arguments, file system layout, and many other options. When no profile is specified, the default profile is used. More information about storage profiles can be found in the [Storage Profiles](../storage-profiles/readme.md) guide. **Note:** Admins are responsible for profiles.|
27
28
|`requires`| No |`copy-offload`| Use this option with [Copy Offload](../data-movement/copy-offload.md). This is for users who want to initiate data movement to or from the Rabbit storage from within their application. |
28
-
|`requires`| No |`user-container-auth`| Use this option with [User Containers](../user-containers/readme.md) that have an application that expects to use the same kind of TLS certificate and [per-Workflow token](../data-movement/copy-offload.md#per-workflow-token) that is configured for [Copy Offload](../data-movement/copy-offload.md). |
29
+
|`requires`| No |`user-container-auth`| Use this option with [User Containers](../user-containers/readme.md) that have an application that expects to use the same kind of TLS certificate and [per-Workflow token](../data-movement/copy-offload.md#wlm-and-the-per-workflow-token) that is configured for [Copy Offload](../data-movement/copy-offload.md). |
29
30
30
31
#### Examples
31
32
@@ -52,12 +53,13 @@ This directive results in a 50GB GFS2 file system created for each compute node
52
53
The `create_persistent` command results in a storage allocation on the Rabbit nodes that lasts beyond the lifetime of the job. This is useful for creating a file system that can share data between jobs. Only a single `create_persistent` directive is allowed in a job, and it cannot be in the same job as a `destroy_persistent` directive. See [persistentdw](readme.md#persistentdw) to utilize the storage in a job.
53
54
54
55
#### Command Arguments
56
+
55
57
| Argument | Required | Value | Notes |
56
58
|----------|----------|-------|-------|
57
-
|`type`| Yes |`raw`, `xfs`, `gfs2`, `lustre`| Type defines how the storage should be formatted. For Lustre file systems, a single file system is created. For raw, xfs, and GFS2 storage, a separate file system is allocated for each compute node in the job. |
59
+
|`type`| Yes |`raw`, `xfs`, `gfs2`, `lustre`| Type defines how the storage should be formatted. For Lustre file systems, a single file system is created. For raw, xfs, and GFS2 storage, a separate file system is allocated for each compute node in the job. |
58
60
|`capacity`| Yes | Allocation size with units. `1TiB`, `100GB`, etc. | Capacity interpretation varies by storage type. For Lustre file systems, capacity is the aggregate OST capacity. For raw, xfs, and GFS2 storage, capacity is the capacity of the file system for a single compute node. Capacity suffixes are: `KB`, `KiB`, `MB`, `MiB`, `GB`, `GiB`, `TB`, `TiB`|
59
61
|`name`| Yes | Lowercase string including numbers and '-' | This is a name for the storage allocation that is unique within the system |
60
-
|`profile`| No | Profile name | This specifies which profile to use when allocating storage. Profiles include `mkfs` and `mount` arguments, file system layout, and many other options. Profiles are created by admins. When no profile is specified, the default profile is used. The profile used when creating the persistent storage allocation is the same profile used by jobs that use the persistent storage. More information about storage profiles can be found in the [Storage Profiles](../storage-profiles/readme.md) guide.|
62
+
|`profile`| No | Profile name | This specifies which profile to use when allocating storage. Profiles include `mkfs` and `mount` arguments, file system layout, and many other options. When no profile is specified, the default profile is used. The profile used when creating the persistent storage allocation is the same profile used by jobs that use the persistent storage. More information about storage profiles can be found in the [Storage Profiles](../storage-profiles/readme.md) guide. **Note:** Admins are responsible for profiles.|
61
63
62
64
#### Examples
63
65
@@ -74,32 +76,36 @@ This directive results in a 100GiB xfs file system created for each compute node
74
76
This directive results in a single 10TiB Lustre file system being created that can be accessed later by any compute nodes in the system. Multiple jobs can access a Rabbit Lustre file system at the same time. This job can be scheduled with a single compute node (or zero compute nodes if the WLM allows), without any limitations on compute node counts for subsequent jobs using the persistent Lustre file system.
75
77
76
78
### destroy_persistent
77
-
The `destroy_persistent` command will delete persistent storage that was allocated by a corresponding `create_persistent`. If the persistent storage is currently in use by a job, then the job containing the `destroy_persistent` command will fail. Only a single `destroy_persistent` directive is allowed in a job, and it cannot be in the same job as a `create_persistent` directive.
79
+
80
+
The `destroy_persistent` command deletes persistent storage that was allocated by a corresponding `create_persistent`. If the persistent storage is currently in use by a job, then the job containing the `destroy_persistent` command fails. Only a single `destroy_persistent` directive is allowed in a job, and it cannot be in the same job as a `create_persistent` directive.
78
81
79
82
#### Command Arguments
83
+
80
84
| Argument | Required | Value | Notes |
81
85
|----------|----------|-------|-------|
82
-
|`name`| Yes | Lowercase string including numbers and '-' | This is a name for the persistent storage allocation that will be destroyed |
86
+
|`name`| Yes | Lowercase string including numbers and '-' | This is a name for the persistent storage allocation that is destroyed |
83
87
84
88
#### Examples
85
89
86
90
```bash
87
91
#DW destroy_persistent name=shared-data
88
92
```
89
93
90
-
This directive will delete the persistent storage allocation with the name `shared-data`
94
+
This directive deletes the persistent storage allocation with the name `shared-data`
91
95
92
96
### persistentdw
97
+
93
98
The `persistentdw` command makes an existing persistent storage allocation available to a job. The persistent storage must already be created from a `create_persistent` command in a different job script. Multiple `persistentdw` commands can be used in the same job script to request access to multiple persistent allocations.
94
99
95
100
Persistent Lustre file systems can be accessed from any compute nodes in the system, and the compute node count for the job can vary as needed. Multiple jobs can access a persistent Lustre file system concurrently if desired. Raw, xfs, and GFS2 file systems can only be accessed by compute nodes that have a physical connection to the Rabbits hosting the storage, and jobs accessing these storage types must have the same compute node count as the job that made the persistent storage.
96
101
97
102
#### Command Arguments
103
+
98
104
| Argument | Required | Value | Notes |
99
105
|----------|----------|-------|-------|
100
-
|`name`| Yes | Lowercase string including numbers and '-' | This is a name for the persistent storage that will be accessed |
106
+
|`name`| Yes | Lowercase string including numbers and '-' | This is a name for the persistent storage that is accessed |
101
107
|`requires`| No |`copy-offload`| Use this option with [Copy Offload](../data-movement/copy-offload.md). This is for users who want to initiate data movement to or from the Rabbit storage from within their application. |
102
-
|`requires`| No |`user-container-auth`| Use this option with [User Containers](../user-containers/readme.md) that have an application that expects to use the same kind of TLS certificate and [per-Workflow token](../data-movement/copy-offload.md#per-workflow-token) that is configured for [Copy Offload](../data-movement/copy-offload.md). |
108
+
|`requires`| No |`user-container-auth`| Use this option with [User Containers](../user-containers/readme.md) that have an application that expects to use the same kind of TLS certificate and [per-Workflow token](../data-movement/copy-offload.md#wlm-and-the-per-workflow-token) that is configured for [Copy Offload](../data-movement/copy-offload.md). |
103
109
104
110
#### Examples
105
111
@@ -111,14 +117,15 @@ This directive causes the `shared-data` persistent storage allocation to be moun
111
117
112
118
### copy_in/copy_out
113
119
114
-
The `copy_in` and `copy_out` directives are used to move data to and from the storage allocations on Rabbit nodes. The `copy_in` directive requests that data be moved into the Rabbit file system before application launch, and the `copy_out` directive requests data to be moved off of the Rabbit file system after application exit. This is different from data-movement that is requested through the copy-offload API, which occurs during application runtime. Multiple `copy_in` and `copy_out` directives can be included in the same job script. More information about data movement can be found in the [Data Movement](../data-movement/readme.md) documentation.
120
+
The `copy_in` and `copy_out` directives are used to move data to and from the storage allocations on Rabbit nodes. The `copy_in` directive requests that data be moved into the Rabbit file system before application launch, and the `copy_out` directive requests data to be moved off of the Rabbit file system after application exit. Multiple `copy_in` and `copy_out` directives can be included in the same job script. This is different from data-movement that is requested through the copy-offload API, which occurs during application runtime. More information about data movement can be found in the [Data Movement](../data-movement/readme.md) documentation.
115
121
116
122
#### Command Arguments
117
-
| Argument | Required | Value | Notes |
118
-
|----------|----------|-------|-------|
123
+
124
+
|Argument|Required|Value|Notes|
125
+
|--------|----------|-------|-------|
119
126
|`source`| Yes |`[path]`, `$DW_JOB_[name]/[path]`, `$DW_PERSISTENT_[name]/[path]`|`[name]` is the name of the Rabbit persistent or job storage as specified in the `name` argument of the `jobdw` or `persistentdw` directive. Any `'-'` in the name from the `jobdw` or `persistentdw` directive should be changed to a `'_'` in the `copy_in` and `copy_out` directive. |
120
127
|`destination`| Yes |`[path]`, `$DW_JOB_[name]/[path]`, `$DW_PERSISTENT_[name]/[path]`|`[name]` is the name of the Rabbit persistent or job storage as specified in the `name` argument of the `jobdw` or `persistentdw` directive. Any `'-'` in the name from the `jobdw` or `persistentdw` directive should be changed to a `'_'` in the `copy_in` and `copy_out` directive. |
121
-
|`profile`| No | Profile name | This specifies which profile to use when copying data. Profiles specify the copy command to use, MPI arguments, and how output gets logged. If no profile is specified then the default profile is used. Profiles are created by an admin. |
128
+
|`profile`| No | Profile name | This specifies the profile to use when copying data. Profiles specify the copy command to use, MPI arguments, and how output is logged. If no profile is specified then the default profile is used. More information about datamovement profiles can be found in the [DataMovement Profiles](../data-movement/readme.md#data-movement-profiles) guide. **Note:** Admins are responsible for profiles.|
122
129
123
130
#### Examples
124
131
@@ -156,13 +163,14 @@ This set of directives makes use of a persistent storage allocation and a job st
156
163
The `container` directive is used to launch user containers on the Rabbit nodes. The containers have access to `jobdw`, `persistentdw`, or global Lustre storage as specified in the `container` directive. More documentation for user containers can be found in the [User Containers](../user-containers/readme.md) guide. Only a single `container` directive is allowed in a job.
157
164
158
165
#### Command Arguments
166
+
159
167
| Argument | Required | Value | Notes |
160
168
|----------|----------|-------|-------|
161
169
|`name`| Yes | Lowercase string including numbers and '-' | This is a name for the container instance that is unique within a job |
162
-
|`profile`| Yes | Profile name | This specifies which container profile to use. The container profile contains information about which container to run, which file system types to expect, which network ports are needed, and many other options. An admin is responsible for creating the container profiles.|
163
-
|`DW_JOB_[expected]`| No |`jobdw` storage allocation `name`| The container profile will list`jobdw` file systems that the container requires. `[expected]` is the name as specified in the container profile |
164
-
|`DW_PERSISTENT_[expected]`| No |`persistentdw` storage allocation `name`| The container profile will list`persistentdw` file systems that the container requires. `[expected]` is the name as specified in the container profile |
165
-
|`DW_GLOBAL_[expected]`| No | Global lustre path | The container profile will list global Lustre file systems that the container requires. `[expected]` is the name as specified in the container profile |
170
+
|`profile`| Yes | Profile name | This specifies which container profile to use. The container profile contains information about which container to run, which file system types to expect, which network ports are needed, and many other options. **Note:** Admins are responsible for profiles.|
171
+
|`DW_JOB_[expected]`| No |`jobdw` storage allocation `name`| The container profile lists`jobdw` file systems that the container requires. `[expected]` is the name as specified in the container profile |
172
+
|`DW_PERSISTENT_[expected]`| No |`persistentdw` storage allocation `name`| The container profile lists`persistentdw` file systems that the container requires. `[expected]` is the name as specified in the container profile |
173
+
|`DW_GLOBAL_[expected]`| No | Global lustre path | The container profile lists global Lustre file systems that the container requires. `[expected]` is the name as specified in the container profile |
166
174
167
175
#### Examples
168
176
@@ -179,8 +187,8 @@ The WLM makes a set of environment variables available to the job application ru
179
187
180
188
| Environment Variable | Value | Notes |
181
189
|----------------------|-------|-------|
182
-
|`DW_JOB_[name]`| Mount path of a `jobdw` file system |`[name]` is from the `name` argument in the `jobdw` directive. Any `'-'` characters in the `name`will be converted to `'_'` in the environment variable. There will be one of these environment variables per `jobdw` directive in the job. |
183
-
|`DW_PERSISTENT_[name]`| Mount path of a `persistentdw` file system |`[name]` is from the `name` argument in the `persistentdw` directive. Any `'-'` characters in the `name`will be converted to `'_'` in the environment variable. There will be one of these environment variables per `persistentdw` directive in the job. |
190
+
|`DW_JOB_[name]`| Mount path of a `jobdw` file system |`[name]` is from the `name` argument in the `jobdw` directive. Any `'-'` characters in the `name`are converted to `'_'` in the environment variable. There is one of these environment variables per `jobdw` directive in the job. |
191
+
|`DW_PERSISTENT_[name]`| Mount path of a `persistentdw` file system |`[name]` is from the `name` argument in the `persistentdw` directive. Any `'-'` characters in the `name`are converted to `'_'` in the environment variable. There is one of these environment variables per `persistentdw` directive in the job. |
184
192
|`NNF_CONTAINER_PORTS`| Comma separated list of ports | These ports are used together with the IP address of the local Rabbit to communicate with a user container specified by a `container` directive. More information can be found in the [User Containers](../user-containers/readme.md) guide. |
185
193
|`DW_WORKFLOW_NAME`| Name of the Workflow ||
186
194
|`DW_WORKFLOW_NAMESPACE`| Namespace of the Workflow ||
0 commit comments