You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: dev/guides/redundant-allocations/readme/index.html
+2-2Lines changed: 2 additions & 2 deletions
Original file line number
Diff line number
Diff line change
@@ -1245,9 +1245,9 @@ <h3 id="lvm">LVM</h3>
1245
1245
<p>For XFS and Raw allocations using LVM, the RAID device can only be rebuilt when the Rabbit node has the LV activated. For <code>jobdw</code> allocations, this means that the RAID cannot be rebuilt while the compute nodes have the LV activated between <code>PreRun</code> and <code>PostRun</code>. For this reason, the most common way to use RAID configurations in this situation will be without rebuilding enabled.</p>
1246
1246
<p>If an XFS or Raw allocation is made with <code>create_persistent</code>, then the rebuild commands should be specified to allow the RAID to be rebuilt when no compute nodes have the LV activated.</p>
1247
1247
<h3id="zpool">Zpool</h3>
1248
-
<p>For Lustre allocations using zpool, there are no restrictions on when rebuild commands can be used. The RAID can be rebuilt for job and persistent instances regardless of whether the compute nodes have the file system mounted.</p>
1248
+
<p>For Lustre allocations using zpool, there are no restrictions on when rebuild commands can be used. The RAID can be rebuilt for job and persistent instances regardless of whether the compute nodes have the file system mounted. This is possible because the Lustre targets are only mounted on the Rabbits.</p>
1249
1249
<h3id="replacing-a-drive">Replacing a Drive</h3>
1250
-
<p>If a drive has failed and needs to be replaced, the Rabbit-p and Rabbit-s should be powered off to replace the drive. After powering the Rabbit back on, the <code>nnf-node-manager</code> pod will restart on the Rabbit. On initialization, Rabbit software will find the new drive and add an NVMe namespace for each allocation. If the rebuild commands have been specified, the Rabbit software will run them to add the new NVMe namespace into the RAID device.</p>
1250
+
<p>If a drive fails and must be replaced, the Rabbit-p and Rabbit-s should be powered off to replace the drive. After replacing the drive and powering the Rabbit back on, the <code>nnf-node-manager</code> pod restarts on the Rabbit. On initialization, Rabbit software locates the new drive and adds an NVMe namespace for each allocation. If rebuild commands have been specified, the Rabbit software will run them to add the new NVMe namespace into the RAID device and restore the correct data.</p>
1251
1251
<h2id="allocation-status">Allocation Status</h2>
1252
1252
<p>If the allocation is a <code>PersistentStorageInstance</code>, the status of the RAID device is available in the <code>Status.State</code> field. If all the RAIDs in the persistent storage are healthy, <code>Status.State=Active</code>. If any of the RAIDs are degraded, <code>Status.State=Degraded</code>.</p>
<p>The <code>count</code> field may be useful when creating a persistent file system since the job with the <code>create_persistent</code> directive may only have a single compute node.</p>
1680
1680
<p>In general, <code>scale</code> gives a simple way for users to get a filesystem that has performance consistent with their job size. <code>count</code> is useful for times when a user wants full control of the file system layout.</p>
<p>Allocations can be set up to use a RAID device to provide redundancy in the event of a drive failure. Optionally, commands can be specified to rebuild the RAID device after a replacement drive has been added. The storage profile parameters differ depending on whether the allocation is using LVM or zpool.</p>
1682
+
<p>Allocations can be set up to use a RAID device to provide continued access in the event of a drive failure. Optionally, commands can be specified to rebuild the RAID device after a replacement drive has been added. The storage profile parameters differ depending on whether the allocation is using LVM or zpool.</p>
1683
1683
<h4id="zpool">Zpool</h4>
1684
-
<p>To create a Lustre confiuration with a redundant zpool, the <code>raidz</code> option should be added to the <code>zpoolCreate</code> command. To allow the zpool to be rebuilt with a new drive, the <code>zpoolReplace</code> command should be included.</p>
1684
+
<p>To create a Lustre confiuration with a redundant zpool, the <code>raidz</code> option is required in <code>zpoolCreate</code> command. To allow the zpool to be rebuilt with a new drive, the <code>zpoolReplace</code> command is required.</p>
1685
1685
<p>The example below shows a RAID configuration for the OST, however, the same options can be specified for any of the Lustre targets.</p>
<p>A RAID logical volume can be used with XFS and Raw allocations. gfs2 allocations can not use RAID logical volumes because the LV is shared.</p>
1705
+
<p>A RAID logical volume can be used with XFS and Raw allocations.
1706
+
NOTE: gfs2 allocations cannot use RAID logical volumes because the LV is shared.</p>
1706
1707
<p>To create a redundant LV, <code>--type raid[x]</code> and <code>--nosync</code> should be specified in the <code>lvcreate</code> command. Also, the <code>--stripes</code> parameter should be adjusted accordingly to specify the number of data stripes. For <code>raid5</code>, <code>$DEVICE_NUM-1</code> is used.</p>
1707
-
<p>To allow the LV to be rebuilt after a replacement drive is added, <code>vgExtend</code>, <code>lvRepair</code>, and <code>vgReduce</code> should be specified in the <code>lvmRebuild</code> section.</p>
1708
+
<p>To allow the LV to rebuild after a drive is replaced, <code>vgExtend</code>, <code>lvRepair</code>, and <code>vgReduce</code> should be specified in the <code>lvmRebuild</code> section.</p>
0 commit comments