Skip to content

Commit 77ee7ae

Browse files
monrog2takishidapsureshbHarinadh-Saladisanjanch
authored
Release V4.1.0 (datacenter#387)
* Add arg to define thread limit - to throttle concurrent API calls when required (datacenter#355) * add `--max-threads` arg * fix bad descriptor errs/race conditions * update pytests * 353 the script incorrectly detects vpc and port channel interfaces as cscwh68103 invalid fabricpathep targets (datacenter#357) * specific testing for known failure conditions of cscwh68103 as to not catch valid scenarios * Update aci-preupgrade-validation-script.py mark version * print cleanup * fix: Add cversion check for post_upgrade_cb_check (datacenter#377) * added validation for CFD CSCwp64296 (datacenter#307) Added rogue ep/coop exception mac check for the CFD CSCwp64296 * Added pre-upgrade validation for N9K-C9408 with more than 6 N9K-X9400-16W LEM's for the bug CSCws82819 (datacenter#354) * Added a new check for the bug 'CSCws82819N9K-C9408 boot loop on 16.1.2f and later with 6 or more LEMs' * New Validation for APIC Storage Inode Usage (F4388, F4389, F4390 equipment-full) (datacenter#361) * New Validation for APIC Storage Inode Usage (F4388, F4389, F4390 equipment-full) * Add new exception handling of invalid query filter in `icurl` due to, for example, a non-supported fault code on older versions * Add validation for multipod_modular_spine_bootscript_check - CSCwr66848 (datacenter#365) * Add check for CFD - CSCwr66848 * Update pytest.yml to run on vX.Y.Z branches * adding of cli parameters for user and password (datacenter#335) * added cli parameter for user (-u) and password (-p) to be used in an eased way for fully automated execution of 'aci-preupgrade-validation-script.py' * test: Add pytest --------- Co-authored-by: Detlef Sass <detlef.sass@de.bosch.com> * Added validation for CSCwd40071 (datacenter#332) * Added validation for CSCwd40071 * Addressed the comments * Added cversion for the check * Removed empty spaces * logic change. removed 0.0.0.0/0 and made pytest changes * logic modified and validation.md file updated * Added validation for CSCws84232 (datacenter#334) * Feat:added svccoreCtrlr excessive entries check * updated the formated json in svccore_negative.json * Removed other PR checks * Fix: svccoreNode mo check is updated * Fix:update the threshold to 240 * refactor:moved to general check * refactor:updated recommended action * refactor:optimise the check for get the count alone * refactor:added try catch exception for error handling * update the threshold value for 240 * refactor:query-target was added * refactor: removed unwanted spaces * refactor:removed unwanted spaces in validation.md * resolve conflict while rebasing * resolve conflict while rebasing * updated pytest script file * updated validation.md * addressed review comments * updated validation.md --------- Co-authored-by: takishida <38262981+takishida@users.noreply.github.com> * set to v4.1.0 --------- Co-authored-by: tkishida <tkishida@cisco.com> Co-authored-by: takishida <38262981+takishida@users.noreply.github.com> Co-authored-by: psureshb <psureshb@cisco.com> Co-authored-by: Harinadh-Saladi <hsaladi@cisco.com> Co-authored-by: sanjanch <sanjanch@cisco.com> Co-authored-by: asraf-khan <anazar@cisco.com> Co-authored-by: Thatleft <detlef.sass@web.de> Co-authored-by: Detlef Sass <detlef.sass@de.bosch.com> Co-authored-by: veesenth_cisco <veesenth@cisco.com>
1 parent 68f3673 commit 77ee7ae

48 files changed

Lines changed: 2161 additions & 36 deletions

File tree

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

‎.github/workflows/pytest.yml‎

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -2,9 +2,9 @@ name: Pytest
22

33
on:
44
push:
5-
branches: [master]
5+
branches: [master, 'v[0-9].[0-9]+.[0-9]+*']
66
pull_request:
7-
branches: [master]
7+
branches: [master, 'v[0-9].[0-9]+.[0-9]+*']
88

99
permissions:
1010
contents: read

‎.gitignore‎

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -50,6 +50,7 @@ coverage.xml
5050
.hypothesis/
5151
.pytest_cache/
5252
cover/
53+
preupgrade_validator*.tgz
5354

5455
# Translations
5556
*.mo

‎aci-preupgrade-validation-script.py‎

Lines changed: 310 additions & 13 deletions
Large diffs are not rendered by default.

‎docs/docs/validations.md‎

Lines changed: 125 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -37,6 +37,7 @@ Items | This Script
3737
[Fabric Link Redundancy][g17] | :white_check_mark: | :no_entry_sign:
3838
[APIC Database Size][g18] | :white_check_mark: | :no_entry_sign:
3939
[APIC downgrade compatibility when crossing 6.2 release][g19]| :white_check_mark: | :no_entry_sign:
40+
[Svccore Excessive Data Check][g20] | :white_check_mark: | :no_entry_sign:
4041

4142
[g1]: #compatibility-target-aci-version
4243
[g2]: #compatibility-cimc-version
@@ -57,6 +58,7 @@ Items | This Script
5758
[g17]: #fabric-link-redundancy
5859
[g18]: #apic-database-size
5960
[g19]: #apic-downgrade-compatibility-when-crossing-62-release
61+
[g20]: #svccore-excessive-data-check
6062

6163
### Fault Checks
6264
Items | Faults | This Script | APIC built-in
@@ -82,7 +84,7 @@ Items | Faults | This Script
8284
[Fabric Port Status][f19] | F1394: ethpm-if-port-down-fabric | :white_check_mark: | :no_entry_sign:
8385
[Equipment Disk Limits][f20] | F1820: 80% -minor<br>F1821: -major<br>F1822: -critical | :white_check_mark: | :no_entry_sign:
8486
[VMM Inventory Partially Synced][f21] | F0132: comp-ctrlr-operational-issues | :white_check_mark: | :no_entry_sign:
85-
87+
[APIC Storage Inode Usage][f22] | F4388: 75% - 85% -warning<br>F4389: 85% - 90% -major<br>F4390: 90% or more -critical | :white_check_mark: | :no_entry_sign:
8688

8789
[f1]: #apic-disk-space-usage
8890
[f2]: #standby-apic-disk-space-usage
@@ -105,6 +107,7 @@ Items | Faults | This Script
105107
[f19]: #fabric-port-status
106108
[f20]: #equipment-disk-limits
107109
[f21]: #vmm-inventory-partially-synced
110+
[f22]: #apic-storage-inode-usage
108111

109112
### Configuration Checks
110113

@@ -194,6 +197,10 @@ Items | Defect | This Script
194197
[ISIS DTEPs Byte Size][d27] | CSCwp15375 | :white_check_mark: | :no_entry_sign:
195198
[Policydist configpushShardCont Crash][d28] | CSCwp95515 | :white_check_mark: | :no_entry_sign:
196199
[Auto Firmware Update on Switch Discovery][d29] | CSCwe83941 | :white_check_mark: | :no_entry_sign:
200+
[Rogue EP Exception List missing on switches][d30] | CSCwp64296 | :white_check_mark: | :no_entry_sign:
201+
[N9K-C9408 with more than 5 N9K-X9400-16W LEMs][d31] | CSCws82819 | :white_check_mark: | :no_entry_sign:
202+
[Multi-Pod Modular Spine Bootscript File][d32] | CSCwr66848 | :white_check_mark: | :no_entry_sign:
203+
[Inband Management Policy Misconfiguration][d33]| CSCwd40071 | :white_check_mark: | :no_entry_sign:
197204

198205
[d1]: #ep-announce-compatibility
199206
[d2]: #eventmgr-db-size-defect-susceptibility
@@ -224,6 +231,10 @@ Items | Defect | This Script
224231
[d27]: #isis-dteps-byte-size
225232
[d28]: #policydist-configpushshardcont-crash
226233
[d29]: #auto-firmware-update-on-switch-discovery
234+
[d30]: #rogue-ep-exception-list-missing-on-switches
235+
[d31]: #n9k-c9408-with-more-than-5-n9k-x9400-16w-lems
236+
[d32]: #multi-pod-modular-spine-bootscript-file
237+
[d33]: #inband-management-policy-misconfiguration
227238

228239
## General Check Details
229240

@@ -1551,6 +1562,56 @@ EPGs using the `pre-provision` resolution immediacy do not rely on the VMM inven
15511562

15521563
This check returns a `MANUAL` result as there are many reasons for a partial inventory sync to be reported. The goal is to ensure that the VMM inventory sync has fully completed before triggering the APIC upgrade to reduce any chance for unexpected inventory changes to occur.
15531564

1565+
1566+
### APIC Storage Inode Usage
1567+
1568+
If a Cisco APIC is running low on inode capacity for any reason, the Cisco APIC upgrade can fail. The Cisco APIC will raise three different faults depending on inode utilization. If any of these faults are raised on the system, the issue should be resolved prior to performing the upgrade.
1569+
1570+
* **F4388**: A warning level fault for Cisco APIC storage inode utilization. This is raised when utilization is greater than 75%.
1571+
1572+
* **F4389**: A major level fault for Cisco APIC storage inode utilization. This is raised when utilization is between 85% and 90%.
1573+
1574+
* **F4390**: A critical level fault for Cisco APIC storage inode utilization. This is raised when utilization is greater than 90%.
1575+
1576+
Although the storage space for the filesystem might be adequate we might still see issues with inode usage, this happens when we have more number of files or directories created with lower file sizes.
1577+
1578+
Recommended Action:
1579+
1580+
To recover from this fault, try the following action
1581+
1582+
1. Free up space from affected disk partition .
1583+
2. TAC may be required to analyze and cleanup certain directories due to filesystem permissions. Cleanup of `/` is one such example.
1584+
1585+
!!! example "Fault Example (F4390: Critical fault for APIC Inode Utilisation)"
1586+
```
1587+
moquery -c faultInst -f 'fault.Inst.code=="F4390"'
1588+
Total Objects shown: 1
1589+
1590+
# faultInst
1591+
ack : yes
1592+
alert : no
1593+
cause : equipment-full
1594+
changeSet : available (Old: 19408344, New: 19407972), inodesFree (Old: 263915, New: 263842), inodesUsed (Old: 2357525, New: 2357598),
1595+
used (Old: 19436092, New: 19436464)
1596+
code : F4390
1597+
created : 2024-08-05T05:42:31.975+02:00
1598+
delegated : no
1599+
descr : Storage unit /scratch-writes on node 3 with hostname apic3 mounted at /scratch-writes is 90% full for Inodes
1600+
dn : topology/pod-2/node-3/sys/ch/p-[/scratch-writes]-f-[/dev/mapper/atx-scratch]/fault-F4390
1601+
domain : infra
1602+
highestSeverity : critical
1603+
lastTransition : 2024-08-05T09:41:18.152+02:00
1604+
lc : raised
1605+
occur : 2
1606+
origSeverity : critical
1607+
prevSeverity : cleared
1608+
rule : eqpt-storage-inode-critical
1609+
severity : critical
1610+
subject : equipment-full
1611+
type : operational
1612+
```
1613+
1614+
15541615
## Configuration Check Details
15551616

15561617
### VPC-paired Leaf switches
@@ -2648,6 +2709,7 @@ Due to [CSCwp95515][59], upgrading to an affected version while having any `conf
26482709

26492710
If any instances of `configpushShardCont` are flagged by this script, Cisco TAC must be contacted to identify and resolve the underlying issue before performing the upgrade.
26502711

2712+
26512713
### Auto Firmware Update on Switch Discovery
26522714

26532715
[Auto Firmware Update on Switch Discovery][63] automatically upgrades a new switch to the target firmware version before registering it to the ACI fabric. This feature activates in three scenarios:
@@ -2668,6 +2730,61 @@ To avoid this risk, consider disabling Auto Firmware Update before upgrading to
26682730
This issue occurs because older switch firmware versions are not compatible with switch images 6.0(3) or newer. The APIC version is not a factor.
26692731

26702732

2733+
### Rogue EP Exception List missing on switches
2734+
2735+
The Rogue/COOP Exception List feature, introduced in 5.2(3), allows exclusion of specific MAC addresses from Rogue Endpoint Control and COOP Dampening. Initially, each MAC address had to be configured individually in each bridge domain. In 6.0(3), this feature was enhanced to support fabric-wide exception lists with wildcard options per bridge domain and the ability to exclude MAC addresses in L3Outs.
2736+
2737+
However, due to [CSCwp64296][64], when upgrading spine switches to version 6.0(3)+ from an older version with Rogue/COOP Exception Lists configured, some exception lists may not be pushed to the spine switches. As a result, the feature may stop functioning after the upgrade.
2738+
2739+
The root cause is that internal objects called `presListener` for Rogue/COOP Exception List, which publish the configuration from APICs to switches, may be missing on the APICs after an upgrade.
2740+
2741+
Recommended action: Delete the affected exception list and create it again. If needed, contact Cisco TAC to help recover missing `presListener` objects on APICs.
2742+
2743+
2744+
### N9K-C9408 with more than 5 N9K-X9400-16W LEMs
2745+
2746+
Due to defect [CSCws82819][65], N9K-C9408 switch will experience a boot loop with dt_helper process crash if upgraded to versions 16.1(2f) to 16.1(5) or 16.2(1g) with more than 5 N9K-X9400-16W LEMs installed.
2747+
2748+
To avoid this issue, please upgrade to fix version or use less than 6 N9K-X9400-16W in one chassis.
2749+
2750+
2751+
### Multi-Pod Modular Spine Bootscript File
2752+
2753+
Due to [CSCwr66848][66], in Multi-Pod environments, upgrading a modular spine to 6.1(4h) may result in inter-pod traffic to stop working if the `/bootflash/bootscript` file is missing on the spine prior to the upgrade. The traffic interruption occurs because the spine incorrectly indentifies the reason of its reload, leading to an unnecessary attempt to load the missing bootscript file.
2754+
2755+
This issue happens only when the target version is specifically 6.1(4h).
2756+
2757+
To avoid this issue, change the target version to another version. Or verify that the `bootscript` file exists in the bootflash of each modular spine switch prior to upgrading to 6.1(4h). If the file is missing, you have to do clean reboot on the impacted spine to ensure that `/bootflash/bootscript` gets created again. In case you already upgraded your spine and you are experiencing the traffic impact due to this issue, clean reboot of the spine will restore the traffic.
2758+
2759+
2760+
### Inband Management Policy Misconfiguration
2761+
2762+
Due to the defect [CSCwh80837][67], starting from version 6.0(4c), mgmtRsInBStNode policy get modified in leaf/spine during Apic upgrade.
2763+
2764+
Impact:
2765+
2766+
When upgrading Apic from versions prior to 6.0(4c) to versions 6.0(4c) or later, if there is a misconfiguration in the inband management policies (mgmtRsInBStNode) with invalid values, the re-processing triggered by [CSCwh80837][67] will expose the underlying [CSCwd40071][68] defect. This results in continuous policyelem core dumps and switch reboot if Switch are running impacted version of [CSCwd40071][68].
2767+
2768+
The invalid configuration occurs when mgmtRsInBStNode has "0.0.0.0" values ( with or without mask) for either the "addr" or "gw" fields.
2769+
2770+
Suggestion:
2771+
2772+
Contact Cisco TAC to remove any identified misconfigured objects before performing the upgrade to prevent policyelem crashes.
2773+
The [CSCwd40071][68] defect affects versions 5.2(5c) and later with a fix available in 6.0(1g). However, the issue will only be triggered during Apic upgrades crossing 6.0(4c) due to [CSCwh80837][67].
2774+
2775+
2776+
### Svccore Excessive Data Check
2777+
2778+
Due to excessive `svccoreCtrlr` or `svccoreNode` managed objects, Apic gui stuck in loading multiple queries.
2779+
2780+
The svccoreCtrlr and svccoreNode objects represent core files related to Apic and Leaf/Spines process respectively.
2781+
2782+
Due to [CSCws84232][67], the APIC GUI may become unresponsive after login, with dashboards stuck in a continuous “Loading…”state.
2783+
Administrators may be unable to access or operate the APIC GUI, potentially impacting day-to-day management or upgrade.
2784+
2785+
This check will verify the count of the `svccoreCtrlr` Managed Object and raise and alarm with the bug if object count found more than 240. Remove the content or objects of `svccoreCtrlr` or `svccoreNode`. Contact Cisco TAC or upgrade to a release containing the fix for CSCws84232 before proceeding with an upgrade.
2786+
2787+
26712788
[0]: https://github.com/datacenter/ACI-Pre-Upgrade-Validation-Script
26722789
[1]: https://www.cisco.com/c/dam/en/us/td/docs/Website/datacenter/apicmatrix/index.html
26732790
[2]: https://www.cisco.com/c/en/us/support/switches/nexus-9000-series-switches/products-release-notes-list.html
@@ -2731,4 +2848,10 @@ To avoid this risk, consider disabling Auto Firmware Update before upgrading to
27312848
[60]: https://www.cisco.com/c/en/us/solutions/collateral/data-center-virtualization/application-centric-infrastructure/white-paper-c11-743951.html#Inter
27322849
[61]: https://www.cisco.com/c/en/us/solutions/collateral/data-center-virtualization/application-centric-infrastructure/white-paper-c11-743951.html#EnablePolicyCompression
27332850
[62]: https://bst.cloudapps.cisco.com/bugsearch/bug/CSCwe83941
2734-
[63]: https://www.cisco.com/c/en/us/td/docs/dcn/aci/apic/all/apic-installation-aci-upgrade-downgrade/Cisco-APIC-Installation-ACI-Upgrade-Downgrade-Guide/m-auto-firmware-update.html
2851+
[63]: https://www.cisco.com/c/en/us/td/docs/dcn/aci/apic/all/apic-installation-aci-upgrade-downgrade/Cisco-APIC-Installation-ACI-Upgrade-Downgrade-Guide/m-auto-firmware-update.html
2852+
[64]: https://bst.cloudapps.cisco.com/bugsearch/bug/CSCwp64296
2853+
[65]: https://bst.cloudapps.cisco.com/bugsearch/bug/CSCws82819
2854+
[66]: https://bst.cloudapps.cisco.com/bugsearch/bug/CSCwr66848
2855+
[67]: https://bst.cloudapps.cisco.com/bugsearch/bug/CSCwh80837
2856+
[68]: https://bst.cloudapps.cisco.com/bugsearch/bug/CSCwd40071
2857+
[69]: https://bst.cloudapps.cisco.com/bugsearch/bug/CSCws84232

‎tests/checks/apic_storage_inode_full_check/Fault_combination.json‎

Lines changed: 80 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,80 @@
1+
[
2+
{
3+
"faultInst": {
4+
"attributes": {
5+
"ack": "no",
6+
"alert": "no",
7+
"cause": "equipment-full",
8+
"changeSet": "available (Old: 37868344, New: 37859228), inodesFree (Old: 810163, New: 479339), inodesUsed (Old: 1811277, New: 2142101), inodesUtilized (Old: 70, New: 82), used (Old: 976092, New: 985208)",
9+
"code": "F4388",
10+
"created": "2026-03-06T11:58:43.579+00:00",
11+
"delegated": "no",
12+
"descr": "Storage unit /data/admin/bin/avread on Node 1 mounted at /data/admin/bin/avread is 82% full for Inodes",
13+
"dn": "topology/pod-1/node-1/sys/ch/p-[/data/admin/bin/avread]-f-[overlayfs]/fault-F4388",
14+
"domain": "infra",
15+
"highestSeverity": "warning",
16+
"lastTransition": "2026-03-06T11:58:43.579+00:00",
17+
"lc": "raised",
18+
"occur": "1",
19+
"origSeverity": "warning",
20+
"prevSeverity": "warning",
21+
"rule": "eqpt-storage-inode-warning",
22+
"severity": "warning",
23+
"subject": "equipment-full",
24+
"type": "operational"
25+
}
26+
}
27+
},
28+
{
29+
"faultInst": {
30+
"attributes": {
31+
"ack": "no",
32+
"alert": "no",
33+
"cause": "equipment-full",
34+
"changeSet": "available (Old: 37868344, New: 37859228), inodesFree (Old: 810163, New: 479339), inodesUsed (Old: 1811277, New: 2142101), inodesUtilized (Old: 70, New: 82), used (Old: 976092, New: 985208)",
35+
"code": "F4388",
36+
"created": "2026-03-06T11:58:43.587+00:00",
37+
"delegated": "no",
38+
"descr": "Storage unit /etc/hosts on Node 1 mounted at /etc/hosts is 82% full for Inodes",
39+
"dn": "topology/pod-1/node-1/sys/ch/p-[/etc/hosts]-f-[overlayfs]/fault-F4388",
40+
"domain": "infra",
41+
"highestSeverity": "warning",
42+
"lastTransition": "2026-03-06T11:58:43.587+00:00",
43+
"lc": "soaking",
44+
"occur": "1",
45+
"origSeverity": "warning",
46+
"prevSeverity": "warning",
47+
"rule": "eqpt-storage-inode-warning",
48+
"severity": "warning",
49+
"subject": "equipment-full",
50+
"type": "operational"
51+
}
52+
}
53+
},
54+
{
55+
"faultInst": {
56+
"attributes": {
57+
"ack": "no",
58+
"alert": "no",
59+
"cause": "equipment-full",
60+
"changeSet": "available (Old: 37868344, New: 37859228), inodesFree (Old: 810163, New: 479339), inodesUsed (Old: 1811277, New: 2142101), inodesUtilized (Old: 70, New: 82), used (Old: 976092, New: 985208)",
61+
"code": "F4388",
62+
"created": "2026-03-06T11:58:43.595+00:00",
63+
"delegated": "no",
64+
"descr": "Storage unit /scratch-writes on Node 1 mounted at /scratch-writes is 82% full for Inodes",
65+
"dn": "topology/pod-1/node-1/sys/ch/p-[/scratch-writes]-f-[/dev/mapper/atx-scratch]/fault-F4388",
66+
"domain": "infra",
67+
"highestSeverity": "warning",
68+
"lastTransition": "2026-03-06T11:58:43.595+00:00",
69+
"lc": "raised-clearing",
70+
"occur": "1",
71+
"origSeverity": "warning",
72+
"prevSeverity": "warning",
73+
"rule": "eqpt-storage-inode-warning",
74+
"severity": "warning",
75+
"subject": "equipment-full",
76+
"type": "operational"
77+
}
78+
}
79+
}
80+
]

‎tests/checks/apic_storage_inode_full_check/Fault_exists_not_raised.json‎

Lines changed: 54 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,54 @@
1+
[
2+
{
3+
"faultInst": {
4+
"attributes": {
5+
"ack": "no",
6+
"alert": "no",
7+
"cause": "equipment-full",
8+
"changeSet": "available (Old: 37868344, New: 37859228), inodesFree (Old: 810163, New: 479339), inodesUsed (Old: 1811277, New: 2142101), inodesUtilized (Old: 70, New: 82), used (Old: 976092, New: 985208)",
9+
"code": "F4388",
10+
"created": "2026-03-06T11:58:43.579+00:00",
11+
"delegated": "no",
12+
"descr": "Storage unit /data/admin/bin/avread on Node 1 mounted at /data/admin/bin/avread is 82% full for Inodes",
13+
"dn": "topology/pod-1/node-1/sys/ch/p-[/data/admin/bin/avread]-f-[overlayfs]/fault-F4388",
14+
"domain": "infra",
15+
"highestSeverity": "warning",
16+
"lastTransition": "2026-03-06T11:58:43.579+00:00",
17+
"lc": "cleared",
18+
"occur": "1",
19+
"origSeverity": "warning",
20+
"prevSeverity": "warning",
21+
"rule": "eqpt-storage-inode-warning",
22+
"severity": "warning",
23+
"subject": "equipment-full",
24+
"type": "operational"
25+
}
26+
}
27+
},
28+
{
29+
"faultInst": {
30+
"attributes": {
31+
"ack": "no",
32+
"alert": "no",
33+
"cause": "equipment-full",
34+
"changeSet": "available (Old: 37868344, New: 37859228), inodesFree (Old: 810163, New: 479339), inodesUsed (Old: 1811277, New: 2142101), inodesUtilized (Old: 70, New: 82), used (Old: 976092, New: 985208)",
35+
"code": "F4388",
36+
"created": "2026-03-06T11:58:43.587+00:00",
37+
"delegated": "no",
38+
"descr": "Storage unit /etc/hosts on Node 1 mounted at /etc/hosts is 82% full for Inodes",
39+
"dn": "topology/pod-1/node-1/sys/ch/p-[/etc/hosts]-f-[overlayfs]/fault-F4388",
40+
"domain": "infra",
41+
"highestSeverity": "warning",
42+
"lastTransition": "2026-03-06T11:58:43.587+00:00",
43+
"lc": "retaining",
44+
"occur": "1",
45+
"origSeverity": "warning",
46+
"prevSeverity": "warning",
47+
"rule": "eqpt-storage-inode-warning",
48+
"severity": "warning",
49+
"subject": "equipment-full",
50+
"type": "operational"
51+
}
52+
}
53+
}
54+
]

0 commit comments

Comments
 (0)