Skip to content

Commit 00b65a1

Browse files
rborbo
committed
Update node-health check
1 parent c7522f9 commit 00b65a1

1 file changed

Lines changed: 100 additions & 0 deletions

File tree

‎content/kubevirt/node-health-check.md‎

Lines changed: 100 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -13,6 +13,7 @@ tags: ["kubevirt","ocp-v","cnv"]
1313
## Installation & configuration
1414

1515
* Install Operator "Node Health Check Operator"
16+
* Install Operator "Self Node Remediation Operator"
1617

1718
### Start operator for worker nodes
1819

@@ -86,3 +87,102 @@ spec:
8687
or OCP/OKD version 4.13+.
8788
Automatic will choose the most appropriate strategy during runtime.
8889
```
90+
91+
## Example
92+
93+
* Start a RHEL VM with network access
94+
* Provide `~/bin/l`
95+
96+
```shell
97+
#!/usr/bin/env bash
98+
99+
(echo "# $@"; exec "$@") | ts '[%Y-%m-%d %H:%M:%S]' | tee -a /tmp/app.log
100+
````
101+
102+
* Run: `l ping $VM_IP`
103+
* Run: `oc get pods -o wide --watch | ts '[%Y-%m-%d %H:%M:%S]' | tee -a /tmp/app.log`
104+
* Watch the log `tail -f /tmp/app.log`
105+
* Stop the VM where the node is running: `l virtctl stop --force --grace-period=0 ocp1-worker-0`
106+
107+
### app.log
108+
109+
```log
110+
[2025-06-16 19:00:01] # oc get vm,vmi
111+
[2025-06-16 19:00:01] NAME AGE STATUS READY
112+
[2025-06-16 19:00:01] virtualmachine.kubevirt.io/rhel 14m Running True
113+
[2025-06-16 19:00:01]
114+
[2025-06-16 19:00:01] NAME AGE PHASE IP NODENAME READY
115+
[2025-06-16 19:00:01] virtualmachineinstance.kubevirt.io/rhel 6m49s Running 2620:52:0:2060:63:97ff:fe00:b ocp1-worker-0 True
116+
[2025-06-16 19:00:13] # oc get vm,vmi
117+
[2025-06-16 19:00:14] NAME AGE STATUS READY
118+
[2025-06-16 19:00:14] virtualmachine.kubevirt.io/ocp1-cp-0 3d19h Running True
119+
[2025-06-16 19:00:14] virtualmachine.kubevirt.io/ocp1-cp-1 3d19h Running True
120+
[2025-06-16 19:00:14] virtualmachine.kubevirt.io/ocp1-cp-2 3d19h Running True
121+
[2025-06-16 19:00:14] virtualmachine.kubevirt.io/ocp1-worker-0 3d19h Running True
122+
[2025-06-16 19:00:14] virtualmachine.kubevirt.io/ocp1-worker-1 3d19h Running True
123+
[2025-06-16 19:00:14] virtualmachine.kubevirt.io/ocp1-worker-2 3d19h Running True
124+
[2025-06-16 19:00:14]
125+
[2025-06-16 19:00:14] NAME AGE PHASE IP NODENAME READY
126+
[2025-06-16 19:00:14] virtualmachineinstance.kubevirt.io/ocp1-cp-0 3d19h Running 10.32.105.66 storm2 True
127+
[2025-06-16 19:00:14] virtualmachineinstance.kubevirt.io/ocp1-cp-1 3d9h Running 10.32.105.67 ucs57 True
128+
[2025-06-16 19:00:14] virtualmachineinstance.kubevirt.io/ocp1-cp-2 3d19h Running 10.32.105.68 storm6 True
129+
[2025-06-16 19:00:14] virtualmachineinstance.kubevirt.io/ocp1-worker-0 3d12h Running 10.32.105.69 ucs55 True
130+
[2025-06-16 19:00:14] virtualmachineinstance.kubevirt.io/ocp1-worker-1 3d12h Running 10.32.105.70 storm3 True
131+
[2025-06-16 19:00:14] virtualmachineinstance.kubevirt.io/ocp1-worker-2 3d12h Running 10.32.105.71 ucs56 True
132+
[2025-06-16 19:01:34] # ping 10.32.111.147
133+
[2025-06-16 19:01:34] PING 10.32.111.147 (10.32.111.147): 56 data bytes
134+
[2025-06-16 19:01:34] 64 bytes from 10.32.111.147: icmp_seq=0 ttl=57 time=52.220 ms
135+
[..snipped..]
136+
[2025-06-16 19:01:39] # virtctl stop --force ocp1-worker-0
137+
[2025-06-16 19:01:40] 64 bytes from 10.32.111.147: icmp_seq=6 ttl=57 time=52.835 ms
138+
[..snipped..]
139+
[2025-06-16 19:02:02] 64 bytes from 10.32.111.147: icmp_seq=28 ttl=57 time=51.931 ms
140+
[2025-06-16 19:02:02] # virtctl stop --force --grace-period=0 ocp1-worker-0
141+
[2025-06-16 19:02:03] VM ocp1-worker-0 was scheduled to stop
142+
[2025-06-16 19:02:04] Request timeout for icmp_seq 29
143+
[..snipped..]
144+
[2025-06-16 19:02:57] Request timeout for icmp_seq 82
145+
[2025-06-16 19:02:58] virt-launcher-rhel-hc2ds 1/1 Running 0 9m46s 10.131.0.36 ocp1-worker-0 <none> 1/1
146+
[2025-06-16 19:02:58] Request timeout for icmp_seq 83
147+
[2025-06-16 19:02:59] Request timeout for icmp_seq 84
148+
[2025-06-16 19:02:59] virt-launcher-rhel-hc2ds 1/1 Terminating 0 9m47s 10.131.0.36 ocp1-worker-0 <none> 1/1
149+
[2025-06-16 19:03:00] Request timeout for icmp_seq 85
150+
[..snipped..]
151+
[2025-06-16 19:04:38] Request timeout for icmp_seq 183
152+
[2025-06-16 19:04:39] virt-launcher-rhel-hc2ds 1/1 Terminating 0 11m 10.131.0.36 ocp1-worker-0 <none> 1/1
153+
[2025-06-16 19:04:39] Request timeout for icmp_seq 184
154+
[..snipped..]
155+
[2025-06-16 19:06:42] Request timeout for icmp_seq 306
156+
[2025-06-16 19:06:42] virt-launcher-rhel-hc2ds 1/1 Failed 0 13m 10.131.0.36 ocp1-worker-0 <none> 1/1
157+
[2025-06-16 19:06:43] Request timeout for icmp_seq 307
158+
[2025-06-16 19:06:43] virt-launcher-rhel-hc2ds 1/1 Failed 0 13m 10.131.0.36 ocp1-worker-0 <none> 1/1
159+
[2025-06-16 19:06:43] virt-launcher-rhel-hc2ds 1/1 Failed 0 13m 10.131.0.36 ocp1-worker-0 <none> 1/1
160+
[2025-06-16 19:06:44] Request timeout for icmp_seq 308
161+
[..snipped..]
162+
[2025-06-16 19:07:30] Request timeout for icmp_seq 354
163+
[2025-06-16 19:07:31] virt-launcher-rhel-rhf6h 0/1 Pending 0 2s <none> <none> <none> 0/1
164+
[2025-06-16 19:07:31] virt-launcher-rhel-rhf6h 0/1 Pending 0 2s <none> ocp1-worker-1 <none> 0/1
165+
[2025-06-16 19:07:31] virt-launcher-rhel-rhf6h 0/1 Pending 0 2s <none> ocp1-worker-1 <none> 0/1
166+
[2025-06-16 19:07:31] Request timeout for icmp_seq 355
167+
[2025-06-16 19:07:32] Request timeout for icmp_seq 356
168+
[2025-06-16 19:07:33] virt-launcher-rhel-rhf6h 0/1 Pending 0 4s <none> ocp1-worker-1 <none> 0/1
169+
[2025-06-16 19:07:33] Request timeout for icmp_seq 357
170+
[2025-06-16 19:07:34] virt-launcher-rhel-rhf6h 0/1 ContainerCreating 0 5s <none> ocp1-worker-1 <none> 0/1
171+
[2025-06-16 19:07:34] Request timeout for icmp_seq 358
172+
[2025-06-16 19:07:35] Request timeout for icmp_seq 359
173+
[2025-06-16 19:07:35] virt-launcher-rhel-rhf6h 0/1 ContainerCreating 0 6s <none> ocp1-worker-1 <none> 1/1
174+
[2025-06-16 19:07:36] Request timeout for icmp_seq 360
175+
[..snipped..]
176+
[2025-06-16 19:07:54] Request timeout for icmp_seq 378
177+
[2025-06-16 19:07:54] virt-launcher-rhel-rhf6h 0/1 ContainerCreating 0 25s <none> ocp1-worker-1 <none> 1/1
178+
[2025-06-16 19:07:55] virt-launcher-rhel-rhf6h 1/1 Running 0 26s 10.128.2.71 ocp1-worker-1 <none> 1/1
179+
[2025-06-16 19:07:55] virt-launcher-rhel-rhf6h 1/1 Running 0 26s 10.128.2.71 ocp1-worker-1 <none> 1/1
180+
[2025-06-16 19:07:55] Request timeout for icmp_seq 379
181+
[..snipped..]
182+
[2025-06-16 19:09:41] Request timeout for icmp_seq 484
183+
[2025-06-16 19:09:41] 64 bytes from 10.32.111.147: icmp_seq=485 ttl=57 time=51.578 ms
184+
[2025-06-16 19:09:42] 64 bytes from 10.32.111.147: icmp_seq=486 ttl=57 time=51.141 ms
185+
[2025-06-16 19:09:43] 64 bytes from 10.32.111.147: icmp_seq=487 ttl=57 time=51.136 ms
186+
[2025-06-16 19:09:44] 64 bytes from 10.32.111.147: icmp_seq=488 ttl=57 time=51.472 ms
187+
..
188+
```

0 commit comments

Comments
 (0)