Skip to content

feat: add scheduling fields to EtcdCluster podTemplate.spec#398

Open
xrl wants to merge 1 commit into
etcd-io:mainfrom
xrl:pr/podspec-scheduling
Open

feat: add scheduling fields to EtcdCluster podTemplate.spec#398
xrl wants to merge 1 commit into
etcd-io:mainfrom
xrl:pr/podspec-scheduling

Conversation

@xrl

@xrl xrl commented Jul 7, 2026

Copy link
Copy Markdown

spec.podTemplate.spec stops at affinity/nodeSelector/tolerations, so an EtcdCluster cannot spread members across zones/hosts, give the etcd container resource requests/limits (member pods are BestEffort today and first in line for node-pressure eviction), assign a priority class, or use a non-default scheduler. This adds topologySpreadConstraints, resources (applied to the etcd member container), priorityClassName and schedulerName — the same scheduling surface battle-tested database operators expose (CloudNativePG, Percona, Elastic ECK) — and propagates them into the StatefulSet pod template next to the existing scheduling fields. For topologySpreadConstraints the labelSelector should match the member pod labels (e.g. app: <cluster-name>). Considered and rejected to keep this scheduling-scoped: runtimeClassName (runtime selection, not scheduling — its scheduling effect arrives via RuntimeClass pod-overhead admission), preemptionPolicy (already governed by the referenced PriorityClass), overhead (populated by the RuntimeClass admission controller, not users). Verified with make test and make verify; new tests assert every podTemplate scheduling field lands on the rendered StatefulSet, and deepcopy/CRD/api-docs are regenerated in the same commit.


PR series — operability fixes & TLS

Small single-purpose PRs from live kind-cluster testing of the operator. Each stands alone unless an After is listed. → = this PR.

PR Lands After
Reviewable now — small, any order
🟢 #374 Requeue instead of swallowing the client-cert provisioning error
🟢 #391 Grant events.k8s.io RBAC so operator Events are actually recorded
🟢 #392 Correlate members[]/leaderID from one health snapshot (consistent leader)
🟢 #393 Propagate user-supplied altNames.ipAddresses into certificates
🟢 #394 Accept day-suffix validityDuration (365d, 100d12h) as documented
🟢 #395 Surface early reconcile errors as a Degraded condition (was empty status)
🟢 #379 Configurable reconcile worker pool (--max-concurrent-reconciles)
🟢 #369 kind-based stress/scale e2e harness (1/3/7 members, churn, quorum watcher)
🟢→ #398 podTemplate.spec scheduling fields: topologySpread, resources, priorityClass, schedulerName
🟢 #397 First-class Helm chart covering the full config/ surface
🟢 #399 Quorum-aware PodDisruptionBudget per EtcdCluster
🟢 #400 Scale-in removes the right member and transfers leadership first
🟢 #401 Backend quota + auto-compaction spec fields, NOSPACE alarm surfacing
🟢 #402 Reconcile-loop gates replace the blocking StatefulSet-ready wait
🟢 #403 Quorum-gated one-pod-at-a-time version upgrades via OnDelete
TLS stack — in order
🟢 #376 Independent spec.tls.{peer,client} surfaces (breaking alpha API)
#377 TLSReady condition + TLS lifecycle Events #376
#378 Multi-member TLS quorum e2e + PeerCANotShared #377
EtcdMirror — in order
🟢 #406 EtcdMirror CRD: one-way cross-cluster replication API (types + CEL)
🟢 #407 pkg/mirroragent replication engine (fenced checkpoint-in-target) #406
🟢 #408 Periodic reconciliation pass wired into the engine's steady-state loop #407
🟢 #412 mirror-agent binary: config/TLS-reload/statusz/metrics + kind e2e #408
🟢 #413 EtcdMirror controller: Deployment rendering, statusz-driven conditions, guards, fenced finalizer #412
🟢 #414 CRD/sample/editor+viewer-role kustomize wiring #413
🟢 #415 Controller-side phase/condition gauges, shipped PrometheusRule + dashboard #414
🟢 #416 Full-lifecycle kind e2e: fence overlap, compaction+prune, restart resume, cert rotation, cutover/reversal #415
Parked as drafts pending #363
#382 Per-cluster domain metrics on the operator /metrics endpoint
#384 EtcdCluster admission webhooks (consolidating with #328) #363
#386 EtcdBackup CR → object storage (S3/GCS) #363
#387 Automatic quorum-loss disaster recovery (bootstrap-latch guarded) #363

🟢 ready · ⚪ draft

podTemplate.spec stops at affinity/nodeSelector/tolerations, so member
pods cannot be spread across zones, given resource requests/limits, a
priority class, or a non-default scheduler; with no resources set the
etcd container makes every member pod BestEffort and first in line for
node-pressure eviction.

Add topologySpreadConstraints, resources (applied to the etcd
container), priorityClassName and schedulerName to podTemplate.spec and
propagate them into the StatefulSet pod template next to the existing
scheduling fields. Regenerate deepcopy/CRD/api-docs. New tests assert
every podTemplate scheduling field lands on the rendered StatefulSet.

Signed-off-by: Xavier Lange <xrlange@gmail.com>

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Signed-off-by: Xavier Lange <xrlange@gmail.com>
@kubernetes-prow

Copy link
Copy Markdown

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: xrl
Once this PR has been reviewed and has the lgtm label, please assign jmhbnz for approval. For more information see the Code Review Process.

The full list of commands accepted by this bot can be found here.

Details Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@kubernetes-prow

Copy link
Copy Markdown

Hi @xrl. Thanks for your PR.

I'm waiting for a etcd-io member to verify that this patch is reasonable to test. If it is, they should reply with /ok-to-test on its own line. Until that is done, I will not automatically test new commits in this PR, but the usual testing commands by org members will still work.

Regular contributors should join the org to skip this step.

Once the patch is verified, the new status will be reflected by the ok-to-test label.

I understand the commands that are listed here.

Details

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

This was referenced Jul 7, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant