Skip to content

Pipeline Helm Charts #3237

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
kunal-511 wants to merge 26 commits into
base: master
Choose a base branch
from
Open

Pipeline Helm Charts #3237

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
26 commits
Select commit Hold shift + click to select a range
6da4f89
Pipline Helm Charts
kunal-511 Sep 8, 2025
4cc10b6
Update helm charts
kunal-511 Sep 22, 2025
1056eda
Update helm charts to reduce differences
kunal-511 Sep 24, 2025
2792151
modified labels and env
kunal-511 Sep 25, 2025
b23e250
update labels and env
kunal-511 Sep 25, 2025
123e42c
Update values
kunal-511 Sep 26, 2025
3683cd8
Fix syntax
kunal-511 Sep 28, 2025
9e2580a
fix syntax and naming
kunal-511 Sep 28, 2025
24be78e
naming change
kunal-511 Sep 28, 2025
4c58024
Update image tag and add addition env
kunal-511 Sep 29, 2025
8f70cf1
Add missing resources
kunal-511 Oct 1, 2025
03d5f94
remove extra resources
kunal-511 Oct 3, 2025
a49d43c
update labels and comparision script
kunal-511 Oct 9, 2025
54c1b58
update kserve configmap helm charts
kunal-511 Oct 12, 2025
ef2d109
remove charts dependencies
kunal-511 Oct 12, 2025
f843c77
step to build dependency for pipelines
kunal-511 Oct 12, 2025
1202141
Remove cloud specific templates
kunal-511 Oct 19, 2025
47f3335
remove cloud speific templates from comparision
kunal-511 Oct 19, 2025
8474f0d
Update helm charts according to v2.15.0 and support only 2 flavors
kunal-511 Dec 1, 2025
51a960b
update pod security
kunal-511 Dec 1, 2025
8219131
Update katib helm charts with v0.19.0
kunal-511 Dec 5, 2025
1c5dae4
Update model registry helm charts for v0.3.3
kunal-511 Dec 5, 2025
8e02def
Remove configurable names
kunal-511 Jan 6, 2026
1f843ba
Update katib helm charts
kunal-511 Jan 6, 2026
3a4a7fe
Update model registry helm charts
kunal-511 Jan 6, 2026
af44b95
Update the ingress list
kunal-511 Jan 6, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 4 additions & 0 deletions .github/workflows/helm-kustomize-comparison.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -38,6 +38,10 @@ jobs:
rm get_helm.sh
- name: Install Kustomize
run: ./tests/kustomize_install.sh
- name: Build Helm dependencies for pipelines
run: |
cd experimental/helm/charts/pipelines
helm dependency build
- name: Run all scenarios comparison
env:
VERBOSE: "true"
Expand Down
4 changes: 2 additions & 2 deletions experimental/helm/charts/katib/Chart.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -4,9 +4,9 @@ name: katib

description: A Helm chart for Katib - AutoML on Kubernetes

version: 0.16.0
version: 0.19.0

appVersion: 0.16.0
appVersion: 0.19.0

keywords:
- automl
Expand Down
33 changes: 17 additions & 16 deletions experimental/helm/charts/katib/ci/values-cert-manager.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,7 @@

global:
namespace: kubeflow
imageTag: v0.18.0
imageTag: v0.19.0

# Enable kustomize compatibility mode
kustomizeMode:
Expand Down Expand Up @@ -77,6 +77,7 @@ config:
controller:
webhookPort: 8443
trialResources:
- TrainJob.v1alpha1.trainer.kubeflow.org
- Job.v1.batch
- TFJob.v1.kubeflow.org
- PyTorchJob.v1.kubeflow.org
Expand All @@ -85,40 +86,40 @@ config:
runtime:
metricsCollectors:
- kind: StdOut
image: ghcr.io/kubeflow/katib/file-metrics-collector:v0.18.0
image: ghcr.io/kubeflow/katib/file-metrics-collector:v0.19.0
- kind: File
image: ghcr.io/kubeflow/katib/file-metrics-collector:v0.18.0
image: ghcr.io/kubeflow/katib/file-metrics-collector:v0.19.0
- kind: TensorFlowEvent
image: ghcr.io/kubeflow/katib/tfevent-metrics-collector:v0.18.0
image: ghcr.io/kubeflow/katib/tfevent-metrics-collector:v0.19.0
resources:
limits:
memory: 1Gi
suggestions:
- algorithmName: random
image: ghcr.io/kubeflow/katib/suggestion-hyperopt:v0.18.0
image: ghcr.io/kubeflow/katib/suggestion-hyperopt:v0.19.0
- algorithmName: tpe
image: ghcr.io/kubeflow/katib/suggestion-hyperopt:v0.18.0
image: ghcr.io/kubeflow/katib/suggestion-hyperopt:v0.19.0
- algorithmName: grid
image: ghcr.io/kubeflow/katib/suggestion-optuna:v0.18.0
image: ghcr.io/kubeflow/katib/suggestion-optuna:v0.19.0
- algorithmName: hyperband
image: ghcr.io/kubeflow/katib/suggestion-hyperband:v0.18.0
image: ghcr.io/kubeflow/katib/suggestion-hyperband:v0.19.0
- algorithmName: bayesianoptimization
image: ghcr.io/kubeflow/katib/suggestion-skopt:v0.18.0
image: ghcr.io/kubeflow/katib/suggestion-skopt:v0.19.0
- algorithmName: cmaes
image: ghcr.io/kubeflow/katib/suggestion-goptuna:v0.18.0
image: ghcr.io/kubeflow/katib/suggestion-goptuna:v0.19.0
- algorithmName: sobol
image: ghcr.io/kubeflow/katib/suggestion-goptuna:v0.18.0
image: ghcr.io/kubeflow/katib/suggestion-goptuna:v0.19.0
- algorithmName: multivariate-tpe
image: ghcr.io/kubeflow/katib/suggestion-optuna:v0.18.0
image: ghcr.io/kubeflow/katib/suggestion-optuna:v0.19.0
- algorithmName: enas
image: ghcr.io/kubeflow/katib/suggestion-enas:v0.18.0
image: ghcr.io/kubeflow/katib/suggestion-enas:v0.19.0
resources:
limits:
memory: 400Mi
- algorithmName: darts
image: ghcr.io/kubeflow/katib/suggestion-darts:v0.18.0
image: ghcr.io/kubeflow/katib/suggestion-darts:v0.19.0
- algorithmName: pbt
image: ghcr.io/kubeflow/katib/suggestion-pbt:v0.18.0
image: ghcr.io/kubeflow/katib/suggestion-pbt:v0.19.0
persistentVolumeClaimSpec:
accessModes:
- ReadWriteMany
Expand All @@ -127,7 +128,7 @@ config:
storage: 5Gi
earlyStoppings:
- algorithmName: medianstop
image: ghcr.io/kubeflow/katib/earlystopping-medianstop:v0.18.0
image: ghcr.io/kubeflow/katib/earlystopping-medianstop:v0.19.0

# RBAC
rbac:
Expand Down
67 changes: 65 additions & 2 deletions experimental/helm/charts/katib/ci/values-external-db.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,7 @@

global:
namespace: kubeflow
imageTag: v0.18.0
imageTag: v0.19.0

# Enable kustomize compatibility mode
kustomizeMode:
Expand Down Expand Up @@ -57,4 +57,67 @@ namespaceCreate:
rbac:
create: true
kubeflow:
enabled: false
enabled: false

# Katib configuration
config:
katibConfig: |
apiVersion: config.kubeflow.org/v1beta1
kind: KatibConfig
init:
certGenerator:
enable: true
controller:
webhookPort: 8443
trialResources:
- Job.v1.batch
- TFJob.v1.kubeflow.org
- PyTorchJob.v1.kubeflow.org
- MPIJob.v1.kubeflow.org
- XGBoostJob.v1.kubeflow.org
runtime:
metricsCollectors:
- kind: StdOut
image: ghcr.io/kubeflow/katib/file-metrics-collector:v0.19.0
- kind: File
image: ghcr.io/kubeflow/katib/file-metrics-collector:v0.19.0
- kind: TensorFlowEvent
image: ghcr.io/kubeflow/katib/tfevent-metrics-collector:v0.19.0
resources:
limits:
memory: 1Gi
suggestions:
- algorithmName: random
image: ghcr.io/kubeflow/katib/suggestion-hyperopt:v0.19.0
- algorithmName: tpe
image: ghcr.io/kubeflow/katib/suggestion-hyperopt:v0.19.0
- algorithmName: grid
image: ghcr.io/kubeflow/katib/suggestion-optuna:v0.19.0
- algorithmName: hyperband
image: ghcr.io/kubeflow/katib/suggestion-hyperband:v0.19.0
- algorithmName: bayesianoptimization
image: ghcr.io/kubeflow/katib/suggestion-skopt:v0.19.0
- algorithmName: cmaes
image: ghcr.io/kubeflow/katib/suggestion-goptuna:v0.19.0
- algorithmName: sobol
image: ghcr.io/kubeflow/katib/suggestion-goptuna:v0.19.0
- algorithmName: multivariate-tpe
image: ghcr.io/kubeflow/katib/suggestion-optuna:v0.19.0
- algorithmName: enas
image: ghcr.io/kubeflow/katib/suggestion-enas:v0.19.0
resources:
limits:
memory: 400Mi
- algorithmName: darts
image: ghcr.io/kubeflow/katib/suggestion-darts:v0.19.0
- algorithmName: pbt
image: ghcr.io/kubeflow/katib/suggestion-pbt:v0.19.0
persistentVolumeClaimSpec:
accessModes:
- ReadWriteMany
resources:
requests:
storage: 5Gi
earlyStoppings:
- algorithmName: medianstop
image: ghcr.io/kubeflow/katib/earlystopping-medianstop:v0.19.0
35 changes: 18 additions & 17 deletions experimental/helm/charts/katib/ci/values-kubeflow.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,7 @@

global:
namespace: kubeflow
imageTag: v0.18.0
imageTag: v0.19.0

# Enable kustomize compatibility mode
kustomizeMode:
Expand Down Expand Up @@ -111,6 +111,7 @@ config:
controller:
webhookPort: 8443
trialResources:
- TrainJob.v1alpha1.trainer.kubeflow.org
- Job.v1.batch
- TFJob.v1.kubeflow.org
- PyTorchJob.v1.kubeflow.org
Expand All @@ -119,40 +120,40 @@ config:
runtime:
metricsCollectors:
- kind: StdOut
image: ghcr.io/kubeflow/katib/file-metrics-collector:v0.18.0
image: ghcr.io/kubeflow/katib/file-metrics-collector:v0.19.0
- kind: File
image: ghcr.io/kubeflow/katib/file-metrics-collector:v0.18.0
image: ghcr.io/kubeflow/katib/file-metrics-collector:v0.19.0
- kind: TensorFlowEvent
image: ghcr.io/kubeflow/katib/tfevent-metrics-collector:v0.18.0
resources:
image: ghcr.io/kubeflow/katib/tfevent-metrics-collector:v0.19.0
resources:
limits:
memory: 1Gi
suggestions:
- algorithmName: random
image: ghcr.io/kubeflow/katib/suggestion-hyperopt:v0.18.0
image: ghcr.io/kubeflow/katib/suggestion-hyperopt:v0.19.0
- algorithmName: tpe
image: ghcr.io/kubeflow/katib/suggestion-hyperopt:v0.18.0
image: ghcr.io/kubeflow/katib/suggestion-hyperopt:v0.19.0
- algorithmName: grid
image: ghcr.io/kubeflow/katib/suggestion-optuna:v0.18.0
image: ghcr.io/kubeflow/katib/suggestion-optuna:v0.19.0
- algorithmName: hyperband
image: ghcr.io/kubeflow/katib/suggestion-hyperband:v0.18.0
image: ghcr.io/kubeflow/katib/suggestion-hyperband:v0.19.0
- algorithmName: bayesianoptimization
image: ghcr.io/kubeflow/katib/suggestion-skopt:v0.18.0
image: ghcr.io/kubeflow/katib/suggestion-skopt:v0.19.0
- algorithmName: cmaes
image: ghcr.io/kubeflow/katib/suggestion-goptuna:v0.18.0
image: ghcr.io/kubeflow/katib/suggestion-goptuna:v0.19.0
- algorithmName: sobol
image: ghcr.io/kubeflow/katib/suggestion-goptuna:v0.18.0
image: ghcr.io/kubeflow/katib/suggestion-goptuna:v0.19.0
- algorithmName: multivariate-tpe
image: ghcr.io/kubeflow/katib/suggestion-optuna:v0.18.0
image: ghcr.io/kubeflow/katib/suggestion-optuna:v0.19.0
- algorithmName: enas
image: ghcr.io/kubeflow/katib/suggestion-enas:v0.18.0
image: ghcr.io/kubeflow/katib/suggestion-enas:v0.19.0
resources:
limits:
memory: 400Mi
- algorithmName: darts
image: ghcr.io/kubeflow/katib/suggestion-darts:v0.18.0
image: ghcr.io/kubeflow/katib/suggestion-darts:v0.19.0
- algorithmName: pbt
image: ghcr.io/kubeflow/katib/suggestion-pbt:v0.18.0
image: ghcr.io/kubeflow/katib/suggestion-pbt:v0.19.0
persistentVolumeClaimSpec:
accessModes:
- ReadWriteMany
Expand All @@ -161,7 +162,7 @@ config:
storage: 5Gi
earlyStoppings:
- algorithmName: medianstop
image: ghcr.io/kubeflow/katib/earlystopping-medianstop:v0.18.0
image: ghcr.io/kubeflow/katib/earlystopping-medianstop:v0.19.0

# Security features - disabled for CI simplicity
networkPolicy:
Expand Down
32 changes: 16 additions & 16 deletions experimental/helm/charts/katib/ci/values-leader-election.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,7 @@

global:
namespace: kubeflow
imageTag: v0.18.0
imageTag: v0.19.0

# Enable kustomize compatibility mode
kustomizeMode:
Expand Down Expand Up @@ -110,40 +110,40 @@ config:
runtime:
metricsCollectors:
- kind: StdOut
image: ghcr.io/kubeflow/katib/file-metrics-collector:v0.18.0
image: ghcr.io/kubeflow/katib/file-metrics-collector:v0.19.0
- kind: File
image: ghcr.io/kubeflow/katib/file-metrics-collector:v0.18.0
image: ghcr.io/kubeflow/katib/file-metrics-collector:v0.19.0
- kind: TensorFlowEvent
image: ghcr.io/kubeflow/katib/tfevent-metrics-collector:v0.18.0
image: ghcr.io/kubeflow/katib/tfevent-metrics-collector:v0.19.0
resources:
limits:
memory: 1Gi
suggestions:
- algorithmName: random
image: ghcr.io/kubeflow/katib/suggestion-hyperopt:v0.18.0
image: ghcr.io/kubeflow/katib/suggestion-hyperopt:v0.19.0
- algorithmName: tpe
image: ghcr.io/kubeflow/katib/suggestion-hyperopt:v0.18.0
image: ghcr.io/kubeflow/katib/suggestion-hyperopt:v0.19.0
- algorithmName: grid
image: ghcr.io/kubeflow/katib/suggestion-optuna:v0.18.0
image: ghcr.io/kubeflow/katib/suggestion-optuna:v0.19.0
- algorithmName: hyperband
image: ghcr.io/kubeflow/katib/suggestion-hyperband:v0.18.0
image: ghcr.io/kubeflow/katib/suggestion-hyperband:v0.19.0
- algorithmName: bayesianoptimization
image: ghcr.io/kubeflow/katib/suggestion-skopt:v0.18.0
image: ghcr.io/kubeflow/katib/suggestion-skopt:v0.19.0
- algorithmName: cmaes
image: ghcr.io/kubeflow/katib/suggestion-goptuna:v0.18.0
image: ghcr.io/kubeflow/katib/suggestion-goptuna:v0.19.0
- algorithmName: sobol
image: ghcr.io/kubeflow/katib/suggestion-goptuna:v0.18.0
image: ghcr.io/kubeflow/katib/suggestion-goptuna:v0.19.0
- algorithmName: multivariate-tpe
image: ghcr.io/kubeflow/katib/suggestion-optuna:v0.18.0
image: ghcr.io/kubeflow/katib/suggestion-optuna:v0.19.0
- algorithmName: enas
image: ghcr.io/kubeflow/katib/suggestion-enas:v0.18.0
image: ghcr.io/kubeflow/katib/suggestion-enas:v0.19.0
resources:
limits:
memory: 400Mi
- algorithmName: darts
image: ghcr.io/kubeflow/katib/suggestion-darts:v0.18.0
image: ghcr.io/kubeflow/katib/suggestion-darts:v0.19.0
- algorithmName: pbt
image: ghcr.io/kubeflow/katib/suggestion-pbt:v0.18.0
image: ghcr.io/kubeflow/katib/suggestion-pbt:v0.19.0
persistentVolumeClaimSpec:
accessModes:
- ReadWriteMany
Expand All @@ -152,4 +152,4 @@ config:
storage: 5Gi
earlyStoppings:
- algorithmName: medianstop
image: ghcr.io/kubeflow/katib/earlystopping-medianstop:v0.18.0
image: ghcr.io/kubeflow/katib/earlystopping-medianstop:v0.19.0
Loading
Loading