Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
90 commits
Select commit Hold shift + click to select a range
c1460c1
feat: values for PSQL db name, elastic prefix (#313)
KonstantinVishnivetskii May 18, 2023
f5d8134
feat(search,schema-registry): updates for v0.10.3 release (#311)
david-leifker May 26, 2023
3678c86
Update kafka chart to 22.1.3 for kafka 3.4.0 (#316)
jinlintt Jun 1, 2023
1f9ffe6
feat: add parameters to cleanupJob resources settings (#317)
alvarogonzalez-packlink Jun 8, 2023
67d5821
feat: Add ability to specify extraPodLabels per deployment (#310)
Jorricks Jun 8, 2023
9063b60
fix: use common labels for (Cron)Jobs (#303)
matthijsvanderloos Jun 8, 2023
07e205e
fix: add missing global values to subchart values (#302)
matthijsvanderloos Jun 8, 2023
6c72601
feat: allow pulling ebean username from secrets alongside password (#…
maxpospischil Jun 8, 2023
3883f3e
chore(secrets): use configurable refs instead of fixed names (#323)
sgomezvillamor Jun 8, 2023
4c5ce1a
Update Default version to v0.10.4 (#330)
pedro93 Jun 13, 2023
7ab12ef
fix: Fixed indentation in datahub-cleanup-job-template.yml (#328)
tusharm Jun 14, 2023
1f96d87
feat(healthcheck): use new healthcheck endpoint for GMS (#331)
iprentic Jun 14, 2023
9746aa2
chore(version): version bump & indent (#324)
david-leifker Jun 15, 2023
40ec8f8
feat: Default User Credentials (#321)
Seokyun-Ha Jun 15, 2023
3ad9b0e
feat(cloud-sql-proxy): add support for running gcloud sql proxy as pr…
TonyOuyangGit Jun 15, 2023
9b03bca
feat: allow for overriding job annotations and adding init containers…
davidspek Jun 26, 2023
3a454ee
feat(cron): Adding more parameters to ingestion-cron (#336)
miguelbirdie Jun 29, 2023
9e1b66a
Update charts to include search and browse env variable flags (#337)
chriscollins3456 Jun 29, 2023
d56333b
fix(config) Set search and browse flags default off (#339)
chriscollins3456 Jul 6, 2023
9425a23
feat(cron): support nodeselector, affinity and toleration capabilitie…
sachinsaju Jul 21, 2023
bd670a9
Helm update for 0.10.5 release (#346)
iprentic Aug 3, 2023
30eee99
docs(readme): document secrets randomization (#350)
david-leifker Aug 15, 2023
ea8a178
fix(auth-secrets): fix system update secrets (#351)
david-leifker Aug 18, 2023
a8baacd
fix(datahub-system-update-job): enable `SPRING_KAFKA_PROPERTIES_AUTO_…
LittleWat Sep 6, 2023
0663c57
feat(session): add session duration configuration (#361)
RyanHolstien Sep 6, 2023
f4cd1ff
fix(ingestion-cron): fix indentation in ingestion cron template (#356)
sachinsaju Sep 7, 2023
062a629
docs(ingestion-cron): add documentation for ingestion cron job values…
sachinsaju Sep 7, 2023
ff3ea3a
Helm changes for 0.11.0 release (#366)
iprentic Sep 11, 2023
935171e
Release v0.11.0 updates (#367)
david-leifker Sep 14, 2023
d8e8c55
doc(values): remove duplicate doc (#363)
david-leifker Sep 19, 2023
ef63fae
chore(gms): setup readiness & liveness from main chart (#314)
dim-ops Sep 19, 2023
e725085
fix(secret): improve secret default behavior (#369)
RyanHolstien Sep 29, 2023
68400a9
feat(neo4j): update neo4j chart (#365)
gschuurman Oct 4, 2023
ae3db71
feat(datahub-ingestion-cron): added support for configuring securityC…
upendrao Oct 4, 2023
83d6714
fix(neo4j): enable APOC plugin (#353)
lix-mms Oct 10, 2023
826bf3b
fix(kafka): increase kafka chart version due to kraft enabled error (…
janfrederickk Oct 12, 2023
4a19805
feat(datahub-upgrade): adding concurrency policy for the cronjobs (#…
dheerajrampally Oct 12, 2023
a20eac2
fix(actions): update datahub actions default version (#348)
DSchmidtDev Oct 20, 2023
853a083
feat(frontend, gms): add ability to choose service type (#384)
KonstantinVishnivetskii Oct 20, 2023
ee2bc53
fix(hazelcast): replace all invalid chars (#386)
sgomezvillamor Oct 23, 2023
ae4bbd3
fix(healthcheck): revert to old healthcheck endpoint for GMS (#393)
darnaut Oct 31, 2023
5996528
Kafka message size options (#383)
david-leifker Nov 3, 2023
21de8df
fix(ingestion-cron): remove duplicate shell command in cron chart (#391)
sachinsaju Nov 7, 2023
a99102e
(feat) configuring containerPort from Values in datahub-frontend (#385)
dheerajrampally Nov 7, 2023
741ecc2
Default to Datahub v0.12.0 (#390)
pedro93 Nov 9, 2023
1c5990f
fix(auth): change service authentication default to true and add emai…
RyanHolstien Nov 15, 2023
6311fce
feat(sql): allow providing username from secret for sql setup jobs (#…
Gerrit-K Nov 16, 2023
7f92a58
feat(datahub-frontend): add checksum annotation for user-secrets (#371)
Gerrit-K Nov 20, 2023
b3f33cf
Add ability for edit user_name_claim and regex (#388)
gschuurman Nov 27, 2023
6598b1d
feat: support setting priority class name for datahub pods (#392)
sachinsaju Nov 29, 2023
79f70a5
Disable Neo4j by default (#402)
darnaut Nov 30, 2023
a1ba211
Feat: Add Basic Auth For Using Confluent Kafka Schema Registry API (#…
mynameis-sohee Dec 6, 2023
a0cbaef
style(datahub-frontend): change order of attributes to correct the hi…
MartinKChen Dec 6, 2023
6b35004
fix(neo4j): update the neo4j volume properties (#399)
leeeizhang Dec 6, 2023
cbf1cab
feat(misc): misc updates (#406)
david-leifker Dec 7, 2023
b969ce1
feat: add `monitoring.portName` in values.yaml (#407)
travis-cook-sfdc Dec 11, 2023
6f73340
feat: add custom image commands and arguments (#408)
travis-cook-sfdc Dec 11, 2023
ceb3a26
V0.12.1 release (#409)
david-leifker Dec 12, 2023
1f2abfd
feat (datahub-actions): Expose executor id, gms protocol, and debug f…
jinlintt Dec 21, 2023
a0d5e88
Config: Make neo4j database configurable (#412)
gschuurman Dec 21, 2023
46dda20
Fix OIDC username claim not overridable for azure (#415)
gschuurman Dec 21, 2023
1c9b471
feat(kafka): add configuration option for preventing deserialization …
RyanHolstien Dec 21, 2023
0f45fa4
feat(ingestion): add configuration option to suspend jobs (#419)
feldjay Dec 21, 2023
cc656aa
fix(release): bump chart versions and default cli (#420)
RyanHolstien Dec 22, 2023
782e147
Allow nodeSelector and tolerations to be applied to all components gl…
darnaut Dec 27, 2023
9e3524f
fix: fix custom command & args behavior (#422)
travis-cook-sfdc Jan 4, 2024
5366a37
feat: add ingestion config map in values (#423)
travis-cook-sfdc Jan 9, 2024
ab8d94a
docs: fix readme for default option (#425)
drewhayward Jan 10, 2024
c99aa11
fix(ingestion): Fix scope of `.Values.globals` in ingestion (#424)
travis-cook-sfdc Jan 10, 2024
f04bcde
fix(kafka-setup-job): allow global.kafka.zookeeper.server to be unset…
darnaut Jan 11, 2024
a702624
fix: fix bug in configmap api version (#427)
travis-cook-sfdc Jan 26, 2024
ecb168d
fix(mysql): adjust default character set and collation (#428)
darnaut Feb 10, 2024
2d03ffc
Adding the support for custom labels to the datahub-frontend service …
dheerajrampally Feb 15, 2024
34440a0
Support nonblocking system update mode (#432)
david-leifker Feb 26, 2024
37aedb1
Bump kafka chart to 26.11.2 that uses kafka 3.6.1 (#431)
jinlintt Mar 1, 2024
1f1d4d8
feat(release): v0.13.0 (#434)
RyanHolstien Mar 4, 2024
db3ad5c
chore(mysql): Bump mysql chart (#437)
david-leifker Mar 7, 2024
d56a9ae
fix(mysql): downgrade mysql chart to 9.4.9 (#439)
darnaut Mar 11, 2024
6888a49
docs: Updated mysql secret generation command (#438)
mkaramuk Mar 12, 2024
90e7500
Fix system update extra envs indent (#445)
david-leifker Mar 27, 2024
63172db
fix: hazelcast service name (#443)
sgomezvillamor Mar 27, 2024
268349b
fix(system-update): really fix indent this time (#446)
david-leifker Mar 27, 2024
1efe6e6
bump(actions): bump actions version (#448)
david-leifker Mar 27, 2024
87225b9
updates for release v0.13.1 (#451)
david-leifker Apr 10, 2024
ec89e9a
disable view access perm (#452)
david-leifker Apr 10, 2024
cee96ec
Add missing env var for values view access controls (#453)
david-leifker Apr 11, 2024
8a360a1
revert non-blocking update (#454)
david-leifker Apr 11, 2024
89c92c8
bump hotfix release v0.13.2 (#455)
david-leifker Apr 16, 2024
2cc4fae
feat(restoreIndices): configurable crontab schedule (#457)
lix-mms May 7, 2024
d0fa278
Upgrade 0.13.1
ericnoam May 31, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 1 addition & 2 deletions .github/workflows/release.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -31,8 +31,7 @@ jobs:
- name: Add Helm repos
run: |
helm repo add elasticsearch https://helm.elastic.co
helm repo add neo4j https://neo4j-contrib.github.io/neo4j-helm
helm repo add neo4j-community https://equinor.github.io/helm-charts/charts
helm repo add neo4j https://helm.neo4j.com/neo4j
helm repo add mysql https://charts.bitnami.com/bitnami
helm repo add cp-helm-charts https://confluentinc.github.io/cp-helm-charts
helm repo add kafka https://charts.bitnami.com/bitnami
Expand Down
15 changes: 6 additions & 9 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -32,22 +32,19 @@ The main components are powered by 4 external dependencies:
- Kafka
- Local DB (MySQL, Postgres, MariaDB)
- Search Index (Elasticsearch)
- Graph Index (Supports either Neo4j or Elasticsearch)
- Graph Index (Supports either Elasticsearch or Neo4j)

The dependencies must be deployed before deploying Datahub. We created a separate
[chart](https://github.com/acryldata/datahub-helm/tree/master/charts/prerequisites)
for deploying the dependencies with example configuration. They could also be deployed
separately on-prem or leveraged as managed services. To remove your dependency on Neo4j,
set enabled to false in the `datahub-kubernetes/prerequisites/values.yaml` file.
Then, override the `graph_service_impl` field in `datahub-kubernetes/datahub/values.yaml` to
have the value `elasticsearch` instead of `neo4j`.
separately on-prem or leveraged as managed services.

## Quickstart
Assuming kubectl context points to the correct kubernetes cluster, first create kubernetes secrets that contain MySQL and Neo4j passwords.

```(shell)
kubectl create secret generic mysql-secrets --from-literal=mysql-root-password=datahub
kubectl create secret generic neo4j-secrets --from-literal=neo4j-password=datahub
kubectl create secret generic mysql-secrets --from-literal=mysql-root-password=datahub --from-literal=mysql-password=datahub
kubectl create secret generic neo4j-secrets --from-literal=neo4j-password=datahub --from-literal=NEO4J_AUTH=neo4j/datahub
```

The above commands sets the passwords to "datahub" as an example. Change to any password of choice.
Expand Down Expand Up @@ -79,7 +76,7 @@ elasticsearch-master-0 1/1 Running 0
prerequisites-cp-schema-registry-cf79bfccf-kvjtv 2/2 Running 1 63m
prerequisites-kafka-0 1/1 Running 2 62m
prerequisites-mysql-0 1/1 Running 1 62m
prerequisites-neo4j-community-0 1/1 Running 0 52m
prerequisites-neo4j-0 1/1 Running 0 52m
prerequisites-zookeeper-0 1/1 Running 0 62m
```

Expand Down Expand Up @@ -109,7 +106,7 @@ elasticsearch-master-0 1/1 Running 0
prerequisites-cp-schema-registry-cf79bfccf-kvjtv 2/2 Running 1 99m
prerequisites-kafka-0 1/1 Running 2 97m
prerequisites-mysql-0 1/1 Running 1 97m
prerequisites-neo4j-community-0 1/1 Running 0 88m
prerequisites-neo4j-0 1/1 Running 0 88m
prerequisites-zookeeper-0 1/1 Running 0 97m
```

Expand Down
16 changes: 8 additions & 8 deletions charts/datahub/Chart.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -4,33 +4,33 @@ description: A Helm chart for LinkedIn DataHub
type: application
# This is the chart version. This version number should be incremented each time you make changes
# to the chart and its templates, including the app version.
version: 0.2.187
version: 0.4.10
# This is the version number of the application being deployed. This version number should be
# incremented each time you make changes to the application.
appVersion: 0.11.0
appVersion: 0.13.2
dependencies:
- name: datahub-gms
version: 0.2.151
version: 0.2.167
repository: file://./subcharts/datahub-gms
condition: datahub-gms.enabled
- name: datahub-frontend
version: 0.2.141
version: 0.2.157
repository: file://./subcharts/datahub-frontend
condition: datahub-frontend.enabled
- name: datahub-mae-consumer
version: 0.2.147
version: 0.2.158
repository: file://./subcharts/datahub-mae-consumer
condition: global.datahub_standalone_consumers_enabled
- name: datahub-mce-consumer
version: 0.2.150
version: 0.2.160
repository: file://./subcharts/datahub-mce-consumer
condition: global.datahub_standalone_consumers_enabled
- name: datahub-ingestion-cron
version: 0.2.136
version: 0.2.143
repository: file://./subcharts/datahub-ingestion-cron
condition: datahub-ingestion-cron.enabled
- name: acryl-datahub-actions
version: 0.2.138
version: 0.2.144
repository: file://./subcharts/acryl-datahub-actions
condition: acryl-datahub-actions.enabled
maintainers:
Expand Down
Loading