Skip to content

Commit 5a094f2

Browse files
authored
feat(pipelines): Support setting ELT_WRITE_DISPOSITION value in Ansible playbook (#164)
### Summary The Ansible playbook can now set the mode for write_disposition in the ELT cron jobs. For now Opralog is set to replace to ensure everything is fresh until #138 is implemented. Refs #138 <!-- This is an auto-generated comment: release notes by coderabbit.ai --> ## Summary by CodeRabbit ## Release Notes * **Chores** * Updated data warehouse configuration to support write disposition settings with replace mode enabled for improved data handling. <sub>✏️ Tip: You can customize this high-level summary in your review settings.</sub> <!-- end of auto-generated comment: release notes by coderabbit.ai -->
1 parent 1b7a8a3 commit 5a094f2

2 files changed

Lines changed: 2 additions & 0 deletions

File tree

infra/ansible-docker/playbooks/elt/elt_cron_tasks.yml

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -8,6 +8,7 @@
88
job: >
99
NO_COLOR=1 UV_NO_PROGRESS=1
1010
ELT_SECRETS={{ elt_secrets_root_dir }}/{{ warehouse.name }}/envvars
11+
ELT_WRITE_DISPOSITION={{ source.write_disposition | default("") }}
1112
{{ elt_cron_root_dir }}/elt_task.sh
1213
https://github.com/{{ warehouse.github_org }}/{{ warehouse.github_repo }}.git
1314
{{ elt_git_clone_dir }}/{{ warehouse.github_org }}/{{ warehouse.github_repo }}

infra/ansible-docker/playbooks/elt/group_vars/elt.yml

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -29,6 +29,7 @@ elt_warehouses:
2929
hour: 2
3030
minute: 11
3131
dbt_args: "--select '+models/operations' --exclude '+models/operations/power_consumption.sql'"
32+
write_disposition: "replace"
3233
- name: electricity_sharepoint
3334
hour: "*"
3435
minute: 5

0 commit comments

Comments
 (0)