Skip to content

feat: extend retention policies#961

Merged
skipi merged 19 commits into
mainfrom
mk/wf-retention-policies
Apr 15, 2026
Merged

feat: extend retention policies#961
skipi merged 19 commits into
mainfrom
mk/wf-retention-policies

Conversation

@skipi
Copy link
Copy Markdown
Collaborator

@skipi skipi commented Mar 27, 2026

📝 Description

  • Plumber now emits deletion events - when pipelines expire and are deleted, plumber publishes PipelineDeleted and WorkflowDeleted events to RabbitMQ. Workflow deletion is only emitted once all pipelines in a workflow are gone.
  • Artifacthub gains two new workers - a pipelinedeletion and workflowdeletion worker that consume those events and clean up the associated artifacts in the bucket.
  • Plumber's retention internals were refactored - the old policy consumer/record deleter was split into two explicit workers (policy marker and deleter) with cleaner separation of concerns, replacing the previous policy_applier/record_deleter structure.

✅ Checklist

  • I have tested this change
  • This change requires documentation update

@github-project-automation github-project-automation Bot moved this to Backlog in Roadmap Mar 27, 2026
@skipi skipi force-pushed the mk/wf-retention-policies branch 3 times, most recently from 1c460a2 to 71ce176 Compare March 27, 2026 12:03
@skipi skipi changed the title Workflow retention policies feat: extend retention policies Mar 27, 2026
@skipi skipi marked this pull request as ready for review March 27, 2026 12:26
@skipi skipi force-pushed the mk/wf-retention-policies branch 6 times, most recently from f2f74d8 to de8993f Compare April 2, 2026 09:38
@skipi skipi force-pushed the mk/wf-retention-policies branch from de8993f to 9bb4f32 Compare April 7, 2026 07:54
Comment thread plumber/ppl/test/retention/deleter/queries_test.exs
@skipi skipi force-pushed the mk/wf-retention-policies branch 3 times, most recently from 99b7375 to b76a475 Compare April 8, 2026 11:21
@skipi skipi force-pushed the mk/wf-retention-policies branch from b76a475 to 62eecae Compare April 13, 2026 09:09
@skipi skipi requested a review from DamjanBecirovic April 13, 2026 09:09
@skipi skipi merged commit 3ddb37b into main Apr 15, 2026
2 checks passed
@skipi skipi deleted the mk/wf-retention-policies branch April 15, 2026 07:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

Status: Backlog

Development

Successfully merging this pull request may close these issues.

2 participants