Skip to content

chore(daily_spellbook): decommission 38 unused hidden-leaf spells#9810

Closed
a-monteiro wants to merge 1 commit into
mainfrom
andre/cur2-2853-daily-decommission
Closed

chore(daily_spellbook): decommission 38 unused hidden-leaf spells#9810
a-monteiro wants to merge 1 commit into
mainfrom
andre/cur2-2853-daily-decommission

Conversation

@a-monteiro

@a-monteiro a-monteiro commented Jun 20, 2026

Copy link
Copy Markdown
Member

Decommissions 38 unused hidden-leaf spells in daily_spellbook as a compute quick win. Each spell is hidden via hide_spells() (so dune.visible=false, not shown in the data explorer), is a leaf in combined dbt + sqlmesh lineage (no model/exposure/sqlmesh/curated-data consumer, checked against the 5 prod manifests, sqlmesh external_models.yaml, and a cross-repo grep), and cleared a usage safety bar over 6 months (Jan–Jun 2026) of QES customer-query data: zero enterprise/paid queries, zero paid customers, and fewer than 5 total queries. 34 of the 38 had zero customer queries in the window.

Deleting these materialized models stops their recurring dbt builds, recovering ~3.06 CPU-hrs/day and ~1.61 TB/day of build compute (query_history 14-day average). The largest single item, frax_finance_bnb.bribes, is ~2.48 CPU-hrs/day on its own.

For each spell the .sql and its _schema.yml entry are removed; sole-model schema files are deleted outright. Orphaned singular tests and their seed fixtures (spaceid, pooltogether, jarvis_network) are removed, and now-unused per-directory config paths in dbt_project.yml (spaceid, pooltogether, worldcoin) are cleaned up. Customer-facing surfaces are protected by the paid-usage guard and untouched.

Verified: only the target models were removed (no surviving-model schema content changed), no dangling refs remain repo-wide, and dbt parse is clean (no warnings).

Fixes CUR2-2853
Towards CUR2-2852

@github-actions github-actions Bot added WIP work in progress dbt: daily covers the Daily dbt subproject labels Jun 20, 2026

Copy link
Copy Markdown
Member Author

This stack of pull requests is managed by Graphite. Learn more about stacking.

@a-monteiro a-monteiro marked this pull request as ready for review June 20, 2026 21:20
@cursor

cursor Bot commented Jun 20, 2026

Copy link
Copy Markdown

PR Summary

Medium Risk
Large deletion surface across many domains; risk is mainly breaking unknown downstream queries or docs that still referenced these hidden tables, mitigated by the PR’s leaf-lineage and low-usage checks.

Overview
Removes 38 hidden-leaf dbt spells from daily_spellbook so they no longer run in production builds. For each target, the model .sql is deleted and its _schema.yml documentation/tests are dropped; whole schema files go away when nothing remains.

Coverage spans sector unions (EAS eas_schemas / eas_attestation_details, inscriptions, labels, rebase, referral, social), project-specific tables (Eigenlayer latest exchange rate, Ajna pools, Frax BNB bribes, GMX GLP components, Nexus Mutual swaps/staking rewards, Pooltogether prize structure, Rocketpool node master, SpaceID registrations, Timeswap lend/borrow, and others), plus dbt_project.yml cleanup for spaceid, pooltogether, and worldcoin schema paths that are no longer used.

Several _schema.yml files that keep other models are trimmed only for the removed spells (e.g. GoodDollar daily UBI agg, EAS schema rename/consolidation for eas_schema_details). The intent is compute savings on unused hide_spells() materializations without changing surviving models’ SQL.

Reviewed by Cursor Bugbot for commit e584d82. Configure here.

@github-actions github-actions Bot added ready-for-review this PR development is complete, please review and removed WIP work in progress labels Jun 20, 2026
@a-monteiro a-monteiro requested a review from a team June 22, 2026 07:11
@0xRobin 0xRobin self-assigned this Jun 22, 2026

@0xRobin 0xRobin left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

discussing on slack

will close these decomission PRs until we have better guidance and a bigger mandate to deprecate lineages as a whole instead of singular models

@0xRobin 0xRobin closed this Jun 29, 2026
@github-actions github-actions Bot locked and limited conversation to collaborators Jun 29, 2026
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

dbt: daily covers the Daily dbt subproject ready-for-review this PR development is complete, please review

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants