Skip to content

Commit 149f7b8

Browse files
fix: skip Docker restart for Dremio to preserve Nessie metadata cache
After docker compose stop/start for seed caching, Dremio loses its in-memory metadata cache. The VDS view validator then cannot resolve Nessie-backed tables, causing all integration model views to fail. Since the Dremio external seeder with COPY INTO is already fast (~1 min), seed caching provides no meaningful benefit. Excluding Dremio from the Docker restart eliminates the metadata cache loss entirely. Co-Authored-By: Itamar Hartstein <haritamar@gmail.com>
1 parent 9f5623e commit 149f7b8

1 file changed

Lines changed: 1 addition & 7 deletions

File tree

.github/workflows/test-warehouse.yml

Lines changed: 1 addition & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -317,7 +317,7 @@ jobs:
317317
run: dbt seed -f --target "${{ inputs.warehouse-type }}"
318318

319319
- name: Save seed cache from Docker volumes
320-
if: steps.seed-cache.outputs.cache-hit != 'true' && inputs.warehouse-type != 'duckdb' && inputs.warehouse-type != 'trino' && inputs.warehouse-type != 'spark' && (inputs.warehouse-type == 'postgres' || inputs.warehouse-type == 'clickhouse' || inputs.warehouse-type == 'dremio')
320+
if: steps.seed-cache.outputs.cache-hit != 'true' && inputs.warehouse-type != 'duckdb' && inputs.warehouse-type != 'trino' && inputs.warehouse-type != 'spark' && inputs.warehouse-type != 'dremio' && (inputs.warehouse-type == 'postgres' || inputs.warehouse-type == 'clickhouse')
321321
working-directory: ${{ env.E2E_DBT_PROJECT_DIR }}
322322
run: |
323323
CACHE_DIR="/tmp/seed-cache-${{ inputs.warehouse-type }}"
@@ -356,12 +356,6 @@ jobs:
356356
echo "Waiting for Spark after restart... ($i/60)"; sleep 5
357357
done
358358
;;
359-
dremio)
360-
for i in $(seq 1 60); do
361-
curl -sf http://localhost:9047 > /dev/null && break
362-
echo "Waiting for Dremio after restart... ($i/60)"; sleep 5
363-
done
364-
;;
365359
postgres)
366360
for i in $(seq 1 30); do
367361
pg_isready -h localhost -p 5432 > /dev/null 2>&1 && break

0 commit comments

Comments
 (0)