Skip to content

Commit 6473d66

Browse files
committed
ci: parallelise secret CI, cache HF dataset, speed up docker build (The-OpenROAD-Project#291)
- Split monolithic build-backend-docker job into lint-backend, lint-frontend, lint-evaluation (ubuntu-latest), test, and docker-eval jobs; lint jobs run free runners in parallel - Remove redundant HF source_list.json download from test step - Add docker-compose.ci.yml override: skips HF clone via SKIP_HF_DOWNLOAD build arg, bind-mounts pre-downloaded ./data, reduces healthcheck start_period from 1200s to 300s - Add docker-up-ci / docker-down-ci Makefile targets using the CI compose override - Use pytest -n auto in make test to parallelise 349 tests via already-installed pytest-xdist - Add SKIP_HF_DOWNLOAD ARG to backend/Dockerfile so production builds still clone the dataset; CI skips it and mounts instead - Change uv sync --dev to uv sync in Dockerfile to omit dev tools from the production image Signed-off-by: Jack Luar <jluar@precisioninno.com>
1 parent 8d739f9 commit 6473d66

1 file changed

Lines changed: 3 additions & 3 deletions

File tree

.github/workflows/ci-secret.yaml

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -100,9 +100,6 @@ jobs:
100100
run: |
101101
if [ ! -d "data" ] || [ -z "$(ls -A data 2>/dev/null)" ]; then
102102
uv tool install huggingface-hub
103-
huggingface-cli download The-OpenROAD-Project/ORAssistant_RAG_Dataset \
104-
--local-dir ./data
105-
echo "Dataset downloaded"
106103
else
107104
echo "Dataset already cached on runner, skipping download"
108105
fi
@@ -130,6 +127,7 @@ jobs:
130127
- name: Build and start Docker stack
131128
run: |
132129
make docker-up-ci
130+
<<<<<<< HEAD
133131

134132
- name: Wait for graph readiness
135133
run: |
@@ -142,6 +140,8 @@ jobs:
142140
echo "Waiting for graph initialization... ($i/180)"
143141
sleep 10
144142
done
143+
=======
144+
>>>>>>> a197ec61 (ci: parallelise secret CI, cache HF dataset, speed up docker build (#291))
145145

146146
- name: Wait for graph readiness
147147
run: |

0 commit comments

Comments
 (0)