Skip to content

Commit 41d4a97

Browse files
ci: replace accelerate with diffusers bnb tests
Replace the accelerate job (which had 26/27 tests silently skipping) with diffusers, a much higher-value integration target for bnb. Diffusers has two layers of bnb test coverage: - tests/quantization/bnb/ — standalone 4-bit/8-bit quantization tests - tests/models/transformers/ — 9 model classes (Flux, HunyuanVideo, Wan, etc.) that inherit BitsAndBytesTesterMixin, testing quantization on real diffusion model architectures All are selected via `pytest -m bitsandbytes tests/` which matches the @is_bitsandbytes decorator that applies pytest.mark.bitsandbytes. Runner: L40S (bandb-aws-g6e-4xlarge-plus) matching diffusers' own CI runner (aws-g6e-xlarge-plus). L40S provides 48GB VRAM needed for larger diffusion models like Flux and HunyuanVideo. Also sets CUBLAS_WORKSPACE_CONFIG=:16:8 for determinism, matching the diffusers CI convention. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
1 parent 7495806 commit 41d4a97

1 file changed

Lines changed: 20 additions & 18 deletions

File tree

.github/workflows/tests-integration-nightly.yml

Lines changed: 20 additions & 18 deletions
Original file line numberDiff line numberDiff line change
@@ -154,10 +154,10 @@ jobs:
154154
path: reports/
155155
retention-days: 7
156156

157-
test-accelerate:
158-
name: Accelerate bnb tests
157+
test-diffusers:
158+
name: Diffusers bnb tests
159159
if: github.repository == 'bitsandbytes-foundation/bitsandbytes'
160-
runs-on: bandb-aws-g5-4xlarge-plus-use1-public-80 # A10
160+
runs-on: bandb-aws-g6e-4xlarge-plus-use1-public-80 # L40S (matches diffusers CI)
161161
steps:
162162
- name: Show GPU information
163163
run: nvidia-smi
@@ -174,38 +174,40 @@ jobs:
174174
pip install torch==${TORCH_VERSION} --index-url ${PYPI_INDEX}
175175
pip install "bitsandbytes[test] @ ${BNB_WHEEL_URL}"
176176
177-
- name: Install accelerate and clone matching tag
177+
- name: Install diffusers and clone matching tag
178178
run: |
179-
pip install accelerate transformers
180-
ACCELERATE_VERSION=$(pip show accelerate | awk '/^Version:/ {print $2}')
181-
echo "Installed accelerate v${ACCELERATE_VERSION}"
182-
git clone --depth=1 --branch "v${ACCELERATE_VERSION}" \
183-
https://github.com/huggingface/accelerate.git /tmp/accelerate
179+
pip install "diffusers[test]" transformers accelerate peft
180+
DIFFUSERS_VERSION=$(pip show diffusers | awk '/^Version:/ {print $2}')
181+
echo "Installed diffusers v${DIFFUSERS_VERSION}"
182+
git clone --depth=1 --branch "v${DIFFUSERS_VERSION}" \
183+
https://github.com/huggingface/diffusers.git /tmp/diffusers
184184
185185
- name: Show environment
186186
run: |
187187
pip list
188188
python -m torch.utils.collect_env
189189
190-
- name: Run accelerate bnb tests
191-
working-directory: /tmp/accelerate
190+
- name: Run diffusers bnb tests
191+
working-directory: /tmp/diffusers
192192
env:
193193
RUN_SLOW: "1"
194+
CUBLAS_WORKSPACE_CONFIG: ":16:8"
194195
shell: bash -o pipefail {0}
195196
run: |
196197
mkdir -p ${GITHUB_WORKSPACE}/reports
197-
python -m pytest tests/test_quantization.py \
198-
-s -v -rs \
199-
-k "not multi_device" \
200-
--junitxml=${GITHUB_WORKSPACE}/reports/accelerate.xml \
198+
python -m pytest \
199+
-m bitsandbytes \
200+
tests/ \
201+
-v \
202+
--junitxml=${GITHUB_WORKSPACE}/reports/diffusers.xml \
201203
-o junit_logging=all \
202-
2>&1 | tee ${GITHUB_WORKSPACE}/reports/accelerate.log
204+
2>&1 | tee ${GITHUB_WORKSPACE}/reports/diffusers.log
203205
204206
- name: Upload JUnit XML and log
205207
if: always()
206208
uses: actions/upload-artifact@v4
207209
with:
208-
name: reports-accelerate
210+
name: reports-diffusers
209211
path: reports/
210212
retention-days: 7
211213

@@ -331,7 +333,7 @@ jobs:
331333

332334
report:
333335
name: Consolidated report
334-
needs: [test-transformers, test-transformers-multigpu, test-accelerate, test-peft, test-peft-multigpu]
336+
needs: [test-transformers, test-transformers-multigpu, test-diffusers, test-peft, test-peft-multigpu]
335337
if: always() && github.repository == 'bitsandbytes-foundation/bitsandbytes'
336338
runs-on: ubuntu-22.04
337339
steps:

0 commit comments

Comments
 (0)