List view

Support 4bit torch.compile fullgraph with PyTorch nightly

torch.compile

Status: Merged (completed).

bitsandbytes-foundation/bitsandbytesnumber 1616

#1616 In bitsandbytes-foundation/bitsandbytes;

· by matthewdouglas was closed on Apr 28, 2025

Additional CI runners

CI/CD

Status: Merged (completed).

bitsandbytes-foundation/bitsandbytesnumber 1639

#1639 In bitsandbytes-foundation/bitsandbytes;

· by matthewdouglas was closed on May 14, 2025

Moved int8_mm_dequant from CPU to default backend

Cross Platform

Status: Merged (completed).

bitsandbytes-foundation/bitsandbytesnumber 1626

#1626 In bitsandbytes-foundation/bitsandbytes;

· by Egor-Krivov was closed on May 7, 2025

PyTorch Custom Operator Integration

Cross Platform

High Priority(first issues that will be worked on)(first issues that will be worked on)

Status: Merged (completed).

bitsandbytes-foundation/bitsandbytesnumber 1544

#1544 In bitsandbytes-foundation/bitsandbytes;

· by matthewdouglas was closed on Mar 25, 2025

General cleanup & test improvements

Status: Merged (completed).

bitsandbytes-foundation/bitsandbytesnumber 1646

#1646 In bitsandbytes-foundation/bitsandbytes;

· by matthewdouglas was closed on May 24, 2025

Optimizer backwards compatibility fix

OptimizersIssues or feature requests relating to optimizersIssues or feature requests relating to optimizers

Status: Merged (completed).

bitsandbytes-foundation/bitsandbytesnumber 1647

#1647 In bitsandbytes-foundation/bitsandbytes;

· by matthewdouglas was closed on May 23, 2025

Add torch.compile tests

torch.compile

Status: Merged (completed).

bitsandbytes-foundation/bitsandbytesnumber 1648

#1648 In bitsandbytes-foundation/bitsandbytes;

· by matthewdouglas was closed on May 24, 2025

Documentation Cleanup

DocumentationImprovements or additions to documentationImprovements or additions to documentation

Status: Merged (completed).

bitsandbytes-foundation/bitsandbytesnumber 1644

#1644 In bitsandbytes-foundation/bitsandbytes;

· by matthewdouglas was closed on May 24, 2025

simplified non_sign_bits

Status: Merged (completed).

bitsandbytes-foundation/bitsandbytesnumber 1649

#1649 In bitsandbytes-foundation/bitsandbytes;

· by ved1beta was closed on May 24, 2025

Linux aarch64 CI updates

aarch64

Build

CI/CD

Cross Platform

Status: Merged (completed).

bitsandbytes-foundation/bitsandbytesnumber 1622

#1622 In bitsandbytes-foundation/bitsandbytes;

· by matthewdouglas was closed on May 2, 2025

Refresh content for README.md

DocumentationImprovements or additions to documentationImprovements or additions to documentation

Status: Merged (completed).

bitsandbytes-foundation/bitsandbytesnumber 1620

#1620 In bitsandbytes-foundation/bitsandbytes;

· by matthewdouglas was closed on May 8, 2025

Test cleanup

CI/CD

Status: Merged (completed).

bitsandbytes-foundation/bitsandbytesnumber 1576

#1576 In bitsandbytes-foundation/bitsandbytes;

· by matthewdouglas was closed on Mar 27, 2025

Drop Python 3.8 support.

Chore

Status: Merged (completed).

bitsandbytes-foundation/bitsandbytesnumber 1574

#1574 In bitsandbytes-foundation/bitsandbytes;

· by matthewdouglas was closed on Mar 27, 2025

Bump CUDA 12.8.0 build to CUDA 12.8.1

Build

Chore

Status: Merged (completed).

bitsandbytes-foundation/bitsandbytesnumber 1575

#1575 In bitsandbytes-foundation/bitsandbytes;

· by matthewdouglas was closed on Mar 27, 2025

Fix torch.compile issue for LLM.int8() with threshold=0

torch.compile

Status: Merged (completed).

bitsandbytes-foundation/bitsandbytesnumber 1581

#1581 In bitsandbytes-foundation/bitsandbytes;

· by matthewdouglas was closed on Apr 1, 2025

Fix: Return tuple in get_cuda_version_tuple

Status: Merged (completed).

bitsandbytes-foundation/bitsandbytesnumber 1580

#1580 In bitsandbytes-foundation/bitsandbytes;

· by DevKimbob was closed on Mar 31, 2025

Stop building for CUDA toolkit < 11.8

Build

Status: Merged (completed).

bitsandbytes-foundation/bitsandbytesnumber 1605

#1605 In bitsandbytes-foundation/bitsandbytes;

· by matthewdouglas was closed on Apr 22, 2025

fix typo __getitem__

Status: Merged (completed).

bitsandbytes-foundation/bitsandbytesnumber 1597

#1597 In bitsandbytes-foundation/bitsandbytes;

· by ved1beta was closed on Apr 15, 2025

Support LLM.int8() inference with torch.compile

torch.compile

Status: Merged (completed).

bitsandbytes-foundation/bitsandbytesnumber 1594

#1594 In bitsandbytes-foundation/bitsandbytes;

· by matthewdouglas was closed on Apr 17, 2025

Updates for device agnosticism

CI/CD

Cross Platform

Status: Merged (completed).

bitsandbytes-foundation/bitsandbytesnumber 1601

#1601 In bitsandbytes-foundation/bitsandbytes;

· by matthewdouglas was closed on Apr 22, 2025

fix: Improve CUDA version detection and error handling

Cross Platform

CUDA Setup

Status: Merged (completed).

bitsandbytes-foundation/bitsandbytesnumber 1599

#1599 In bitsandbytes-foundation/bitsandbytes;

· by ved1beta was closed on Apr 17, 2025

Add simple op implementations for CPU

aarch64

Cross Platform

x64 CPU

Status: Merged (completed).

bitsandbytes-foundation/bitsandbytesnumber 1602

#1602 In bitsandbytes-foundation/bitsandbytes;

· by matthewdouglas was closed on Apr 28, 2025

Set up nightly CI for unit tests

CI/CD

Status: Merged (completed).

bitsandbytes-foundation/bitsandbytesnumber 1619

#1619 In bitsandbytes-foundation/bitsandbytes;

· by matthewdouglas was closed on Apr 29, 2025

Improve torch.compile support for int8 with torch>=2.8 nightly

torch.compile

Status: Merged (completed).

bitsandbytes-foundation/bitsandbytesnumber 1617

#1617 In bitsandbytes-foundation/bitsandbytes;

· by matthewdouglas was closed on Apr 28, 2025

C lib loading: add fallback with sensible error msg

CUDA Setup

Status: Merged (completed).

bitsandbytes-foundation/bitsandbytesnumber 1615

#1615 In bitsandbytes-foundation/bitsandbytes;

· by Titus-von-Koeller was closed on May 9, 2025