Skip to content

Commit 96a8bf6

Browse files
matthewdouglasmatthewdouglas
committed
Update accelerator support chart
1 parent 896d8e2 commit 96a8bf6

1 file changed

Lines changed: 87 additions & 8 deletions

File tree

‎README.md‎

Lines changed: 87 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -31,14 +31,93 @@ bitsandbytes has the following minimum requirements for all platforms:
3131

3232
* Python 3.9+
3333
* [PyTorch](https://pytorch.org/get-started/locally/) 2.2+
34-
35-
Platform specific requirements are detailed below:
36-
#### Linux x86-64
37-
* glibc >= 2.24
38-
39-
#### Windows x86-64
40-
* Windows Server 2019+ or Windows 11+
41-
34+
* _Note: While we aim to provide wide backwards compatibility, we recommend using the latest version of PyTorch for the best experience._
35+
36+
#### Accelerator support:
37+
38+
<table>
39+
<thead>
40+
<tr>
41+
<th>Platform</th>
42+
<th>Accelerator</th>
43+
<th>Hardware Requirements</th>
44+
<th>Support Status</th>
45+
</tr>
46+
</thead>
47+
<tbody>
48+
<tr>
49+
<td colspan="4">🐧 <strong>Linux</strong></td>
50+
</tr>
51+
<tr>
52+
<td align="right">x86-64</td>
53+
<td>◻️ CPU</td>
54+
<td></td>
55+
<td>〰️ Partial Support</td>
56+
</tr>
57+
<tr>
58+
<td></td>
59+
<td>🟩 NVIDIA GPU</td>
60+
<td>SM50+ minimum<br>SM75+ recommended</td>
61+
<td>✅ Full Support *</td>
62+
</tr>
63+
<tr>
64+
<td></td>
65+
<td>🟥 AMD GPU</td>
66+
<td>gfx90a, gfx942, gfx1100</td>
67+
<td>🚧</td>
68+
</tr>
69+
<tr>
70+
<td></td>
71+
<td>🟦 Intel XPU</td>
72+
<td>TBD</td>
73+
<td>🚧</td>
74+
</tr>
75+
<tr>
76+
<td align="right">aarch64</td>
77+
<td>CPU</td>
78+
<td></td>
79+
<td>〰️ Partial Support</td>
80+
</tr>
81+
<tr>
82+
<td></td>
83+
<td>🟩 NVIDIA GPU</td>
84+
<td>SM75, SM80, SM90, SM100</td>
85+
<td>✅ Full Support *</td>
86+
</tr>
87+
<tr>
88+
<td colspan="4">🪟 <strong>Windows</strong></td>
89+
</tr>
90+
<tr>
91+
<td align="right">x86-64</td>
92+
<td>◻️ CPU</td>
93+
<td>AVX2</td>
94+
<td>〰️ Partial Support</td>
95+
</tr>
96+
<tr>
97+
<td></td>
98+
<td>🟩 NVIDIA GPU</td>
99+
<td>SM50+ minimum<br>SM75+ recommended</td>
100+
<td>✅ Full Support *</td>
101+
</tr>
102+
<tr>
103+
<td></td>
104+
<td>🟦 Intel XPU</td>
105+
<td>TBD</td>
106+
<td>🚧</td>
107+
</tr>
108+
<tr>
109+
<td colspan="4">🍎 <strong>macOS</strong></td>
110+
</tr>
111+
<tr>
112+
<td align="right">arm64</td>
113+
<td>◻️ CPU / Metal</td>
114+
<td>Apple M1+</td>
115+
<td>❌ Under consideration</td>
116+
</tr>
117+
</tbody>
118+
</table>
119+
120+
\* Accelerated INT8 requires SM75+.
42121

43122
## :book: Documentation
44123
* [Official Documentation](https://huggingface.co/docs/bitsandbytes/main)

0 commit comments

Comments
 (0)