Skip to content

Commit fa0ae17

Browse files
[Doc] Fix int8 docs (#21487)
fix int8 docs
1 parent 1e4cf8b commit fa0ae17

1 file changed

Lines changed: 1 addition & 1 deletion

File tree

docs/source/en/perf_infer_gpu_one.mdx

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -40,7 +40,7 @@ Below are some notes to help you use this module, or follow the demos on [Google
4040

4141
### Requirements
4242

43-
- Make sure you run on NVIDIA GPUs that support 8-bit tensor cores (Turing, Ampere or newer architectures - e.g. T4, RTX20s RTX30s, A40-A100).
43+
- If you have `bitsandbytes<0.37.0`, make sure you run on NVIDIA GPUs that support 8-bit tensor cores (Turing, Ampere or newer architectures - e.g. T4, RTX20s RTX30s, A40-A100). For `bitsandbytes>=0.37.0`, all GPUs should be supported.
4444
- Install the correct version of `bitsandbytes` by running:
4545
`pip install bitsandbytes>=0.31.5`
4646
- Install `accelerate`

0 commit comments

Comments
 (0)