Skip to content

Commit 930c9ba

Browse files
fix
1 parent c72f9e8 commit 930c9ba

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

docs/source/quickstart.mdx

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -27,12 +27,12 @@ bitsandbytes provides three main features:
2727
Load and run a model using 8-bit quantization:
2828

2929
```py
30-
from transformers import AutoModelForCausalLM, AutoTokenizer
30+
from transformers import AutoModelForCausalLM, AutoTokenizer, BitsAndBytesConfig
3131

3232
model = AutoModelForCausalLM.from_pretrained(
3333
"meta-llama/Llama-2-7b-hf",
3434
device_map="auto",
35-
load_in_8bit=True,
35+
quantization_config=BitsAndBytesConfig(load_in_8bit=True),
3636
)
3737

3838
tokenizer = AutoTokenizer.from_pretrained("meta-llama/Llama-2-7b-hf")

0 commit comments

Comments
 (0)