Skip to content

Commit acb1a5b

Browse files
doc
1 parent 521dfb1 commit acb1a5b

1 file changed

Lines changed: 6 additions & 0 deletions

File tree

docs/source/quickstart.mdx

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -41,6 +41,8 @@ outputs = model.generate(**inputs, max_new_tokens=20)
4141
print(tokenizer.decode(outputs[0]))
4242
```
4343

44+
> **Learn more:** See the [Integrations guide](./integrations) for more details on using bitsandbytes with Transformers.
45+
4446
### 4-bit Quantization
4547

4648
For even greater memory savings:
@@ -91,6 +93,8 @@ model = get_peft_model(model, lora_config)
9193
# Now train with your preferred trainer
9294
```
9395

96+
> **Learn more:** See the [FSDP-QLoRA guide](./fsdp_qlora) for advanced training techniques and the [Integrations guide](./integrations) for using with PEFT.
97+
9498
### 8-bit Optimizers
9599

96100
Use 8-bit optimizers to reduce training memory by 75%:
@@ -111,6 +115,8 @@ for batch in dataloader:
111115
optimizer.zero_grad()
112116
```
113117

118+
> **Learn more:** See the [8-bit Optimizers guide](./optimizers) for detailed usage and configuration options.
119+
114120
### Custom Quantized Layers
115121

116122
Use quantized linear layers directly in your models:

0 commit comments

Comments
 (0)