You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
> **Learn more:** See the [Integrations guide](./integrations) for more details on using bitsandbytes with Transformers.
45
+
44
46
### 4-bit Quantization
45
47
46
48
For even greater memory savings:
@@ -91,6 +93,8 @@ model = get_peft_model(model, lora_config)
91
93
# Now train with your preferred trainer
92
94
```
93
95
96
+
> **Learn more:** See the [FSDP-QLoRA guide](./fsdp_qlora) for advanced training techniques and the [Integrations guide](./integrations) for using with PEFT.
97
+
94
98
### 8-bit Optimizers
95
99
96
100
Use 8-bit optimizers to reduce training memory by 75%:
@@ -111,6 +115,8 @@ for batch in dataloader:
111
115
optimizer.zero_grad()
112
116
```
113
117
118
+
> **Learn more:** See the [8-bit Optimizers guide](./optimizers) for detailed usage and configuration options.
119
+
114
120
### Custom Quantized Layers
115
121
116
122
Use quantized linear layers directly in your models:
0 commit comments