Skip to content
This repository was archived by the owner on Jan 24, 2024. It is now read-only.

Allow loading model with BitsAndBytes 4bit quantization, PEFT LoRA adapters.#203

Open
idoru wants to merge 6 commits into
hyperonym:masterfrom
idoru:4bit-quantization
Open

Allow loading model with BitsAndBytes 4bit quantization, PEFT LoRA adapters.#203
idoru wants to merge 6 commits into
hyperonym:masterfrom
idoru:4bit-quantization

Pass kwargs to PeftModel loading

33a37c1
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs