We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
2 parents e28ec3a + dcd33f1 commit 011f184Copy full SHA for 011f184
1 file changed
examples/GPTQ/README.md
@@ -72,7 +72,7 @@ This end-to-end example utilizes the common set of interfaces provided by `fms_m
72
73
```bash
74
lm_eval --model hf \
75
- --model_args pretrained="Meta-Llama-3-8B-GPTQ,dtype=float16,gptqmodel=True=True,enforce_eager=True" \
+ --model_args pretrained="Meta-Llama-3-8B-GPTQ,dtype=float16,gptqmodel=True,enforce_eager=True" \
76
--tasks lambada_openai \
77
--num_fewshot 5 \
78
--device cuda:0 \
0 commit comments