Skip to content

Commit 48436de

Browse files
committed
fix: call hf_ptq.py directly for offline PTQ test
The huggingface_example.sh wrapper doesn't support --specdec_offline_dataset. Call hf_ptq.py directly with the correct args instead. Signed-off-by: Ye Yu <yey@nvidia.com> Signed-off-by: Ye Yu <yeyu@nvidia.com>
1 parent e342300 commit 48436de

1 file changed

Lines changed: 5 additions & 7 deletions

File tree

tests/examples/speculative_decoding/test_eagle_offline_ptq.py

Lines changed: 5 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -111,15 +111,13 @@ def test_offline_ptq(offline_ptq_dirs):
111111
"""Stage 3: run PTQ on the offline EAGLE checkpoint using the hidden state dataset."""
112112
run_example_command(
113113
[
114-
"scripts/huggingface_example.sh",
115-
"--no-verbose",
116-
"--model",
114+
"python",
115+
"hf_ptq.py",
116+
"--pyt_ckpt_path",
117117
str(offline_ptq_dirs["eagle_ckpt"] / "trained"),
118-
"--quant",
118+
"--qformat",
119119
"fp8",
120-
"--tasks",
121-
"quant",
122-
"--calib",
120+
"--calib_size",
123121
"2",
124122
"--batch_size",
125123
"1",

0 commit comments

Comments
 (0)