Skip to content

Commit 3938f2e

Browse files
committed
Update get_expert_linear_names
Signed-off-by: ajrasane <131806219+ajrasane@users.noreply.github.com>
1 parent 7a857ad commit 3938f2e

File tree

2 files changed

+2
-0
lines changed

2 files changed

+2
-0
lines changed

examples/llm_ptq/run_vllm.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -116,6 +116,7 @@ def main():
116116
max_model_len=args.max_model_len,
117117
trust_remote_code=args.trust_remote_code,
118118
quantization=quantization,
119+
enforce_eager=True,
119120
)
120121

121122
# Get sampling params from config, with CLI/defaults as fallback

modelopt/torch/export/layer_utils.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -972,6 +972,7 @@ def module_match_name_list(module, name_list):
972972
"Qwen3MoeSparseMoeBlock",
973973
"Qwen3NextSparseMoeBlock",
974974
"Qwen3_5MoeSparseMoeBlock",
975+
"Qwen3OmniMoeThinkerTextSparseMoeBlock",
975976
"DeepseekMoE",
976977
],
977978
):

0 commit comments

Comments
 (0)