Skip to content

Commit 9e3b399

Browse files
committed
Update get_expert_linear_names
Signed-off-by: ajrasane <131806219+ajrasane@users.noreply.github.com>
1 parent 55f1e73 commit 9e3b399

2 files changed

Lines changed: 2 additions & 0 deletions

File tree

examples/llm_ptq/run_vllm.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -116,6 +116,7 @@ def main():
116116
max_model_len=args.max_model_len,
117117
trust_remote_code=args.trust_remote_code,
118118
quantization=quantization,
119+
enforce_eager=True,
119120
)
120121

121122
# Get sampling params from config, with CLI/defaults as fallback

modelopt/torch/export/layer_utils.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -972,6 +972,7 @@ def module_match_name_list(module, name_list):
972972
"Qwen3MoeSparseMoeBlock",
973973
"Qwen3NextSparseMoeBlock",
974974
"Qwen3_5MoeSparseMoeBlock",
975+
"Qwen3OmniMoeThinkerTextSparseMoeBlock",
975976
"DeepseekMoE",
976977
],
977978
):

0 commit comments

Comments
 (0)