Skip to content

fix w_group_size KeyError in DeepSeek per-tensor quant#50

Merged
yghstill merged 1 commit into
Tencent:mainfrom
ali-88123:dev_fix
Aug 21, 2025
Merged

fix w_group_size KeyError in DeepSeek per-tensor quant#50
yghstill merged 1 commit into
Tencent:mainfrom
ali-88123:dev_fix

Conversation

@ali-88123
Copy link
Copy Markdown
Collaborator

@ali-88123 ali-88123 commented Aug 21, 2025

解决执行 python3 tools/run.py -c configs/deepseek_r1/fp8_static/deepseek_r1_fp8_static_low_memmory.yaml 时的报错问题。

报错位置:
File "AngelSlim/angelslim/models/llm/deepseek.py", line 166, in get_qdq_module

@ali-88123 ali-88123 requested a review from yghstill August 21, 2025 11:28
@yghstill yghstill merged commit b7c43b4 into Tencent:main Aug 21, 2025
4 checks passed
@ali-88123 ali-88123 deleted the dev_fix branch August 25, 2025 07:22
WOODchen7 pushed a commit to WOODchen7/AngelSlim that referenced this pull request Aug 27, 2025
dawnranger pushed a commit to dawnranger/AngelSlim that referenced this pull request Mar 11, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants