Skip to content

feat: update target hf model device decision method & add ds zero2 config#136

Merged
liusong1222 merged 1 commit into
Tencent:mainfrom
liusong1222:dev/speculative
Nov 7, 2025
Merged

feat: update target hf model device decision method & add ds zero2 config#136
liusong1222 merged 1 commit into
Tencent:mainfrom
liusong1222:dev/speculative

Conversation

@liusong1222
Copy link
Copy Markdown
Collaborator

feat: update target hf model device decision method & add ds zero2 config

  • Update target model wrapper with improved device decision logic
  • Add DeepSpeed ZeRO-2 configuration for distributed training
  • Enhance benchmark engine for better device handling
  • Refactor utility functions to support new device management

@liusong1222 liusong1222 merged commit 95e4bda into Tencent:main Nov 7, 2025
5 checks passed
dawnranger pushed a commit to dawnranger/AngelSlim that referenced this pull request Mar 11, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants