Skip to content

feat(kv_cache_calculator): Add New Model Supports#899

Merged
mag1c-h merged 8 commits intoModelEngine-Group:developfrom
Potterluo:opt_kvcache_calculator
Apr 13, 2026
Merged

feat(kv_cache_calculator): Add New Model Supports#899
mag1c-h merged 8 commits intoModelEngine-Group:developfrom
Potterluo:opt_kvcache_calculator

Conversation

@Potterluo
Copy link
Copy Markdown
Contributor

  • Add calculation formula and support for sliding window attention mechanism
  • Add calculation formula and support for hybrid architecture (Attention + SSM)
  • Update model type detection logic to support new architectures
  • Add support for new models: GLM-5, Qwen3.5, Kimi-K2.5, MiniMax-M2.5
  • Improve multimodal model configuration parsing functionality
  • Add configuration data for more mainstream models
  • Optimize model architecture type display and recognition logic

Test

image image image image image

… support

- Add calculation formula and support for sliding window attention mechanism
- Add calculation formula and support for hybrid architecture (Attention + SSM)
- Update model type detection logic to support new architectures
- Add support for new models: GLM-5, Qwen3.5, Kimi-K2.5, MiniMax-M2.5
- Improve multimodal model configuration parsing functionality
- Add configuration data for more mainstream models
- Optimize model architecture type display and recognition logic
… support

- Add calculation formula and support for sliding window attention mechanism
- Add calculation formula and support for hybrid architecture (Attention + SSM)
- Update model type detection logic to support new architectures
- Add support for new models: GLM-5, Qwen3.5, Kimi-K2.5, MiniMax-M2.5
- Improve multimodal model configuration parsing functionality
- Add configuration data for more mainstream models
- Optimize model architecture type display and recognition logic
@Potterluo Potterluo force-pushed the opt_kvcache_calculator branch from 02a3f39 to 2246501 Compare April 8, 2026 01:17
@mag1c-h mag1c-h merged commit e26fa0b into ModelEngine-Group:develop Apr 13, 2026
17 of 18 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants