Skip to content

[kernel] feat: hybrid CPU-GPU MoE inference#1550

Draft
AlpinDale wants to merge 2 commits into
mainfrom
cpu-gpu-hybrid
Draft

[kernel] feat: hybrid CPU-GPU MoE inference#1550
AlpinDale wants to merge 2 commits into
mainfrom
cpu-gpu-hybrid

[config] feat: set default chunked prefill size and update environmen…

07d9232
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar