【draft】Mtp optimization#1266

Open

hiworldwzj wants to merge 57 commits intomainfrom

mtp_optimization

Commits on Apr 9, 2026

fix
hiworldwzj
committed
add gitignore

flyinglandlord
authored and
hiworldwzj
committed
finish usable mtp kernel

flyinglandlord
authored and
hiworldwzj
committed
end-to-end finish

flyinglandlord
authored and
hiworldwzj
committed
fix cudagraph support

flyinglandlord
authored and
hiworldwzj
committed
save runnable version of dynamic mtp

flyinglandlord
authored and
hiworldwzj
committed
save runnable version of dynamic mtp

flyinglandlord
authored and
hiworldwzj
committed
fix
hiworldwzj
committed
save fixed dynamic mtp

flyinglandlord
authored and
hiworldwzj
committed
save

flyinglandlord
authored and
hiworldwzj
committed
save

flyinglandlord
authored and
hiworldwzj
committed
add experiment script

flyinglandlord
authored and
hiworldwzj
committed
update mtp kernel support BLOCK_BATCH < max_verify_group_size

flyinglandlord
authored and
hiworldwzj
committed
fix implementation issues

flyinglandlord
authored and
hiworldwzj
committed
save

flyinglandlord
authored and
hiworldwzj
committed
save

flyinglandlord
authored and
hiworldwzj
committed
fix
hiworldwzj
committed
fix
hiworldwzj
committed
fix
hiworldwzj
committed
fix
hiworldwzj
committed
fix
hiworldwzj
committed
fix
hiworldwzj
committed
fix
hiworldwzj
committed
fix
hiworldwzj
committed
fix
hiworldwzj
committed
fix
hiworldwzj
committed
fix
hiworldwzj
committed
fix
hiworldwzj
committed
fix lightllm/server/router/model_infer/mode_backend/generic_pre_process.py
flyinglandlord
committed
update generic_pre_process.py
flyinglandlord
committed
fix
flyinglandlord
committed
fix
flyinglandlord
committed
refactor qwen3_eagle3
flyinglandlord
committed
add stage1
hiworldwzj
committed
fix
hiworldwzj
committed
fix
hiworldwzj
committed
fix
hiworldwzj
committed
fix
hiworldwzj
committed
fix
hiworldwzj
committed
fix
hiworldwzj
committed
fix
hiworldwzj
committed

Commits on Apr 10, 2026

Commits on Apr 11, 2026

fix
hiworldwzj
committed
fix
hiworldwzj
committed