[WIP]feat: support Speculative Decoding by Sglang Eagle algo#1176

Draft

TaoZex wants to merge 140 commits intoareal-project:mainfrom

Commits on Apr 13, 2026

feat: speculative decode init
bingyechen
committed
feat: add config
bingyechen
committed
feat: fix log
bingyechen
committed
feat: fix
bingyechen
committed
feat: fix
bingyechen
committed
feat: fix
bingyechen
committed
feat: fix
bingyechen
committed
feat: fix
bingyechen
committed

Commits on Apr 14, 2026

feat: fix code
bingyechen
committed
feat: add log
bingyechen
committed
fet: fix
bingyechen
committed
feat: fix
bingyechen
committed
feat: fix code
bingyechen
committed
feat: fix mtp
bingyechen
committed
feat: remove
bingyechen
committed
feat: change config
bingyechen
committed
feat: improve mtp_loss_scaling_factor
bingyechen
committed
feat: fix config
bingyechen
committed
feat: fix
bingyechen
committed
feat: fix local for test
bingyechen
committed
feat: bug fix
bingyechen
committed
feat: fix
bingyechen
committed
feat: add base config
bingyechen
committed
feat: remove mtp keep
bingyechen
committed

Commits on Apr 15, 2026

feat: fix mtp loss
bingyechen
committed
feat: fix ckpt
bingyechen
committed
feat: fix config oom
bingyechen
committed
feat: fix no mtp
bingyechen
committed
feat: fix config
bingyechen
committed
feat: fix
bingyechen
committed
feat: fix
bingyechen
committed

Commits on Apr 16, 2026

feat: add qwen
bingyechen
committed
feat: remove enable_draft_weights_cpu_backup
bingyechen
committed
feat: fix mtp loss
bingyechen
committed
feat: fix OOM
bingyechen
committed
feat: revert
bingyechen
committed
feat: add mem log
bingyechen
committed
feat: rm log
bingyechen
committed
feat: sample log
bingyechen
committed
feat: fix
bingyechen
committed

Commits on Apr 17, 2026

feat: fix mtp gradient
bingyechen
committed
feat: fix again
bingyechen
committed
feat： fix
bingyechen
committed

Commits on Apr 18, 2026

feat(engine): add mtp weight update
bingyechen
committed
feat(mtp): fix mtp weight update
bingyechen
committed

Commits on Apr 19, 2026

fix(controller): fix callback
bingyechen
committed
fix(controller): skip _NO_PROXY
bingyechen
committed
fix(controller): fix update
bingyechen
committed
feat(controller): add log
bingyechen
committed

Commits on Apr 20, 2026

fix(engine): cuda ipc sync
bingyechen
committed
fix(megatron): add log
bingyechen
committed
fix(engine): improve serialize
bingyechen
committed
fix(engine): skip NCCL broadcast
bingyechen
committed
fix(engine): improve
bingyechen
committed
fix(engine): fix nccl block
bingyechen
committed
refactor(rollout_controller): add log metric
bingyechen
committed
fix(engine): fix CUDA stream
bingyechen
committed
feat(megatron): add log
bingyechen
committed
fix(rollout_controller): add
bingyechen
committed
feat(megatron): fix
bingyechen
committed
refactor(megatron_engine): improve
bingyechen
committed

Commits on Apr 22, 2026

fix(mcore): deal eh_proj.weight
bingyechen
committed
fix(megatron_engine): remove code
bingyechen
committed
fix(megatron_engine): grad
bingyechen
committed

Commits on Apr 23, 2026

feat(megatron_engine): add mtp log
bingyechen
committed
fix: use _logger
bingyechen
committed

Commits on Apr 24, 2026

fix(engine): fix mtp gradient
bingyechen
committed
feat(mtp): add mtp lr
bingyechen
committed
fix(engine): add mtp clip
bingyechen
committed
refactor(megatron_engine): mv
bingyechen
committed
feat(megatron_engine): ad
bingyechen
committed

Commits on Apr 27, 2026

fix: h20 config
bingyechen
committed
perf: fix config
bingyechen
committed
feat: add log
bingyechen
committed
fix(scheduler): worker check、
bingyechen
committed
fix(infra): fix net
bingyechen
committed
fix(net): add callback(need rethink)
bingyechen
committed
fix(engine): double scale
bingyechen
committed
feat(actor): fix mtp_lr_scale
bingyechen
committed

Commits on Apr 28, 2026

fix(engine): fix mtp gradient numbatch
bingyechen
committed
fix(engine): lr
bingyechen
committed
feat(engine): megatron log
bingyechen
committed
feat(engine): audit log
bingyechen
committed
fix(megatron_engine): mimo weight update
bingyechen
committed

Commits on Apr 29, 2026

fix: scale up mtp_lr_scale
bingyechen
committed
fix(megatron_engine): add log
bingyechen
committed
feat(megatron_engine): fp32 weight update
bingyechen
committed

Commits on May 2, 2026

feat(engine): add full stage log
bingyechen
committed
fix(engine): fix mtp
bingyechen
committed
fix(megatron_engine): mtp nccl error
bingyechen
committed
fix(engine): fix again
bingyechen
committed
fix(megatron_engine): fix
bingyechen
committed

Commits on May 3, 2026

feat(engine): improve
bingyechen
committed
feat(megatron_engine): verify fp32 weight
bingyechen
committed
feat(engine): fix again
bingyechen
committed
feat(infra): read sglang weight for verify
bingyechen
committed
feat(engine): fix
bingyechen
committed
feat(megatron_engine): verify log
bingyechen
committed
fix(engine): mtp issue
bingyechen
committed
feat(controller): fix
bingyechen
committed
feat(controller): fix1
bingyechen
committed
fix(engine): fix
bingyechen
committed

Commits on May 4, 2026

fix(engine): v36
bingyechen
committed
fix(engine): fix
bingyechen
committed
fix(engine): fix
bingyechen
committed
feat(controller/engine): add callback log
bingyechen
committed
feat(controller/engine): add more
bingyechen
committed
feat(rollout): refactor code
bingyechen
committed
feat(engine): patch
bingyechen
committed
fix(engine): adapter
bingyechen
committed
refactor(engine): fix
bingyechen
committed
feat(engine): fix engine
bingyechen
committed
feat(engine): verify
bingyechen
committed
feat(megatron): trick
bingyechen
committed
fix: mtp_loss_scaling_factor
bingyechen
committed
feat(megatron_engine): bf16
bingyechen
committed

Commits on May 5, 2026

feat(megatron_engine): fix
bingyechen
committed
feat(megatron): mtp native
bingyechen
committed
feat: MTP L2 norm
bingyechen
committed
feat(engine): MTPSourceLossCap
bingyechen
committed
refactor(math): remove config
bingyechen
committed
fix: fix mtp_loss_scaling_factor
bingyechen
committed
fix: mtp_loss_scaling_factor
bingyechen
committed
fix(engine): remove shared weight
bingyechen
committed
feat(megatron_engine): SpecDecFlow
bingyechen
committed
feat: learn rate
bingyechen
committed
feat(megatron_engine): add
bingyechen
committed

Commits on May 6, 2026

feat(engine): MTPStochasticRoundBf16
bingyechen
committed

Commits on May 7, 2026

feat(megatron_engine): Align
bingyechen
committed
fix(mcore): hf convert
bingyechen
committed
fix: d1
bingyechen
committed
fix(mcore/mimo_mtp_hf_mapping): fix convert
bingyechen
committed

Commits on May 8, 2026

feat: mtp weight log
bingyechen
committed
feat: log
bingyechen
committed
feat(megatron): log1
bingyechen
committed
feat: log
bingyechen
committed
feat: MTPShipEntryAudit
bingyechen
committed
fix(engine): SigmaDeltaBf16
bingyechen
committed

Commits on May 9, 2026

feat(infra): MTPWireBytesFloat
bingyechen
committed

Commits on May 10, 2026

feat(remote_inf_engine): fix
bingyechen
committed