Skip to content

Feature: Support Qwen3-VL and HunyuanOCR eagle3 speculative decoding#196

Merged
irisliu10 merged 2 commits into
Tencent:mainfrom
irisliu10:speculative_decoding_vlm
Jan 12, 2026
Merged

Feature: Support Qwen3-VL and HunyuanOCR eagle3 speculative decoding#196
irisliu10 merged 2 commits into
Tencent:mainfrom
irisliu10:speculative_decoding_vlm

Conversation

@irisliu10
Copy link
Copy Markdown
Collaborator

No description provided.

from .offline_dataset_builder import OfflineLLMDatasetBuilder, OfflineVLMDatasetBuilder
from .online_dataset_builder import OnlineLLMDatasetBuilder, OnlineVLMDatasetBuilder
from .offline_dataset_builder import (
OfflineLLMDatasetBuilder,
Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

不用import OfflineVLMDatasetBuilder?

"attention_mask",
"loss_mask",
"inputs_embeds",
# "inputs_embeds",
Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

inputs_embeds暂时用不到可记个todo,或先删除掉该字段,用的时候再增加

@irisliu10 irisliu10 merged commit c35fb3b into Tencent:main Jan 12, 2026
5 checks passed
dawnranger pushed a commit to dawnranger/AngelSlim that referenced this pull request Mar 11, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants