Skip to content

Commit 214942e

Browse files
authored
fix kernel output extract (PaddlePaddle#5208)
1 parent df427ba commit 214942e

1 file changed

Lines changed: 1 addition & 1 deletion

File tree

fastdeploy/spec_decode/mtp.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -799,7 +799,7 @@ def _propose(self, step_use_cudagraph: bool = False):
799799
self.model_inputs["is_block_step"],
800800
self.model_inputs["decode_states"],
801801
self.model_inputs["mask_rollback"],
802-
)[0]
802+
)
803803
self.model_inputs["attn_mask_offsets"].copy_(attn_mask_offsets, False)
804804

805805
# Initialize forward meta data

0 commit comments

Comments
 (0)