Skip to content

tdt-loss: add TDT loss kernel#882

Open
ebezzam wants to merge 1 commit into
huggingface:mainfrom
ebezzam:tdt_loss
Open

tdt-loss: add TDT loss kernel#882
ebezzam wants to merge 1 commit into
huggingface:mainfrom
ebezzam:tdt_loss

Conversation

@ebezzam
Copy link
Copy Markdown

@ebezzam ebezzam commented May 19, 2026

What does this PR do?

Goal of this PR is to add a kernel that has been drafted by @eustlb for the recently merged Parakeet TDT.

It's a very rough draft with a lot of Claude help as it's my first time working with kernels 😅

TODO

Perhaps we can see how other kernels used in Transformers were integrated. As the kernel is for a function, maybe rotary_pos_emb is a good example? Here are the files in this repo.

Here is a draft PR for adding/using this kernel in Transformers: huggingface/transformers#46048

cc @vasqu

@ebezzam ebezzam requested review from danieldk and drbh as code owners May 19, 2026 07:51
@github-actions
Copy link
Copy Markdown

Hi @ebezzam, thanks for your interest in contributing!

This project requires that pull request authors are vouched, and you are not in the list of vouched users.

This PR will be closed automatically. See https://github.com/huggingface/kernels-community/blob/main/CONTRIBUTING.md for more details.

@github-actions github-actions Bot closed this May 19, 2026
@ebezzam ebezzam changed the title Initial commit, missing .cu file. Add TDT loss kernel May 19, 2026
@danieldk danieldk reopened this May 19, 2026
@danieldk danieldk changed the title Add TDT loss kernel tdt-loss: add TDT loss kernel May 19, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants