Skip to content

aiter-rope: Add layer repo for apply_rotary_transformers#996

Open
Abdennacer-Badaoui wants to merge 1 commit into
huggingface:mainfrom
Abdennacer-Badaoui:aiter-rope-layer-repo
Open

aiter-rope: Add layer repo for apply_rotary_transformers#996
Abdennacer-Badaoui wants to merge 1 commit into
huggingface:mainfrom
Abdennacer-Badaoui:aiter-rope-layer-repo

Conversation

@Abdennacer-Badaoui

Copy link
Copy Markdown
Member

Adds an nn.Module layer version of apply_rotary_transformers (mirrors #949 for rotary) so it works with the layer-repo path in huggingface/transformers#46883. Function kept for BC.

@drbh drbh added backend: rocm AMD / AITER kernels new-layer Adds or extends a LayerRepo size: S Diff <= 50 lines type: feature New functionality / capability labels Jun 30, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

backend: rocm AMD / AITER kernels new-layer Adds or extends a LayerRepo size: S Diff <= 50 lines type: feature New functionality / capability

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants