-
Notifications
You must be signed in to change notification settings - Fork 39
[Feature]: GEMM + ReduceScatter #105
Copy link
Copy link
Closed
1 / 21 of 2 issues completedLabels
enhancementNew feature or requestNew feature or requestexamplesExamples showcasing Iris APIs and usageExamples showcasing Iris APIs and usagehelp wantedExtra attention is neededExtra attention is neededirisIris project issueIris project issue
Description
Metadata
Metadata
Assignees
Labels
enhancementNew feature or requestNew feature or requestexamplesExamples showcasing Iris APIs and usageExamples showcasing Iris APIs and usagehelp wantedExtra attention is neededExtra attention is neededirisIris project issueIris project issue
Type
Fields
Give feedbackNo fields configured for issues without a type.
Suggestion Description
Implement GEMM+ReduceScatter using Iris. See TritonDistributed example for reference.
Also see: https://github.com/vllm-project/vllm/blob/b78bed1bc5debead116092f429eee51398691fc8/vllm/compilation/collective_fusion.py#L53-L84
Implementation variants:
See comment here: #169 (comment)
Operating System
No response
GPU
No response
ROCm Component
No response