Skip to content

[Kernel][Experimental] feat: add Vulkan backend#1416

Draft
AlpinDale wants to merge 3 commits into
mainfrom
vulkan-backend
Draft

[Kernel][Experimental] feat: add Vulkan backend#1416
AlpinDale wants to merge 3 commits into
mainfrom
vulkan-backend

Conversation

@AlpinDale
Copy link
Copy Markdown
Collaborator

@AlpinDale AlpinDale commented Aug 14, 2025

Work-in-progress, experimental Vulkan backend for Aphrodite, with custom compute shaders, inspired by ggml-vulkan.

Current phase is still experimental and setting up the pipeline, runtime, and other basic functionalities. I don't anticipate this will be done any time soon!

TODO

  • Get the dispatcher to build
  • Implement activation functions
    • Implement GELU
    • Implement SwiGLU
  • Implement layernorm functions
  • Implement positional encoding functions
  • Implement Paged Attention
  • Implement Cache Kernels (w/ paged attn)
  • Implement Flash Attention
  • Implement Vulkan Sampling
  • Implement Quantization

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant