Skip to content

Enable Snapdragon backend support in Rust llama.cpp integration #956

@ghost

Description

llama.cpp now has an experimental Snapdragon backend for:

  • Android
  • Windows on Snapdragon

Docs:

Rust-side support for this backend can be added, including:

  • Cargo/build feature wiring for Snapdragon backends (GGML_OPENCL, GGML_HEXAGON)
  • runtime device/backend selection where needed
  • target support for Android arm64 and Windows arm64

This is Snapdragon-specific, and the Windows Hexagon path has additional SDK/driver/signing requirements per upstream docs.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions