Commit cb049b2
committed
docs(backends): note AMD-native quant lanes, GPTQ/AWQ/Marlin unsupported
design-rocm.md #15. Adds a concise ROCm/AMD subsection recording the
ecosystem finding from design-rocm.md §A.2: GGUF (q4_0/q4_K/q8_0), FP8
(W8A8), and MXFP4 (via AMD Quark) are the AMD-native quant lanes,
while GPTQ/AWQ/Marlin have no ROCm equivalent — Marlin, the fast
kernel both lean on, is hand-written Nvidia tensor-core PTX. Cites
design-rocm.md §A.2 and the vLLM ROCm quantization compatibility
matrix, so future ROCm quant work doesn't get scoped as "port GPTQ to
HIP" against the ecosystem's own grain.
Co-Authored-By: Virgil <virgil@lethean.io>1 parent 4969250 commit cb049b2
1 file changed
Lines changed: 21 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
45 | 45 | | |
46 | 46 | | |
47 | 47 | | |
| 48 | + | |
| 49 | + | |
| 50 | + | |
| 51 | + | |
| 52 | + | |
| 53 | + | |
| 54 | + | |
| 55 | + | |
| 56 | + | |
| 57 | + | |
| 58 | + | |
| 59 | + | |
| 60 | + | |
| 61 | + | |
| 62 | + | |
| 63 | + | |
| 64 | + | |
| 65 | + | |
| 66 | + | |
| 67 | + | |
| 68 | + | |
48 | 69 | | |
49 | 70 | | |
50 | 71 | | |
| |||
0 commit comments