Commit 2b927cf
chore: QVAC-21914 address PR review — flush-cadence wording, nits
Non-behavioral cleanups from the PR tetherto#181 review pass:
- ggml-opencl graph_compute: correct the flush-cadence comment. The old
"per-token decode hot path submission-free by construction" claim was
false for multi-GB models — a decode step streams the whole model, so
its estimated work crosses the default 512 MB budget a few times per
token. Reworded to state that accurately (cost is negligible in
practice since clFlush is non-blocking, and it is tunable/zeroable to
make decode fully submission-free). Mechanism unchanged.
- ggml_cl_flash_attn: GGML_ASSERT(q->ne[1] <= INT32_MAX) before the int
n_q truncation, since the q-chunk loop accumulates into an int and
derives cl_ulong offsets from it (defensive; not reachable with real
shapes).
- Consistency: normalize the ticket tag to bare `QVAC-21914` (drop the
`qvac ` prefix) in clip.h and tests/CMakeLists.txt, matching the .cpp
files and the fork's QVAC-21257 precedent.
- tests/CMakeLists.txt: move the unconditional test-opencl-fa-chunking
registration up beside test-copy-tbq-subgroups (its self-skipping
sibling) instead of sitting right after the LLAMA_MTMD endif() where it
read as MTMD-gated; add a comment noting it deliberately does not link
mtmd.
No functional change to the fix; local mtmd + both tests build,
test-clip-fa-cutoff passes.1 parent 7056f4c commit 2b927cf
3 files changed
Lines changed: 26 additions & 15 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
5798 | 5798 | | |
5799 | 5799 | | |
5800 | 5800 | | |
5801 | | - | |
5802 | | - | |
5803 | | - | |
5804 | | - | |
| 5801 | + | |
| 5802 | + | |
| 5803 | + | |
| 5804 | + | |
| 5805 | + | |
| 5806 | + | |
| 5807 | + | |
| 5808 | + | |
5805 | 5809 | | |
5806 | 5810 | | |
5807 | 5811 | | |
| |||
12945 | 12949 | | |
12946 | 12950 | | |
12947 | 12951 | | |
| 12952 | + | |
| 12953 | + | |
| 12954 | + | |
| 12955 | + | |
| 12956 | + | |
12948 | 12957 | | |
12949 | 12958 | | |
12950 | 12959 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
254 | 254 | | |
255 | 255 | | |
256 | 256 | | |
257 | | - | |
258 | | - | |
259 | | - | |
| 257 | + | |
| 258 | + | |
| 259 | + | |
| 260 | + | |
| 261 | + | |
| 262 | + | |
| 263 | + | |
| 264 | + | |
| 265 | + | |
| 266 | + | |
| 267 | + | |
260 | 268 | | |
261 | 269 | | |
262 | 270 | | |
| |||
294 | 302 | | |
295 | 303 | | |
296 | 304 | | |
297 | | - | |
| 305 | + | |
298 | 306 | | |
299 | 307 | | |
300 | 308 | | |
301 | 309 | | |
302 | 310 | | |
303 | 311 | | |
304 | 312 | | |
305 | | - | |
306 | | - | |
307 | | - | |
308 | | - | |
309 | | - | |
310 | | - | |
311 | 313 | | |
312 | 314 | | |
313 | 315 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
122 | 122 | | |
123 | 123 | | |
124 | 124 | | |
125 | | - | |
| 125 | + | |
126 | 126 | | |
127 | 127 | | |
128 | 128 | | |
| |||
0 commit comments