|
11 | 11 |
|
12 | 12 | | MS | Name | Items | Status | |
13 | 13 | |----|------|-------|--------| |
14 | | -| **M1** | Quick-Win-Welle | #1-5 (kombiniert) | ☐ offen | |
15 | | -| **M2** | Vulkan-Offensive | #6, #7, #9, #10, #12 | ☐ offen | |
| 14 | +| **M1** | Quick-Win-Welle | #1-5 (kombiniert) | ⏳ teilweise (#2✅, #5✅, #4⏳, #1❌) | |
| 15 | +| **M2** | Vulkan-Offensive | #6, #7, #9, #10, #12 | ⏳ blockiert (#6❌, #7⏭️, #9❌) | |
16 | 16 | | **M3** | MoE-Offloading v2 | #3, #13, #14, #15 | ☐ offen | |
17 | 17 | | **M4** | Speculative Decoding v2 | #11, #28 | ☐ offen | |
18 | 18 | | **M5** | Coopmat2 + Multi-GPU | #12, #20, #21 | ☐ offen | |
|
26 | 26 |
|
27 | 27 | | # | Status | Ansatz | Systeme | Aufwand | Existiert | Solo-Plan | Gain | |
28 | 28 | |---|--------|--------|---------|---------|-----------|-----------|------| |
29 | | -| 1 | ☐ | MTP Logits Copy Optimization | Mars, Styx | 2-3h | PR #23198 | [M1-Batch](plans/SESSION_PLAN_quickwins-batch1.md) | +20% PP mit MTP | |
30 | | -| 2 | ☐ | Tensor Split Regex Optimization | Uranus | 1-2h | PR #24710 | [M1-Batch](plans/SESSION_PLAN_quickwins-batch1.md) | befreit 40% decode thread | |
| 29 | +| 1 | ❌ | MTP Logits Copy Optimization | Mars, Styx | 2-3h | PR #23198 | [M1-Batch](plans/SESSION_PLAN_quickwins-batch1.md) | +20% PP mit MTP — **19 Konflikte in 10 Kern-Dateien, MTP OFF, skipped** | |
| 30 | +| 2 | ✅ | Tensor Split Regex Optimization | Uranus | 1-2h | PR #24710 (open) | [M1-Batch](plans/SESSION_PLAN_quickwins-batch1.md) | befreit 40% decode thread — **angewendet, Build grün auf Hydra+Mars** | |
31 | 31 | | 3 | ☐ | Pascal CUDA MMVQ Optimization | Styx | 2-3 Tage | PR #25479 | [M3](plans/SESSION_PLAN_pascal-mmvq.md) | +3-6% decode auf Pascal | |
32 | | -| 4 | ☐ | n-gram / Prompt-Lookup Decoding | Alle | 0h | in mainline | [M1-Batch](plans/SESSION_PLAN_quickwins-batch1.md) | hilft bei repetitiven Workloads | |
33 | | -| 5 | ☐ | GTT Size Tuning für Mars APU | Mars | 1h | Konfiguration | [M1-Batch](plans/SESSION_PLAN_quickwins-batch1.md) | >15GB GPU-Speicher | |
34 | | -| 6 | ☐ | Vulkan MUL_MAT_ID Subgroup Optimization | Mars, Venus | 1 Tag | PR #15524 | [M2](plans/SESSION_PLAN_mulmat-id-subgroup.md) | bis +657% MoE PP auf AMD | |
35 | | -| 7 | ☐ | Vulkan FlashAttention Refactor | Mars, Venus | 1 Woche | PR #19625 | [M2](plans/SESSION_PLAN_vulkan-fa-refactor.md) | 10-20% scalar FA improvement | |
| 32 | +| 4 | ⏳ | n-gram / Prompt-Lookup Decoding | Alle | 0h | in mainline | [M1-Batch](plans/SESSION_PLAN_quickwins-batch1.md) | hilft bei repetitiven Workloads — **verfügbar, Benchmark ausstehend** | |
| 33 | +| 5 | ✅ | GTT Size Tuning für Mars APU | Mars | 1h | Konfiguration | [M1-Batch](plans/SESSION_PLAN_quickwins-batch1.md) | >15GB GPU-Speicher — **bereits konfiguriert (26GB GTT), kein Tuning nötig** | |
| 34 | +| 6 | ❌ | Vulkan MUL_MAT_ID Subgroup Optimization | Mars, Venus | 1 Tag | PR #15524 | [M2](plans/SESSION_PLAN_mulmat-id-subgroup.md) | bis +657% MoE PP auf AMD — **23 Konflikte in 3 Vulkan-Dateien, Shader-Gen beschädigt, revertiert. Erfordert manuelle Portierung mit tiefem Vulkan-Shader-Verständnis** | |
| 35 | +| 7 | ⏭️ | Vulkan FlashAttention Refactor | Mars, Venus | 1 Woche | PR #19625 | [M2](plans/SESSION_PLAN_vulkan-fa-refactor.md) | 10-20% scalar FA improvement — **verschoben, abhängig von #6** | |
36 | 36 |
|
37 | 37 | ## Tier 2: Mittelfristig (1-3 Wochen) |
38 | 38 |
|
39 | 39 | | # | Status | Ansatz | Systeme | Aufwand | Existiert | Solo-Plan | Gain | |
40 | 40 | |---|--------|--------|---------|---------|-----------|-----------|------| |
41 | 41 | | 8 | ☐ | Mixed Precision KV Cache (Hot/Cold) | Alle | 1 Woche | commit e889fbd | später | Reduziert KV-Größe bei erhaltener Qualität | |
42 | | -| 9 | ☐ | Vulkan Shared Memory Staging Kernel | Mars, Venus | 2-3 Tage | PR #20897 | [M2](plans/SESSION_PLAN_vulkan-shmem-staging.md) | >2.5x TG potenziell | |
| 42 | +| 9 | ❌ | Vulkan Shared Memory Staging Kernel | Mars, Venus | 2-3 Tage | PR #20897 (closed) | [M2](plans/SESSION_PLAN_vulkan-shmem-staging.md) | >2.5x TG potenziell — **PR closed ohne Merge (AI-generiert), manuelle Portierung nötig** | |
43 | 43 | | 10 | ☐ | UMA Zero-Copy für Mars APU | Mars, Venus | 1-2 Wochen | PR #22462 | [M2](plans/SESSION_PLAN_uma-zero-copy.md) | +112x transfer speed | |
44 | 44 | | 11 | ☐ | EAGLE-3 Speculative Decoding | Alle | 2-3 Wochen | PR #18039 | [M4](plans/SESSION_PLAN_eagle3.md) | bis 6.5x speedup | |
45 | 45 | | 12 | ☐ | Vulkan Cooperative Matrix (Coopmat2) | Mars, Uranus | 2-3 Wochen | PR #19075 | [M5](plans/SESSION_PLAN_coopmat2-rdna3.md) | 2.5x FA multiply | |
|
0 commit comments