SDPA decode perf improvements for qwen-3.5-35B-A3B #12572
| Job | Run time |
|---|---|
| 40m 17s | |
| 43m 50s | |
| 16m 6s | |
| 21m 35s | |
| 16m 25s | |
| 17m 35s | |
| 21m 4s | |
| 22m 21s | |
| 27m 37s | |
| 1h 4m 36s | |
| 22m 29s | |
| 31m 0s | |
| 22m 1s | |
| 32m 53s | |
| 18m 3s | |
| 32m 52s | |
| 34m 8s | |
| 26m 2s | |
| 30m 49s | |
| 33m 5s | |
| 22m 1s | |
| 28m 34s | |
| 2s | |
| 21m 21s | |
| 19m 41s | |
| 19m 49s | |
| 14m 6s | |
| 29m 10s | |
| 15m 25s | |
| 14m 21s | |
| 27m 36s | |
| 15m 49s | |
| 13m 58s | |
| 14m 10s | |
| 28m 34s | |
| 24m 18s | |
| 29m 9s | |
| 14m 44s | |
| 15m 30s | |
| 14m 12s | |
| 15h 57m 18s |