Reduce allocation overhead in quantized sdpa #20059
| Job | Run time |
|---|---|
| 7m 36s | |
| 7m 8s | |
| 7m 35s | |
| 6m 46s | |
| 7m 0s | |
| 7m 18s | |
| 5m 48s | |
| 6m 7s | |
| 7m 3s | |
| 6m 22s | |
| 15m 51s | |
| 6m 27s | |
| 6m 41s | |
| 7m 27s | |
| 13m 14s | |
| 1h 58m 23s |
| Job | Run time |
|---|---|
| 7m 36s | |
| 7m 8s | |
| 7m 35s | |
| 6m 46s | |
| 7m 0s | |
| 7m 18s | |
| 5m 48s | |
| 6m 7s | |
| 7m 3s | |
| 6m 22s | |
| 15m 51s | |
| 6m 27s | |
| 6m 41s | |
| 7m 27s | |
| 13m 14s | |
| 1h 58m 23s |